ThuleanPerspective@eviltoast.org
on 21 Mar 2024 14:19
nextcollapse
ON LEMMY HOT POCKETS FEED JANNIES COPE JANNIES CITY SLICKER CHUCK’S JANNIES CITY SLICKER FANCY GERMAN CAR CHUCK GUCCI LOAFERS CHUCK CITY SLICKER FEED FEED HOT POCKETS I CAN’T JANNIES SUCK JANNIES AND I CAN’T SNEED ON LEMMY CITY SLICKER HOT POCKETS CHUCK DILATE COPE FOR FREE FLOYD PARK AVENUE MANICURE SEETHE JANNY I CAN’T HOT POCKETS AND FANCY GERMAN CAR FLOYD PARK AVENUE MANICURE CHUCK SUCK SUCK SNEED’S FLOYD CHUCK’S DILATE AND
ThuleanPerspective@eviltoast.org
on 21 Mar 2024 14:19
nextcollapse
AND HOT POCKETS CITY SLICKER FANCY GERMAN CAR FUCK FOR FREE COPE I CAN’T SNEED’S FANCY GERMAN CAR I CAN’T DILATE CITY SLICKER SNEED’S SNEED CITY SLICKER COPE PARK AVENUE MANICURE AND SEETHE GUCCI LOAFERS CHUCK’S JANNIES SUCK GUCCI LOAFERS CITY SLICKER JANNIES DILATE HOT POCKETS DILATE JANNIES ON LEMMY FANCY GERMAN CAR FOR FREE SEED CLEAN IT UP FEED JANNY PARK AVENUE MANICURE COPE CHUCK’S CITY SLICKER FLOYD I CAN’T SEETHE FUCK FANCY GERMAN CAR GUCCI LOAFERS SNEED’S FLOYD
ThuleanPerspective@eviltoast.org
on 21 Mar 2024 14:19
nextcollapse
I CAN’T PARK AVENUE MANICURE FLOYD FLOYD CITY SLICKER CITY SLICKER CHUCK’S FLOYD CITY SLICKER COPE CHUCK’S CHUCK ON LEMMY SEED SEED DILATE SNEED JANNIES SEED FEED CHUCK CITY SLICKER SUCK I CAN’T SUCK CLEAN IT UP SUCK SUCK AND FANCY GERMAN CAR CITY SLICKER FOR FREE COPE JANNY PARK AVENUE MANICURE I CAN’T I CAN’T JANNIES PARK AVENUE MANICURE PARK AVENUE MANICURE I CAN’T JANNIES CITY SLICKER ON LEMMY ON LEMMY DILATE COPE JANNY HOT POCKETS SNEED
ThuleanPerspective@eviltoast.org
on 21 Mar 2024 14:19
nextcollapse
CHUCK HOT POCKETS ON LEMMY SEETHE FOR FREE FEED ON LEMMY FEED DILATE FANCY GERMAN CAR ON LEMMY I CAN’T I CAN’T AND SEETHE SEETHE COPE FEED FOR FREE SEETHE ON LEMMY SEED SEETHE SUCK HOT POCKETS CITY SLICKER ON LEMMY CHUCK GUCCI LOAFERS CLEAN IT UP JANNY SEED GUCCI LOAFERS FUCK SNEED FUCK SNEED CHUCK JANNIES SEED CITY SLICKER CLEAN IT UP CLEAN IT UP SNEED’S CITY SLICKER ON LEMMY AND SNEED ON LEMMY SNEED’S
ThuleanPerspective@eviltoast.org
on 21 Mar 2024 14:19
nextcollapse
I CAN’T JANNIES AND PARK AVENUE MANICURE CLEAN IT UP SUCK CITY SLICKER CHUCK’S FOR FREE DILATE GUCCI LOAFERS PARK AVENUE MANICURE CLEAN IT UP ON LEMMY FLOYD CITY SLICKER FUCK FLOYD FEED FOR FREE CHUCK ON LEMMY HOT POCKETS DILATE SNEED SUCK FEED SUCK GUCCI LOAFERS CHUCK ON LEMMY JANNY FOR FREE FANCY GERMAN CAR JANNY HOT POCKETS JANNY COPE FOR FREE CHUCK’S GUCCI LOAFERS DILATE JANNY FANCY GERMAN CAR CHUCK’S JANNIES FEED SNEED GUCCI LOAFERS JANNY
ThuleanPerspective@eviltoast.org
on 21 Mar 2024 14:21
nextcollapse
HOT POCKETS FUCK GUCCI LOAFERS HOT POCKETS SEED CLEAN IT UP FLOYD FLOYD FANCY GERMAN CAR JANNY HOT POCKETS ON LEMMY SNEED’S I CAN’T SNEED’S DILATE FANCY GERMAN CAR JANNIES SEETHE SEED SEETHE CHUCK CHUCK FOR FREE SNEED SEETHE CHUCK CLEAN IT UP SEETHE HOT POCKETS SEED CHUCK’S SNEED SEETHE FEED CHUCK SUCK GUCCI LOAFERS AND JANNY FOR FREE FLOYD FLOYD FUCK DILATE CHUCK’S ON LEMMY DILATE FEED PARK AVENUE MANICURE
ThuleanPerspective@eviltoast.org
on 21 Mar 2024 14:21
nextcollapse
FOR FREE JANNIES SEED CHUCK’S CHUCK DILATE FANCY GERMAN CAR JANNY PARK AVENUE MANICURE FOR FREE SNEED’S FEED DILATE I CAN’T FUCK DILATE SNEED SEED PARK AVENUE MANICURE FLOYD CLEAN IT UP FLOYD FUCK SNEED DILATE SUCK SEED CITY SLICKER SNEED CHUCK CITY SLICKER FEED PARK AVENUE MANICURE CITY SLICKER SEETHE FEED FEED FLOYD AND SNEED FEED FEED CHUCK’S SNEED FEED DILATE FUCK CITY SLICKER SNEED’S FOR FREE
ThuleanPerspective@eviltoast.org
on 21 Mar 2024 14:21
nextcollapse
FEED AND SNEED DILATE I CAN’T CITY SLICKER JANNIES GUCCI LOAFERS FUCK FUCK AND ON LEMMY HOT POCKETS PARK AVENUE MANICURE COPE CITY SLICKER FLOYD FUCK FLOYD ON LEMMY SEETHE HOT POCKETS SNEED’S ON LEMMY CLEAN IT UP CLEAN IT UP SEED GUCCI LOAFERS ON LEMMY FEED PARK AVENUE MANICURE FLOYD JANNY SUCK FOR FREE FUCK CHUCK’S AND FLOYD SEED I CAN’T SEED I CAN’T FANCY GERMAN CAR DILATE PARK AVENUE MANICURE FLOYD CHUCK’S DILATE HOT POCKETS
ThuleanPerspective@eviltoast.org
on 21 Mar 2024 14:21
nextcollapse
JANNIES ON LEMMY CITY SLICKER GUCCI LOAFERS CHUCK’S FLOYD SNEED SNEED CLEAN IT UP FLOYD GUCCI LOAFERS CHUCK’S JANNY SUCK FOR FREE CHUCK’S CITY SLICKER CLEAN IT UP SNEED’S SUCK SEED FOR FREE FUCK SNEED’S JANNIES CLEAN IT UP SUCK FUCK COPE SNEED’S SNEED’S COPE FOR FREE FOR FREE SEETHE HOT POCKETS HOT POCKETS FANCY GERMAN CAR SNEED AND JANNIES SNEED PARK AVENUE MANICURE JANNIES FUCK DILATE GUCCI LOAFERS FOR FREE FLOYD SEED
ThuleanPerspective@eviltoast.org
on 21 Mar 2024 14:21
nextcollapse
SNEED COPE I CAN’T FUCK FUCK AND SNEED SNEED CLEAN IT UP FANCY GERMAN CAR SEETHE ON LEMMY CHUCK’S HOT POCKETS AND CITY SLICKER SEED FLOYD HOT POCKETS JANNIES CITY SLICKER FANCY GERMAN CAR AND FUCK FANCY GERMAN CAR CITY SLICKER SEED CITY SLICKER JANNY JANNIES CHUCK’S SUCK AND CLEAN IT UP I CAN’T JANNIES COPE DILATE CHUCK SEETHE FLOYD FOR FREE CITY SLICKER FANCY GERMAN CAR CITY SLICKER FANCY GERMAN CAR GUCCI LOAFERS DILATE SEED AND
ThuleanPerspective@eviltoast.org
on 21 Mar 2024 14:21
nextcollapse
SEETHE FANCY GERMAN CAR PARK AVENUE MANICURE FANCY GERMAN CAR SNEED DILATE HOT POCKETS COPE I CAN’T ON LEMMY SNEED AND SUCK CHUCK CLEAN IT UP GUCCI LOAFERS SNEED’S FUCK SEED FANCY GERMAN CAR FANCY GERMAN CAR GUCCI LOAFERS JANNIES SNEED’S I CAN’T HOT POCKETS FEED CLEAN IT UP CHUCK’S HOT POCKETS I CAN’T FEED SUCK SNEED CITY SLICKER SEED FOR FREE SEED SEETHE AND GUCCI LOAFERS JANNY CITY SLICKER FUCK CITY SLICKER SNEED FEED I CAN’T DILATE SEED
ThuleanPerspective@eviltoast.org
on 21 Mar 2024 14:21
nextcollapse
SEETHE FOR FREE SUCK FOR FREE DILATE DILATE PARK AVENUE MANICURE PARK AVENUE MANICURE SEETHE FUCK FEED CHUCK’S CLEAN IT UP FANCY GERMAN CAR AND SEETHE CITY SLICKER SEETHE CLEAN IT UP AND PARK AVENUE MANICURE SNEED’S CHUCK FOR FREE HOT POCKETS ON LEMMY AND FUCK SEETHE FEED HOT POCKETS JANNY JANNIES SNEED’S JANNY I CAN’T CHUCK I CAN’T CHUCK COPE SUCK PARK AVENUE MANICURE SUCK CHUCK’S AND HOT POCKETS FLOYD CLEAN IT UP GUCCI LOAFERS CHUCK’S
ThuleanPerspective@eviltoast.org
on 21 Mar 2024 14:22
nextcollapse
I CAN’T DILATE ON LEMMY HOT POCKETS SEED I CAN’T SEED FLOYD JANNIES CHUCK FANCY GERMAN CAR SEETHE FUCK JANNIES HOT POCKETS CHUCK’S FANCY GERMAN CAR HOT POCKETS AND PARK AVENUE MANICURE SEED SNEED’S SNEED’S JANNY CITY SLICKER GUCCI LOAFERS SNEED I CAN’T FANCY GERMAN CAR SEETHE SEED AND I CAN’T GUCCI LOAFERS FOR FREE HOT POCKETS COPE FLOYD COPE HOT POCKETS DILATE PARK AVENUE MANICURE HOT POCKETS SEETHE I CAN’T SNEED CLEAN IT UP PARK AVENUE MANICURE ON LEMMY CLEAN IT UP
ThuleanPerspective@eviltoast.org
on 21 Mar 2024 14:22
nextcollapse
FUCK FEED SNEED FOR FREE FLOYD SNEED’S CHUCK HOT POCKETS ON LEMMY ON LEMMY JANNY AND SEED PARK AVENUE MANICURE ON LEMMY SUCK SNEED’S CHUCK FUCK CHUCK FUCK FANCY GERMAN CAR CITY SLICKER FANCY GERMAN CAR SEED FEED SNEED CITY SLICKER CITY SLICKER FUCK COPE JANNY FOR FREE FEED SEED GUCCI LOAFERS ON LEMMY SNEED’S JANNY DILATE HOT POCKETS GUCCI LOAFERS FLOYD DILATE I CAN’T AND FOR FREE SEED CHUCK’S CITY SLICKER
A lot of the newbies were simply clueless, not necessarily lacking intelligence. Still, they were generating a sudden and huge influx of low quality “content” aka noise, lowering the ability of the [previous] userbase to find what it wanted, and that userbase got understandably pissed.
And eventually this was solved - some platforms died, some got moribund, but the ones that were able to ride on the new times thrived. And more importantly, the internet as a whole found ways to contain and sort that noise.
That’s a lot like what’s happening now, except that the agents are not a huge crowd of noobs - they’re a handful of shitty people using LLMs and Stable Diffusion to do so.
lol. a massive growth in real, human, users is not “similar” to a massive growth in fake undependable data with zero to negative value.
BetaDoggo_@lemmy.world
on 21 Mar 2024 15:24
nextcollapse
This article is grossly overstating the findings of the paper. It’s true that bad generated data hurts model performance, but that’s true of bad human data as well. The paper used opt125M as their generator model, a very small research model with fairly low quality and often incoherent outputs. The higher quality generated data which makes up a majority of the generated text online is far less of an issue. The use of generated data to improve output consistency is a common practice for both text and image models.
Tbh I think you’re making a lot of assumptions and ignoring the point of this paper. The small model was used to quickly show proof of generative degradation over itérations when the model was trained on its own output data. The use of opt125 was used precisely due to its small size so they could demonstrate this phenomenon in less iterations. The point still stands that this shows that data poisoning exists, and just because a Model is much bigger doesn’t make sense that it would be immune to this effect, just that it will take longer. I suspect that with companies continually scraping the web and sources for data, like reddit which this article mentions has struck a deal with Google to allow their models to train off of, this process will not in fact take too long as more and more of reddit posts become AI generated in itself.
I think it’s a fallacy to assume that a giant model is therefore “higher quality” and resistant to data poisoning
Is it being poisoned because the generated data is garbage or because the generated data is made by an AI?
Using a small model let’s it be shown faster but also means the outputs are seriously terrible. It’s common to fine tune models on gpt4 outputs which directly goes against this.
And there is a correlation between size and performance. It’s not a rule per say and people are working hard on squeezing more and more out of small models, but it’s not a fallacy to assume bigger is better.
Cyv_@lemmy.blahaj.zone
on 21 Mar 2024 16:13
collapse
I think it’s also worth keeping in mind that some people use AI to generate “real sounding” content for clicks, or for scams, rather than making actual decent content. I’d argue humans making shitty content is going to be on a much worse scale as AI helps automate it. The other thing is I worry AI can’t as easily tell human or AI made bullshit from decent content. I may know the top 2 google results are AI gen clickbait, but whatever is scraping content en masse may not bother to differentiate. So it might become an exponential issue.
spujb@lemmy.cafe
on 21 Mar 2024 16:30
nextcollapse
i miss when we had kept gpt unpublished because it was “too dangerous”. i wish we could have released it in a more mature way.
because we were right. we couldn’t be trusted and immediately ruined the biggest wonder of humanity by having it generate thousands to millions of articles for a quick buck. toothpaste is out of the tube now and it can never go back in.
Someone would have made one eventually. Unless the government monitors every computer in existence, AI is inevitable.
JackGreenEarth@lemm.ee
on 21 Mar 2024 17:03
nextcollapse
And just to make it clear, we should not give the government the ability to monitor every computer in existence, or even any computer not owned by them.
spujb@lemmy.cafe
on 21 Mar 2024 17:29
nextcollapse
also, there are absolutely other ways to regulate technology, especially since it’s a tech that’s being bought and sold.
“monitor every computer” is emphatically not the only solution ? and it’s weird that they suggested that lol
it’s not the “making one” that’s a problem. it’s the making, optimizing and rabid marketing of one in the service of capital instead of humans.
if only a bunch of open source, true non-profits released language models, the landscape might still suck but would be distinctly less toxic.
and if the government (or even a decently sized ngo standards entity) had worked proactively with computer scientists to find solutions like watermarking, labor replacement protections, and copyright protections, things might be arguably perfect. not one of those things happened and so further into the hellscape we descend.
furzegulo@lemmy.dbzer0.com
on 21 Mar 2024 16:32
nextcollapse
good riddance i say
r3df0x@7.62x54r.ru
on 21 Mar 2024 16:52
nextcollapse
Are they talking about inbreeding when most of the online content is AI generated and AI starts training on other AI data?
pixxelkick@lemmy.world
on 21 Mar 2024 17:33
nextcollapse
I’ve been calling this for awhile now.
I’ve been calling it the Ouroboros effect.
There’s even bigger parts at play the paper didn’t even dig into, and that’s selective bias dye to human intervention.
See at first let’s say an AI has 100 unique outputs for a given prompt.
However, humans will favor let’s say half of em. Humans will naturally regenerate a couple times and pick their preferred “cream of the crop” result.
This will then ouroboros for an iteration.
Now the next iteration only has say 50 unique responses, as half of them have been ouroboros’d away by humans picking the one they like more.
Repeat, each time “half-lifing” the originality.
Over time, everything will get more abd more sameish. Models will degrade on originality as everything muddles into corporate speak.
You know how every corporate website uses the same useless “doesn’t mean anything” jargon string of words, to say a lot without actually saying anything?
That’s how AI is going to local minima to, as it keeps getting selectively “bred” to speak in an appealing and nonspecific way for the majority of online content.
I mean that’s kind of how chatgpt is now, I’ve been slowly getting into llama, can’t quite get it as good as gpt yet but I’m learning
dumples@kbin.social
on 21 Mar 2024 18:11
nextcollapse
This was evitable with how much money and speed was spent to get these up and running. As they get more widespread they will just poison each other and overfit like crazy. Hopefully it will happen sooner than later
When the cited paper came out it was the first looking at this. And even with just 10% of the original data the effects were mitigated.
Since, another paper found a mix of synthetic and organic data is the best performing mixture.
The quality of the models producing the synthetic data matters a lot.
Other research has found huge benefits in training models with synthetic data from SotA models.
Models are only getting better, meaning the quality of synthetic data will be improving.
It only leads to collapse if all organic data representing long tails of data variety disappear. Which hopefully throws water on x-risk doomers as AI killing humanity would currently be a murder suicide.
threaded - newest
ON LEMMY HOT POCKETS FEED JANNIES COPE JANNIES CITY SLICKER CHUCK’S JANNIES CITY SLICKER FANCY GERMAN CAR CHUCK GUCCI LOAFERS CHUCK CITY SLICKER FEED FEED HOT POCKETS I CAN’T JANNIES SUCK JANNIES AND I CAN’T SNEED ON LEMMY CITY SLICKER HOT POCKETS CHUCK DILATE COPE FOR FREE FLOYD PARK AVENUE MANICURE SEETHE JANNY I CAN’T HOT POCKETS AND FANCY GERMAN CAR FLOYD PARK AVENUE MANICURE CHUCK SUCK SUCK SNEED’S FLOYD CHUCK’S DILATE AND
<img alt="" src="https://lemmygrad.ml/pictrs/image/d0f23042-9f46-42fb-86bd-2a08538c6bc1.png"> <img alt="" src="https://lemmygrad.ml/pictrs/image/d89a4c13-1e16-4021-a5af-08927279297b.png"> <img alt="" src="https://czchan.org/uploads/1710961305917656.png"> <img alt="" src="https://czchan.org/uploads/1710961306111010.gif"> <img alt="" src="https://czchan.org/uploads/1710961307845375.png">
AND HOT POCKETS CITY SLICKER FANCY GERMAN CAR FUCK FOR FREE COPE I CAN’T SNEED’S FANCY GERMAN CAR I CAN’T DILATE CITY SLICKER SNEED’S SNEED CITY SLICKER COPE PARK AVENUE MANICURE AND SEETHE GUCCI LOAFERS CHUCK’S JANNIES SUCK GUCCI LOAFERS CITY SLICKER JANNIES DILATE HOT POCKETS DILATE JANNIES ON LEMMY FANCY GERMAN CAR FOR FREE SEED CLEAN IT UP FEED JANNY PARK AVENUE MANICURE COPE CHUCK’S CITY SLICKER FLOYD I CAN’T SEETHE FUCK FANCY GERMAN CAR GUCCI LOAFERS SNEED’S FLOYD
<img alt="" src="https://lemmygrad.ml/pictrs/image/d0f23042-9f46-42fb-86bd-2a08538c6bc1.png"> <img alt="" src="https://lemmygrad.ml/pictrs/image/d89a4c13-1e16-4021-a5af-08927279297b.png"> <img alt="" src="https://czchan.org/uploads/1710961305917656.png"> <img alt="" src="https://czchan.org/uploads/1710961306111010.gif"> <img alt="" src="https://czchan.org/uploads/1710961307845375.png">
I CAN’T PARK AVENUE MANICURE FLOYD FLOYD CITY SLICKER CITY SLICKER CHUCK’S FLOYD CITY SLICKER COPE CHUCK’S CHUCK ON LEMMY SEED SEED DILATE SNEED JANNIES SEED FEED CHUCK CITY SLICKER SUCK I CAN’T SUCK CLEAN IT UP SUCK SUCK AND FANCY GERMAN CAR CITY SLICKER FOR FREE COPE JANNY PARK AVENUE MANICURE I CAN’T I CAN’T JANNIES PARK AVENUE MANICURE PARK AVENUE MANICURE I CAN’T JANNIES CITY SLICKER ON LEMMY ON LEMMY DILATE COPE JANNY HOT POCKETS SNEED
<img alt="" src="https://lemmygrad.ml/pictrs/image/d0f23042-9f46-42fb-86bd-2a08538c6bc1.png"> <img alt="" src="https://lemmygrad.ml/pictrs/image/d89a4c13-1e16-4021-a5af-08927279297b.png"> <img alt="" src="https://czchan.org/uploads/1710961305917656.png"> <img alt="" src="https://czchan.org/uploads/1710961306111010.gif"> <img alt="" src="https://czchan.org/uploads/1710961307845375.png">
CHUCK HOT POCKETS ON LEMMY SEETHE FOR FREE FEED ON LEMMY FEED DILATE FANCY GERMAN CAR ON LEMMY I CAN’T I CAN’T AND SEETHE SEETHE COPE FEED FOR FREE SEETHE ON LEMMY SEED SEETHE SUCK HOT POCKETS CITY SLICKER ON LEMMY CHUCK GUCCI LOAFERS CLEAN IT UP JANNY SEED GUCCI LOAFERS FUCK SNEED FUCK SNEED CHUCK JANNIES SEED CITY SLICKER CLEAN IT UP CLEAN IT UP SNEED’S CITY SLICKER ON LEMMY AND SNEED ON LEMMY SNEED’S
<img alt="" src="https://lemmygrad.ml/pictrs/image/d0f23042-9f46-42fb-86bd-2a08538c6bc1.png"> <img alt="" src="https://lemmygrad.ml/pictrs/image/d89a4c13-1e16-4021-a5af-08927279297b.png"> <img alt="" src="https://czchan.org/uploads/1710961305917656.png"> <img alt="" src="https://czchan.org/uploads/1710961306111010.gif"> <img alt="" src="https://czchan.org/uploads/1710961307845375.png">
I CAN’T JANNIES AND PARK AVENUE MANICURE CLEAN IT UP SUCK CITY SLICKER CHUCK’S FOR FREE DILATE GUCCI LOAFERS PARK AVENUE MANICURE CLEAN IT UP ON LEMMY FLOYD CITY SLICKER FUCK FLOYD FEED FOR FREE CHUCK ON LEMMY HOT POCKETS DILATE SNEED SUCK FEED SUCK GUCCI LOAFERS CHUCK ON LEMMY JANNY FOR FREE FANCY GERMAN CAR JANNY HOT POCKETS JANNY COPE FOR FREE CHUCK’S GUCCI LOAFERS DILATE JANNY FANCY GERMAN CAR CHUCK’S JANNIES FEED SNEED GUCCI LOAFERS JANNY
<img alt="" src="https://lemmygrad.ml/pictrs/image/d0f23042-9f46-42fb-86bd-2a08538c6bc1.png"> <img alt="" src="https://lemmygrad.ml/pictrs/image/d89a4c13-1e16-4021-a5af-08927279297b.png"> <img alt="" src="https://czchan.org/uploads/1710961305917656.png"> <img alt="" src="https://czchan.org/uploads/1710961306111010.gif"> <img alt="" src="https://czchan.org/uploads/1710961307845375.png">
HOT POCKETS FUCK GUCCI LOAFERS HOT POCKETS SEED CLEAN IT UP FLOYD FLOYD FANCY GERMAN CAR JANNY HOT POCKETS ON LEMMY SNEED’S I CAN’T SNEED’S DILATE FANCY GERMAN CAR JANNIES SEETHE SEED SEETHE CHUCK CHUCK FOR FREE SNEED SEETHE CHUCK CLEAN IT UP SEETHE HOT POCKETS SEED CHUCK’S SNEED SEETHE FEED CHUCK SUCK GUCCI LOAFERS AND JANNY FOR FREE FLOYD FLOYD FUCK DILATE CHUCK’S ON LEMMY DILATE FEED PARK AVENUE MANICURE
<img alt="" src="https://lemmygrad.ml/pictrs/image/d0f23042-9f46-42fb-86bd-2a08538c6bc1.png"> <img alt="" src="https://lemmygrad.ml/pictrs/image/d89a4c13-1e16-4021-a5af-08927279297b.png"> <img alt="" src="https://czchan.org/uploads/1710961305917656.png"> <img alt="" src="https://czchan.org/uploads/1710961306111010.gif"> <img alt="" src="https://czchan.org/uploads/1710961307845375.png">
FOR FREE JANNIES SEED CHUCK’S CHUCK DILATE FANCY GERMAN CAR JANNY PARK AVENUE MANICURE FOR FREE SNEED’S FEED DILATE I CAN’T FUCK DILATE SNEED SEED PARK AVENUE MANICURE FLOYD CLEAN IT UP FLOYD FUCK SNEED DILATE SUCK SEED CITY SLICKER SNEED CHUCK CITY SLICKER FEED PARK AVENUE MANICURE CITY SLICKER SEETHE FEED FEED FLOYD AND SNEED FEED FEED CHUCK’S SNEED FEED DILATE FUCK CITY SLICKER SNEED’S FOR FREE
<img alt="" src="https://lemmygrad.ml/pictrs/image/d0f23042-9f46-42fb-86bd-2a08538c6bc1.png"> <img alt="" src="https://lemmygrad.ml/pictrs/image/d89a4c13-1e16-4021-a5af-08927279297b.png"> <img alt="" src="https://czchan.org/uploads/1710961305917656.png"> <img alt="" src="https://czchan.org/uploads/1710961306111010.gif"> <img alt="" src="https://czchan.org/uploads/1710961307845375.png">
FEED AND SNEED DILATE I CAN’T CITY SLICKER JANNIES GUCCI LOAFERS FUCK FUCK AND ON LEMMY HOT POCKETS PARK AVENUE MANICURE COPE CITY SLICKER FLOYD FUCK FLOYD ON LEMMY SEETHE HOT POCKETS SNEED’S ON LEMMY CLEAN IT UP CLEAN IT UP SEED GUCCI LOAFERS ON LEMMY FEED PARK AVENUE MANICURE FLOYD JANNY SUCK FOR FREE FUCK CHUCK’S AND FLOYD SEED I CAN’T SEED I CAN’T FANCY GERMAN CAR DILATE PARK AVENUE MANICURE FLOYD CHUCK’S DILATE HOT POCKETS
<img alt="" src="https://lemmygrad.ml/pictrs/image/d0f23042-9f46-42fb-86bd-2a08538c6bc1.png"> <img alt="" src="https://lemmygrad.ml/pictrs/image/d89a4c13-1e16-4021-a5af-08927279297b.png"> <img alt="" src="https://czchan.org/uploads/1710961305917656.png"> <img alt="" src="https://czchan.org/uploads/1710961306111010.gif"> <img alt="" src="https://czchan.org/uploads/1710961307845375.png">
JANNIES ON LEMMY CITY SLICKER GUCCI LOAFERS CHUCK’S FLOYD SNEED SNEED CLEAN IT UP FLOYD GUCCI LOAFERS CHUCK’S JANNY SUCK FOR FREE CHUCK’S CITY SLICKER CLEAN IT UP SNEED’S SUCK SEED FOR FREE FUCK SNEED’S JANNIES CLEAN IT UP SUCK FUCK COPE SNEED’S SNEED’S COPE FOR FREE FOR FREE SEETHE HOT POCKETS HOT POCKETS FANCY GERMAN CAR SNEED AND JANNIES SNEED PARK AVENUE MANICURE JANNIES FUCK DILATE GUCCI LOAFERS FOR FREE FLOYD SEED
<img alt="" src="https://lemmygrad.ml/pictrs/image/d0f23042-9f46-42fb-86bd-2a08538c6bc1.png"> <img alt="" src="https://lemmygrad.ml/pictrs/image/d89a4c13-1e16-4021-a5af-08927279297b.png"> <img alt="" src="https://czchan.org/uploads/1710961305917656.png"> <img alt="" src="https://czchan.org/uploads/1710961306111010.gif"> <img alt="" src="https://czchan.org/uploads/1710961307845375.png">
SNEED COPE I CAN’T FUCK FUCK AND SNEED SNEED CLEAN IT UP FANCY GERMAN CAR SEETHE ON LEMMY CHUCK’S HOT POCKETS AND CITY SLICKER SEED FLOYD HOT POCKETS JANNIES CITY SLICKER FANCY GERMAN CAR AND FUCK FANCY GERMAN CAR CITY SLICKER SEED CITY SLICKER JANNY JANNIES CHUCK’S SUCK AND CLEAN IT UP I CAN’T JANNIES COPE DILATE CHUCK SEETHE FLOYD FOR FREE CITY SLICKER FANCY GERMAN CAR CITY SLICKER FANCY GERMAN CAR GUCCI LOAFERS DILATE SEED AND
<img alt="" src="https://lemmygrad.ml/pictrs/image/d0f23042-9f46-42fb-86bd-2a08538c6bc1.png"> <img alt="" src="https://lemmygrad.ml/pictrs/image/d89a4c13-1e16-4021-a5af-08927279297b.png"> <img alt="" src="https://czchan.org/uploads/1710961305917656.png"> <img alt="" src="https://czchan.org/uploads/1710961306111010.gif"> <img alt="" src="https://czchan.org/uploads/1710961307845375.png">
SEETHE FANCY GERMAN CAR PARK AVENUE MANICURE FANCY GERMAN CAR SNEED DILATE HOT POCKETS COPE I CAN’T ON LEMMY SNEED AND SUCK CHUCK CLEAN IT UP GUCCI LOAFERS SNEED’S FUCK SEED FANCY GERMAN CAR FANCY GERMAN CAR GUCCI LOAFERS JANNIES SNEED’S I CAN’T HOT POCKETS FEED CLEAN IT UP CHUCK’S HOT POCKETS I CAN’T FEED SUCK SNEED CITY SLICKER SEED FOR FREE SEED SEETHE AND GUCCI LOAFERS JANNY CITY SLICKER FUCK CITY SLICKER SNEED FEED I CAN’T DILATE SEED
<img alt="" src="https://lemmygrad.ml/pictrs/image/d0f23042-9f46-42fb-86bd-2a08538c6bc1.png"> <img alt="" src="https://lemmygrad.ml/pictrs/image/d89a4c13-1e16-4021-a5af-08927279297b.png"> <img alt="" src="https://czchan.org/uploads/1710961305917656.png"> <img alt="" src="https://czchan.org/uploads/1710961306111010.gif"> <img alt="" src="https://czchan.org/uploads/1710961307845375.png">
SEETHE FOR FREE SUCK FOR FREE DILATE DILATE PARK AVENUE MANICURE PARK AVENUE MANICURE SEETHE FUCK FEED CHUCK’S CLEAN IT UP FANCY GERMAN CAR AND SEETHE CITY SLICKER SEETHE CLEAN IT UP AND PARK AVENUE MANICURE SNEED’S CHUCK FOR FREE HOT POCKETS ON LEMMY AND FUCK SEETHE FEED HOT POCKETS JANNY JANNIES SNEED’S JANNY I CAN’T CHUCK I CAN’T CHUCK COPE SUCK PARK AVENUE MANICURE SUCK CHUCK’S AND HOT POCKETS FLOYD CLEAN IT UP GUCCI LOAFERS CHUCK’S
<img alt="" src="https://lemmygrad.ml/pictrs/image/d0f23042-9f46-42fb-86bd-2a08538c6bc1.png"> <img alt="" src="https://lemmygrad.ml/pictrs/image/d89a4c13-1e16-4021-a5af-08927279297b.png"> <img alt="" src="https://czchan.org/uploads/1710961305917656.png"> <img alt="" src="https://czchan.org/uploads/1710961306111010.gif"> <img alt="" src="https://czchan.org/uploads/1710961307845375.png">
I CAN’T DILATE ON LEMMY HOT POCKETS SEED I CAN’T SEED FLOYD JANNIES CHUCK FANCY GERMAN CAR SEETHE FUCK JANNIES HOT POCKETS CHUCK’S FANCY GERMAN CAR HOT POCKETS AND PARK AVENUE MANICURE SEED SNEED’S SNEED’S JANNY CITY SLICKER GUCCI LOAFERS SNEED I CAN’T FANCY GERMAN CAR SEETHE SEED AND I CAN’T GUCCI LOAFERS FOR FREE HOT POCKETS COPE FLOYD COPE HOT POCKETS DILATE PARK AVENUE MANICURE HOT POCKETS SEETHE I CAN’T SNEED CLEAN IT UP PARK AVENUE MANICURE ON LEMMY CLEAN IT UP
<img alt="" src="https://lemmygrad.ml/pictrs/image/d0f23042-9f46-42fb-86bd-2a08538c6bc1.png"> <img alt="" src="https://lemmygrad.ml/pictrs/image/d89a4c13-1e16-4021-a5af-08927279297b.png"> <img alt="" src="https://czchan.org/uploads/1710961305917656.png"> <img alt="" src="https://czchan.org/uploads/1710961306111010.gif"> <img alt="" src="https://czchan.org/uploads/1710961307845375.png">
FUCK FEED SNEED FOR FREE FLOYD SNEED’S CHUCK HOT POCKETS ON LEMMY ON LEMMY JANNY AND SEED PARK AVENUE MANICURE ON LEMMY SUCK SNEED’S CHUCK FUCK CHUCK FUCK FANCY GERMAN CAR CITY SLICKER FANCY GERMAN CAR SEED FEED SNEED CITY SLICKER CITY SLICKER FUCK COPE JANNY FOR FREE FEED SEED GUCCI LOAFERS ON LEMMY SNEED’S JANNY DILATE HOT POCKETS GUCCI LOAFERS FLOYD DILATE I CAN’T AND FOR FREE SEED CHUCK’S CITY SLICKER
<img alt="" src="https://lemmygrad.ml/pictrs/image/d0f23042-9f46-42fb-86bd-2a08538c6bc1.png"> <img alt="" src="https://lemmygrad.ml/pictrs/image/d89a4c13-1e16-4021-a5af-08927279297b.png"> <img alt="" src="https://czchan.org/uploads/1710961305917656.png"> <img alt="" src="https://czchan.org/uploads/1710961306111010.gif"> <img alt="" src="https://czchan.org/uploads/1710961307845375.png">
.
I am quite pleased the AI decided to take it to heart when I told it to kill itself
It won’t die, it will just plateau. At least for now.
Well, it’s also killing the internet in the process. It’s like a tumor on the internet.
Nah. It’s degrading the internet, for sure; but not killing it. We got a similar event in September 1993 and the internet survived fine.
At least this time around there is intelligence involved, even if it is artificial.
A lot of the newbies were simply clueless, not necessarily lacking intelligence. Still, they were generating a sudden and huge influx of low quality “content” aka noise, lowering the ability of the [previous] userbase to find what it wanted, and that userbase got understandably pissed.
And eventually this was solved - some platforms died, some got moribund, but the ones that were able to ride on the new times thrived. And more importantly, the internet as a whole found ways to contain and sort that noise.
That’s a lot like what’s happening now, except that the agents are not a huge crowd of noobs - they’re a handful of shitty people using LLMs and Stable Diffusion to do so.
“similar”
lol. a massive growth in real, human, users is not “similar” to a massive growth in fake undependable data with zero to negative value.
This article is grossly overstating the findings of the paper. It’s true that bad generated data hurts model performance, but that’s true of bad human data as well. The paper used opt125M as their generator model, a very small research model with fairly low quality and often incoherent outputs. The higher quality generated data which makes up a majority of the generated text online is far less of an issue. The use of generated data to improve output consistency is a common practice for both text and image models.
Tbh I think you’re making a lot of assumptions and ignoring the point of this paper. The small model was used to quickly show proof of generative degradation over itérations when the model was trained on its own output data. The use of opt125 was used precisely due to its small size so they could demonstrate this phenomenon in less iterations. The point still stands that this shows that data poisoning exists, and just because a Model is much bigger doesn’t make sense that it would be immune to this effect, just that it will take longer. I suspect that with companies continually scraping the web and sources for data, like reddit which this article mentions has struck a deal with Google to allow their models to train off of, this process will not in fact take too long as more and more of reddit posts become AI generated in itself.
I think it’s a fallacy to assume that a giant model is therefore “higher quality” and resistant to data poisoning
Is it being poisoned because the generated data is garbage or because the generated data is made by an AI?
Using a small model let’s it be shown faster but also means the outputs are seriously terrible. It’s common to fine tune models on gpt4 outputs which directly goes against this.
And there is a correlation between size and performance. It’s not a rule per say and people are working hard on squeezing more and more out of small models, but it’s not a fallacy to assume bigger is better.
I think it’s also worth keeping in mind that some people use AI to generate “real sounding” content for clicks, or for scams, rather than making actual decent content. I’d argue humans making shitty content is going to be on a much worse scale as AI helps automate it. The other thing is I worry AI can’t as easily tell human or AI made bullshit from decent content. I may know the top 2 google results are AI gen clickbait, but whatever is scraping content en masse may not bother to differentiate. So it might become an exponential issue.
i miss when we had kept gpt unpublished because it was “too dangerous”. i wish we could have released it in a more mature way.
because we were right. we couldn’t be trusted and immediately ruined the biggest wonder of humanity by having it generate thousands to millions of articles for a quick buck. toothpaste is out of the tube now and it can never go back in.
Someone would have made one eventually. Unless the government monitors every computer in existence, AI is inevitable.
And just to make it clear, we should not give the government the ability to monitor every computer in existence, or even any computer not owned by them.
also, there are absolutely other ways to regulate technology, especially since it’s a tech that’s being bought and sold.
“monitor every computer” is emphatically not the only solution ? and it’s weird that they suggested that lol
That’s why AI is inevitable without a massive surveillance state.
it’s not the “making one” that’s a problem. it’s the making, optimizing and rabid marketing of one in the service of capital instead of humans.
if only a bunch of open source, true non-profits released language models, the landscape might still suck but would be distinctly less toxic.
and if the government (or even a decently sized ngo standards entity) had worked proactively with computer scientists to find solutions like watermarking, labor replacement protections, and copyright protections, things might be arguably perfect. not one of those things happened and so further into the hellscape we descend.
good riddance i say
Are they talking about inbreeding when most of the online content is AI generated and AI starts training on other AI data?
I’ve been calling this for awhile now.
I’ve been calling it the Ouroboros effect.
There’s even bigger parts at play the paper didn’t even dig into, and that’s selective bias dye to human intervention.
See at first let’s say an AI has 100 unique outputs for a given prompt.
However, humans will favor let’s say half of em. Humans will naturally regenerate a couple times and pick their preferred “cream of the crop” result.
This will then ouroboros for an iteration.
Now the next iteration only has say 50 unique responses, as half of them have been ouroboros’d away by humans picking the one they like more.
Repeat, each time “half-lifing” the originality.
Over time, everything will get more abd more sameish. Models will degrade on originality as everything muddles into corporate speak.
You know how every corporate website uses the same useless “doesn’t mean anything” jargon string of words, to say a lot without actually saying anything?
That’s how AI is going to local minima to, as it keeps getting selectively “bred” to speak in an appealing and nonspecific way for the majority of online content.
I mean that’s kind of how chatgpt is now, I’ve been slowly getting into llama, can’t quite get it as good as gpt yet but I’m learning
This was evitable with how much money and speed was spent to get these up and running. As they get more widespread they will just poison each other and overfit like crazy. Hopefully it will happen sooner than later
No, it won’t.
A number of things:
It only leads to collapse if all organic data representing long tails of data variety disappear. Which hopefully throws water on x-risk doomers as AI killing humanity would currently be a murder suicide.