Reddit sells training data to unnamed AI company ahead of IPO (arstechnica.com)
from VITecNet@programming.dev to technology@lemmy.world on 19 Feb 2024 23:30
https://programming.dev/post/10280834

#technology

threaded - newest

autotldr@lemmings.world on 19 Feb 2024 23:30 next collapse

This is the best summary I could come up with:


On Friday, Bloomberg reported that Reddit has signed a contract allowing an unnamed AI company to train its models on the site’s content, according to people familiar with the matter.

The move comes as the social media platform nears the introduction of its initial public offering (IPO), which could happen as soon as next month.

Reddit initially revealed the deal, which is reported to be worth $60 million a year, earlier in 2024 to potential investors of an anticipated IPO, Bloomberg said.

In April 2023, Reddit founder and CEO Steve Huffman told The New York Times that it planned to charge AI companies for access to its almost two decades’ worth of human-generated content.

If the reported $60 million/year deal goes through, it’s quite possible that if you’ve ever posted on Reddit, some of that material may be used to train the next generation of AI models that create text, still pictures, and video.

Even without the deal, experts have discovered in the past that Reddit has been a key source of training data for large language models and AI image generators.


The original article contains 379 words, the summary contains 182 words. Saved 52%. I’m a bot and I’m open source!

humanbroadcast@lemmy.world on 19 Feb 2024 23:51 next collapse

Companies are in the fuck-around phase, and we’ll all have to live in the find-out era.

thesystemisdown@lemmy.world on 19 Feb 2024 23:54 collapse

Meanwhile, the masses are still using all the ‘services’ because they all have momentum. I’m not confident any of them can do anything bad enough to chase off their users.

Imgonnatrythis@sh.itjust.works on 20 Feb 2024 00:03 next collapse

I already left reddit because they did bad things. Assume you mean chase off a critical mass though? The fact that “X” is still a thing may prove you correct.

[deleted] on 20 Feb 2024 00:11 next collapse

.

gregorum@lemm.ee on 20 Feb 2024 03:58 collapse

Huge amounts of people have already left X. Those that remain are mostly bots and neo Nazis.

tutus@links.hackliberty.org on 20 Feb 2024 12:47 collapse

How ever much we want that to be true, it’s simply not. Sadly.

gregorum@lemm.ee on 20 Feb 2024 14:28 collapse

there’s a pretty good breakdown here about how it actually is, but, obviously, X is goosing the numbers to make the loss look not-so-bad.

jmanes@lemmy.world on 20 Feb 2024 00:54 next collapse

Yeah, they’re not leaving. The only way they would leave is if the service were to be physically shut down. Pretty sure you could make everyone watch 1 minute long ads on app open and they would still stay.

givesomefucks@lemmy.world on 20 Feb 2024 02:10 next collapse

For now.

I’m old as shit, I’ve seen an uncountable amount of “social media” come and go. At it’s heart reddit is just a forum. They’ve tacked on a lot of modern shit, but so do most of them when they’re running out of steam.

It’s a war of attrition now. People will leave in batches overtime until it just kinda ends, or not. Myspace is still shuffling around here somewhere.

wise_pancake@lemmy.ca on 20 Feb 2024 02:32 next collapse

I thought Facebook would die with all the scandals, I’m the only person in my life who cared. I deleted Twitter before it became X, I’m the only one I know who did that.

I don’t think anyone gives a shit and it’s made me hate people a lot more than I used to.

gregorum@lemm.ee on 20 Feb 2024 03:58 collapse

Most people I know left Facebook and Twitter years ago. Maybe it’s just a difference in people we associate with? 

johnwilker@lemmy.world on 20 Feb 2024 15:58 collapse

100%. In a writing sub I threw out. “I wish they’d just charge us, users a fee.”

I got “Pay for this?!”

Folks live and die on Reddit but the idea of paying is… gross. Yet they scream about moves like this.

People, man… I dunno.

foggy@lemmy.world on 20 Feb 2024 00:21 next collapse

Really trying to meddle an elections like it’s 2016

FaceDeer@kbin.social on 20 Feb 2024 00:54 next collapse

I don't see anything in the article related to elections.

ArbiterXero@lemmy.world on 20 Feb 2024 01:07 collapse

No, But there’s BIG money in AI astroturfing for elections.

pop@lemmy.ml on 20 Feb 2024 01:41 collapse

Good. Get a good taste your own medicine.

It’s time how people in the US felt foreign entities meddling with their elections for a change, huh?

grabs popcorn

SeedyOne@lemm.ee on 20 Feb 2024 01:52 next collapse

You’re naive to think it’s just starting now.

Hubi@feddit.de on 20 Feb 2024 01:55 collapse

It’s been happening for the better part of a decade though. And started probably much earlier than that, just not as blatant.

empireOfLove2@lemmy.dbzer0.com on 20 Feb 2024 00:21 next collapse

Which will probably last for about one year, long enough to boost IPO valuations, then openAI (we all know who’s buying it) will cancel their contract because it’s too expensive and Reddit does not actually generate enough unique content yearly to be worth continuously training on. Then the death spiral happens again.

kamenlady@lemmy.world on 20 Feb 2024 01:15 collapse

Fuckin’ Spez will squeeze Reddit until the head pops. The only thing meticulously planned, is the flow of money to his accounts. The fastest flow.

millifoo@lemmy.world on 20 Feb 2024 00:40 next collapse

I spent a chunk of this afternoon nuking my old reddit posts. Thousands and thousands of posts… thank goodness for shreddit.

NightAuthor@lemmy.world on 20 Feb 2024 01:11 next collapse

Most tools miss a ton bc of the limitations of the website and api. The best, pretty much only, way to get everything is to get an export of your data, then use that csv to delete all items one by one

Hubi@feddit.de on 20 Feb 2024 01:57 next collapse

Yup, shreddit has the ability to use the csv from the data request. Took me about 24 hours to edit and erase the 20.000+ comments I made over the last 10 years.

x4740N@lemmy.world on 20 Feb 2024 02:21 collapse

Does shreddit have the ability to exclude certain subreddits because I want to exclude my comments on one subreddot but overwrite the rest of them

WallEx@feddit.de on 20 Feb 2024 12:50 next collapse

I did that before they went through with their api bullshit, I’m so happy, it was fully automated. Just typed in the replacement massege and that’s it

guacupado@lemmy.world on 20 Feb 2024 13:52 collapse

I didn’t know about this. I just went into it.

edit: lol you have to pay for Shreddit. Nevermind, I don’t care about deleting my posts that much.

millifoo@lemmy.world on 20 Feb 2024 18:09 collapse

No, not the website: the git project.

If you want a web app, try redact.dev (yes, there’s a paid version where you can download your old messages, but the free one wipes out your posts (with random text) for free.

Sneptaur@pawb.social on 20 Feb 2024 01:13 next collapse

Very glad I overwrote all of my comments with random words before deleting my account. They won’t be profiting off of me anymore.

FaceDeer@kbin.social on 20 Feb 2024 02:05 collapse

Instead you're posting to the Fediverse, which is even more open for use by third parties.

residentmarchant@lemmy.world on 20 Feb 2024 03:03 next collapse

Yea, but it’ll be open forever, nobody can turn off an app overnight and profit from it.

FaceDeer@kbin.social on 20 Feb 2024 03:45 collapse

Right. But my point is that they can profit from it. The issue lots of folks seem to be having is "how dare Reddit make money using something I did!", and that issue is even worse for the Fediverse since lots of companies can be doing it.

Undearius@lemmy.ca on 20 Feb 2024 04:02 collapse

And what value is a commodity that is available to everyone?

I don’t disagree with your point but I’m sure it couldn’t be sold for as much as when it’s a limited resource.

FaceDeer@kbin.social on 20 Feb 2024 04:18 collapse

The value comes from the work that can be done with it. If you can train an AI off it then it's worth something.

Undearius@lemmy.ca on 20 Feb 2024 04:52 collapse

It’s one thing if you’re processing and doing work with the data but Reddit will be getting $60,000,000 a year for simple having the data.

FaceDeer@kbin.social on 20 Feb 2024 05:11 collapse

They can't do the work without the data, though.

Or rather, they can't do the work without the risk of Reddit raising a legal fuss that would cost them more than $60 million. The data itself can already be downloaded for free from various places.

Sneptaur@pawb.social on 20 Feb 2024 13:59 collapse

Its obscure enough that I don’t think it’s being sought out by AI companies. The nature of federated instances should make it a bit more challenging to pull a complete data set too

FaceDeer@kbin.social on 20 Feb 2024 15:12 collapse

Not so obscure that Meta isn't paying attention and planning for interoperation, and Meta is one of the biggest players in the AI development field.

A complete data set isn't required, just a comprehensive one.

PizzaFacia@lemmy.world on 20 Feb 2024 02:05 next collapse

$60mm a year seems really cheap, no? I know its shit data from the bot posters but still would think it would be like $100-150mm

potatopotato@sh.itjust.works on 20 Feb 2024 09:18 next collapse

Honestly it’s probably the best search dataset in existence right now. You can make Google suck far less by appending “reddit” to most searches because you’ll get results from a group consisting of a higher ratio of actual humans instead of bots.

Yeah reddit is shit, but the rest of the internet is 10x worse at this point. Pretty much any writing that isn’t a labor of love on someone’s personal page or users interacting with each other in a semi organic way is rapidly becoming 100% GPT vomit as every company in existence lays off their writing staff

Whoever bought this got a fucking bargain.

ilinamorato@lemmy.world on 20 Feb 2024 13:43 next collapse

It’s ludicrously cheap for the size and quality of the dataset. A set of 829 academic papers at University of Michigan is priced at $25,000—about 1/2400 of this sale. If you were to scale that dollar value to the size of the Reddit dataset, you’d expect it to contain about 2 million academic papers’ worth of data.

But Reddit has almost two decades of text written by 200 million chronically-online people. And sure, probably most Reddit users don’t write an academic paper amount of content every year; but the average is probably closer to that than not, especially when you consider that some of those subreddits like AskHistorians and AskScientists really are generating the equivalent of dozens of academic papers per day. Just based on the amount of text alone, Reddit should’ve sold us out for 50-100x what they got for just a single year of data, and 1000-2000x for the full twenty years (though, granted, they didn’t have that much data for that entire time, so let’s say half that).

Furthermore, those 829 papers in the U of M dataset are disconnected, unlinked text representing a tiny fraction of what U of M’s 50,000 students generate in even a single year. Reddit has data with links, images, conversational responses, prompt responses, Q&As, flash fiction, slash fiction, historical deep-dives, investigations, memes, inside jokes, a development of style and consensus over time, and a comprehensive understanding of what it means to interact online, generated by people around the world over the course of 18 years. It’s much better data for almost any LLM purpose that isn’t just writing academic papers from the perspective of students at a medium size 4-year undergrad institution in the Midwestern US. The quality of the dataset should’ve made the value even higher. It’s hard to say exactly how much higher, but let’s just be extremely conservative and say it should have doubled the total.

That means that, conservatively, the value of Reddit’s dataset—or, rather, our dataset, which Reddit freebooted from us—was about 1000x what they were paid, based on the proportional value of the U of M dataset.

They should’ve sold us out for billions.

Of course, we don’t know anything about what exclusivity deals or subset of data that they might have included with this deal. It might only be one year of data, and only 6 months of exclusivity. But assuming they sold the rights to the entire dataset, we got sold for pennies.

ormr@feddit.de on 20 Feb 2024 17:38 collapse

Is the data access exclusive for that one company? If not then it’s no miracle they’re opting for a subscription-based model lol

Bakkoda@sh.itjust.works on 20 Feb 2024 18:26 next collapse

#stockholderedging

Aopen@discuss.tchncs.de on 20 Feb 2024 20:16 collapse

Isnt this copyright infringement? Does reddits policy allow them to do this?