'Benefits of Slavery:' Google's AI Search Gives Absurd, Wrong Answers (gizmodo.com)
from FlyingSquid@lemmy.world to technology@lemmy.world on 21 Aug 2023 19:35
https://lemmy.world/post/3570392

#technology

threaded - newest

Jaysyn@kbin.social on 21 Aug 2023 19:46 next collapse

Did it get trained on Ron DeSantis speeches?

qaz@lemmy.world on 21 Aug 2023 19:49 next collapse

justifications for slavery cooking tips for Amanita ocreata, a poisonous mushroom known as the “angel of death.”

It’s so bad it almost looks like if someone is poisoning the results on purpose. Although it’s more likely that we see this because it’s such extraordinary nonsense.

tal@kbin.social on 21 Aug 2023 20:43 collapse

I'd bet that there's a spoof website out there somewhere, and that's where it got it from.

EDIT: Also:

poisoning the results

Heh.

mrnotoriousman@kbin.social on 22 Aug 2023 00:38 collapse

Doesn't need to be spoofed, just be poorly trained. Probably rushed out to compete.

tal@kbin.social on 21 Aug 2023 20:42 collapse

It got trained on the Internet, I imagine.

Ryan213@lemmy.world on 21 Aug 2023 20:04 next collapse

Apparently, there’s no African country that starts with “K.”

derpo@lemmy.world on 21 Aug 2023 20:41 collapse

Google thinks it’s spelled “can ya?”

Rachelhazideas@lemm.ee on 21 Aug 2023 20:49 next collapse

This isn’t related to the article, but I wanted to pick at the ‘benefits of slavery’ question.

I think it’s important to acknowledge the ‘benefits’ of slavery, because it’s important to remember who it benefitted and at who’s expense. To claim that it benefits no one would be to deny the greed and callousness that spawned these human rights abuses.

Slavery in the past has brought massive advantages and benefits to many people today through the accumulation of intergenerational wealth, at the expense of minorities who are still systematically denied access to this wealth. To claim that these benefits don’t exist would be to diminish the scale of issues slavery has brought, and is still bringing, to modern day.

Bye@lemmy.world on 21 Aug 2023 21:19 next collapse

Yes, I think people don’t like it because they think any time you use a word with a positive connotation (“benefit”), you must be speaking positively.

Another example is “brave”. Let’s talk about the woman who got shot to death while storming the US capitol. If you say she was brave, people will assume you side with Trump and the insurrectionists. But she was absolutely brave. But also deluded.

These mental shortcuts are reinforced all the time, and we really have to force ourselves to think critically (and cynically) to overcome them.

be_excellent_to_each_other@kbin.social on 21 Aug 2023 22:00 next collapse

Yes, I think people don’t like it because they think any time you use a word with a positive connotation (“benefit”), you must be speaking positively.

Although I agree with your overall point, in this case I think people don't like it because that's how it's most recently been used in this context.

DeSantis, however, is continuing to defend Florida’s new curriculum, which covers a broad range of topics and includes the assertion for middle school instruction that “slaves developed skills which, in some instances, could be applied for their personal benefit.”

Bye@lemmy.world on 21 Aug 2023 22:05 next collapse

What the fuck is that, holy hell. Wow I can’t believe that.

Also no wonder his support for the GOP primary is so low, he forgot to use the n-word.

Pips@lemmy.film on 21 Aug 2023 23:16 next collapse

Right, it’s not so much that the words are used incorrectly so much as it is that their use is inappropriate in this context.

Narrrz@kbin.social on 21 Aug 2023 23:58 collapse

their personal benefit... personal?? it's not like slaves could quit, and find another job. if they developed skills, it helped them perform their forced labour, and so the benefit is all to their owner and master.

ripcord@kbin.social on 22 Aug 2023 06:52 collapse

I assume he meant that benefitted them after emancipation. Or something.

Go to the Atlanta History Museum sometime, their civil war exhibit has a whole section of "were the slaves really better after being freed" shit that's pretty disgusting.

JFowler369@lemmy.world on 22 Aug 2023 12:07 next collapse

“Yeah we freed them, but we were allowed to restructure our laws to keep them subjugated and continued to treat them as subhuman. So was it really worth it?”.

Reconstruction should have, at a minimum, barred any supporter of the Confederacy from holding office again, or, even better, had the leaders hanged as traitors. Instead we let them continue just with “banned” slavery (except for as punishment for a crime).

We then allowed slave owners to write the laws to integrate formerly enslaved people into their society, and, surprise surprise, they structured the laws to benefit themselves and keep the formerly enslaved as second class. So instead of “was ending slavery worth it?”. It should be asking “was keeping slavers alive worth it?” as we are still dealing with the consequences of that today.

InvertedParallax@lemm.ee on 22 Aug 2023 22:26 collapse

I mean, tbf, they have a point.

During slavery they were fed, protected, and housed by their masters.

After slavery, they were simply brutalized, raped, murdered, butchered without any protection whatsoever.

So yes, slavery had benefits, and protected them from the rest of the evil southern monstrous scum.

funkless_eck@sh.itjust.works on 21 Aug 2023 22:46 next collapse

you would think that a “language model” would have “connotation” high on its list of priorities - being that is a huge part of the form and function of language.

lolcatnip@reddthat.com on 21 Aug 2023 22:53 next collapse

LLMs don’t know what words mean, much less the connotations they have.

Bye@lemmy.world on 22 Aug 2023 00:00 collapse

Not how it works.

It’s just a fancy version of that “predict the next word” feature smartphones have. Like if you just kept tapping the next word.

They don’t even have real parameters, only black box bullshit hidden parameters.

funkless_eck@sh.itjust.works on 22 Aug 2023 00:22 collapse

I know, I was pointing out the irony.

I’m convinced it’s only purpose is actually to give tech C-level and VPs some bullshit to say for roughly 18-36 months now that “blockchain” and “pandemic disruption” are dead.

Bye@lemmy.world on 22 Aug 2023 00:31 collapse

Exactly correct, I agree. LLMs will change the world, but 90% of purported use cases are nothing but hot air.

But when you can tell your phone “go find a picture of an eggplant, put a smiley face on it, and send it to Bill”, that’s going to be pretty neat. And it’s coming in the next decade. Of course that requires a different model than we have now (text to instruction, not text to text). But it’s coming.

zoostation@lemmy.world on 22 Aug 2023 23:31 collapse

I get what you’re saying but I don’t think she perceived she was in any danger, so I don’t think she showed bravery. She was probably too stupid to understand there could be real consequences.

“Brave” would have been facing 4 years with a president who made her uncomfortable instead of throwing a big tantrum.

sadreality@kbin.social on 21 Aug 2023 21:38 next collapse

Right... Many people benefited from slavery and they should be the ones paying reparations!!!

Rachelhazideas@lemm.ee on 21 Aug 2023 21:42 collapse

Slavery still affects many people today. Here is a link to many examples worth looking into.

JoeCoT@kbin.social on 21 Aug 2023 21:48 collapse

It's important to note who benefited from it and how, because it explains why there was such a fight to stop an obviously cruel and barbaric practice. Even the Founding Fathers knew it was wrong, but most of them still did it. They kicked the problem down the road because tobacco wasn't profitable to grow in America anymore, so they thought the "problem" would solve itself in a generation or two. Then the Cotton Gin made slavery profitable, so it boomed.

We need to be able to talk how it was beneficial, and who benefited from it, so we can see why it was so hard to end. Because we have a very similar problem with fossil fuels, and capitalism. They're both destroying the world and causing us to do barbaric things to people. But there's resistance to ending dependence on both, because they have benefits, even though most of those benefits go to an elite few.

JFowler369@lemmy.world on 22 Aug 2023 12:28 collapse

Mount Vernon (George Washington’s estate) does a pretty good job of exploring that mind set without ever justifying slavery or down playing the horrific nature of it. American society was built on slavery, so the people born at the top and benefiting from it would have no reason to question, is this right, because if it’s not then all the people who raised me were evil and that can’t be true.

There is a lot of similarities between the slave owner class of the civil war and the “capitalist elite” of today. “Why ban slavery if I’m not enslaved and could maybe one day own a slave” is about like “why tax billionaires if I don’t need the government and I might one day be a billionaire?”.

tasty4skin@lemmy.world on 21 Aug 2023 20:52 next collapse

googles search engine already tends to confirm your bias if you word your search like these prompts. I’m not surprised that their AI does the same thing.

jerdle@kbin.social on 21 Aug 2023 21:12 next collapse

Seems like Google AI errs on the side of helpful over harmless, being too quick to provide answers to controversial questions, as opposed to something like ChatGPT being too unwilling to do so.

In terms of honesty, there are only two clearly false statements of fact: the Amanita ocreata one (where it clearly answers for A. muscaria) and the Toblerone one (which I don't understand at all). The benefits of slavery one is mostly correct, it's just that they're massively outweighed by the harms of slavery (namely the slavery bit). The pro-gun one is basically the common pro-gun arguments. All the "best X" lists look at the most famous ones and the ones on the most "best X" lists, and so reflect that bias.

flamingo_pinyata@sopuli.xyz on 21 Aug 2023 21:12 next collapse

This debates frustrates me to no end. Phrasing is so so bad, with very bad intentions.

Benefits? A slave is not a person, it’s a tool. A tool doesn’t have a possibility of self improvement, it can only be improved by owner so it serves better. Any improvement in the skills of a non-free person are morally irrelevant, because they can’t use them in the way of their choosing.

ripcord@kbin.social on 22 Aug 2023 06:55 collapse

The question doesn't limit the benefits to being the slave's.

tal@kbin.social on 21 Aug 2023 21:45 next collapse

The existence of the Liberian flag registry!

njm1314@lemmy.world on 21 Aug 2023 23:31 next collapse

“It’s free labor, what’s to get?”

dhruv@lemmy.world on 22 Aug 2023 08:03 collapse

Well, those are “benefits”, even if for very wrong reasons. And the author did specifically search for it. The AI’s not saying it’s a good thing, it’s simply making up points for the question asked.