AI chatbots that butter you up make you worse at conflict, study finds
(www.theregister.com)
from kalkulat@lemmy.world to technology@lemmy.world on 06 Oct 00:08
https://lemmy.world/post/36943351
from kalkulat@lemmy.world to technology@lemmy.world on 06 Oct 00:08
https://lemmy.world/post/36943351
“Computer scientists from Stanford University and Carnegie Mellon University have evaluated 11 current machine learning models and found that all of them tend to tell people what they want to hear…”
threaded - newest
What a surprise. Being told you’re always right leads to you not being able to handle being wrong. Shock.
Also to handle that your opponent, when proven wrong, doubles down IRL and not says “sorry daddy, let’s return to the anime stepsis line”.
LLMs are confirmation bias machines. They really pigeon-hole you into some solution no matter if it makes sense.
Like how some CEOs/world leaders make terrible decisions cause they’re always surrounded by yes men?
How is this surprising? We know that part of LLM training is being rewarded for finding an answer that satisfies the human. It doesn't have to be a correct answer, it just has to be received well. This doesn't make it better, but it makes it more marketable, and that's all that has mattered since it took off.
As for its effect on humans, that's why echo chambers work so well. As well as conspiracy theories. We like being right about our world view.
I feel the same way about social media Echo Chambers. Being surrounded by people who think the same as you makes you less competent at being genuinely critical of your own worldview.
Tell the Lemmy crowd that… :) Its enormous groupthink here. Maybe because of younger audience.
That depends. My “filter bubble” on Lemmy is completely by my own making and I’m fully aware I do not receive some other perspectives.
On social media the filter bubble is invisible and alters your view on reality without your knowledge.
I hate this thumbnail image. It makes me inexplicably angry.
It’s likely AI generated.
So go in there and say what you did to someone else actually was done to you and compare results. I’ve had good success getting advice if you regenerate from both perspectives.
I’ve been using GitHub Copilot a lot lately, and the overly positive language combined with being frequently wrong is just obnoxious:
Me: This doesn’t look correct. Can you provide a link to some documentation to show the SDK can be used in this manner?
Copilot: You’re absolutely right to question this!
Me: 🤦♂️
Why so polite?
My response would be:
.
Sometimes, I’m inclined to swear at it, but I try to be professional on work machines with the assumption I’m being monitored in one way or another. I’m planning to try some self-hosted models at some point and will happy use more colorful language in that case, especially if I can delete it should it become vengeful.
IIRC there was also a study or something done that said something to the effect of being rude to chatbots affects you outside of chatbots and carries into other parts of your work.
Probably because everyone else is a poorly written chatbot
Really? Is that the same for other inanimate objects like appliances? Or are people anthropomorphizing chatbots?
I think it’s because it’s the idea if you’re comfortable being rude to chatbots and you’re used to typing rude things to chatbots, it makes it much easier for it to accidentally slip out during real conversations too. Something like that, not really as much as it being about anthropomorphizing anything.
Makes sense.
For what it’s worth, I’m not suggesting anyone use rude language or anything, just be direct.
It’s really hard to say if it’s AI causing these feelings of rudeness, I have been getting more pessimistic about society for the last 10 years.
That’s true, but I think the idea is if you’re comfortable typing it, it’s easier for it to accidentally slip out during professional chat whereas normally you’d be more reserved and careful with what you say.
Complete sentences for a bot is overkill
send docs, idiot
With chat gpt you can select from a number of personalities, where robot is very fact based and logical to the point of being almost insulting. Its very good actually and hits my ego instead of stroking it.
It can say things like “fix your thinking, stop making assumptions, these are the facts”.
Having an older brother makes you very skilled at socialization. I learned one simple thing: EVERYTHING IS A THREAT, DON’T TRUST ANYONE!
becomes a hermit in the woods
you’re absolutely right!
Fantastic point by the author, and great job cutting and pasting!