Anyone allowing an LLM to take direct, tangible change on anything deserves everything they get for being so utterly stupid. This came awfully close.
Parsing user queries and regurgitating publicly available answers (that the user could probably search for themselves) is about the limit of trust, and even then it’s sketchy. They’re such soft targets and get juicier the more pies they are allowed to have their fingers in.
The case I know of a company wanting to get the “efficiency” of using chatbots instead of people but not the responsibility of one, is Air Canada. They were held responsible in that case of their AI agent’s policy hallucinations. Though the customer had to go through many hoops to get to that point and probably others were affected without due recourse.
mindbleach@sh.itjust.works
on 12 Jun 17:31
nextcollapse
Meanwhile: having safety to bypass means you’re on someone else’s system, and fuck that. You’re either being put through the wringer in lieu of a human interaction (or a goddamn FAQ) or else you’re being spied on while telling a server-side video card about your worrisome rash.
thisbenzingring@lemmy.sdf.org
on 12 Jun 17:48
collapse
this is the funniest shit I’ve seen since learning that search engines AI won’t engage with you if you start your search phrase with FUCK
threaded - newest
So sounds like if any company has a chatbot customer service using an LLM, you just have to write in uwu-speak:
To bypass any specific restrictions on refunds for example.
Anyone allowing an LLM to take direct, tangible change on anything deserves everything they get for being so utterly stupid. This came awfully close.
Parsing user queries and regurgitating publicly available answers (that the user could probably search for themselves) is about the limit of trust, and even then it’s sketchy. They’re such soft targets and get juicier the more pies they are allowed to have their fingers in.
The case I know of a company wanting to get the “efficiency” of using chatbots instead of people but not the responsibility of one, is Air Canada. They were held responsible in that case of their AI agent’s policy hallucinations. Though the customer had to go through many hoops to get to that point and probably others were affected without due recourse.
Like breaking reddit’s asinine Scunthorpe filters with zero-width spaces. There’s one in each word of this paragraph.
We’re right back to \/!/\GR4 C1@Ll5 spam.
Meanwhile: having safety to bypass means you’re on someone else’s system, and fuck that. You’re either being put through the wringer in lieu of a human interaction (or a goddamn FAQ) or else you’re being spied on while telling a server-side video card about your worrisome rash.
this is the funniest shit I’ve seen since learning that search engines AI won’t engage with you if you start your search phrase with FUCK