Anthropic tested Claude's(LLM, AI Chatbot) ability to manage a physical “storefront” to mixed results, as the AI struggled with pricing strategy and inventory management (www.anthropic.com)
from Pro@programming.dev to technology@lemmy.world on 28 Jun 09:27
https://programming.dev/post/33029847

#technology

threaded - newest

A_norny_mousse@feddit.org on 28 Jun 10:24 next collapse

Anybody who thought the answer could have been even remotely close to Yes is delusional.

Womble@lemmy.world on 28 Jun 10:37 collapse

I doubt anyone expected it to work completely, but it is interesting to see to what extent it worked and how it failed (halucinations and sycophancy)

A_norny_mousse@feddit.org on 28 Jun 11:13 collapse

True; I just hate headlines that ask stupid questions.

But then again, there’s always the premise that it could work, in such attempts, which annoys me no less.

Uff@lemmy.world on 28 Jun 12:17 next collapse

This shit needs to start being regulated.

Pro@programming.dev on 28 Jun 12:23 collapse

How so?

Uff@lemmy.world on 28 Jun 12:32 collapse

AI needs to be regulated. It’s already creeping everywhere. People getting fired and replaced with sloppy AI, holding petabytes of people’s data and work hostage, the list goes on. You can’t even ask a question without being asked for personal data to the AI and you certainly can’t do whatever you want with it.

If it’s going to replace humans, it needs to be regulated like one.

Grimy@lemmy.world on 28 Jun 15:10 collapse

There is currently no regulation against humans creating slop or making bad business decisions. Prohibiting the use of tools for certain tasks to save jobs is a recipe for disaster, which is actually what you are saying I think.

dhork@lemmy.world on 28 Jun 13:13 next collapse

It is an interesting article, even if it’s conclusions are entirely too rosy. The “storefront” was a single vending machine, and the bot was instructed to interact with Anthropic employees (with an hourly cost attached) to do all physical interactions. While the bot did a decent job managing the stock most of the time, it made a lot of bad decisions based on trying to be too helpful to it’s customers. It also frequently hallucinated, with some hilarious results I wont spoil here. But as anyone who owns a small business knows, one bad decision could put it under, so saying that an AI can manage a vending machine well “most of the time” is equivalent to saying it cant do the job at all.

Their conclusion is that with a bit more work, Claude might be able to perform as a middle-manager. To me, that says more about how useless middle-management is than how capable their AI is.

sepi@piefed.social on 28 Jun 22:16 collapse

So what you are saying is the AI is ready to replace tech CEOs.

Dojan@pawb.social on 29 Jun 10:00 next collapse

This is so funny. It fails miserably and they’re all “yeah so this is promising.”

Sure, a world where your manager hallucinates meetings with you and assesses you poorly for not performing according to plans that were hallucinated through said meetings sounds like a fantastic idea.

django@discuss.tchncs.de on 30 Jun 09:57 collapse

All the tasks could have been easily solved with some basic APIs and algorithms.