A.I. groks 66%-76% faster with data augmentation strategies. (arxiv.org)
from Hackworth@lemmy.world to technology@lemmy.world on 22 Aug 2024 18:00
https://lemmy.world/post/18935912

#technology

threaded - newest

catloaf@lemm.ee on 22 Aug 2024 18:37 next collapse

AI doesn’t grok anything. It doesn’t have any capability of understanding at all. It’s a Markov chain on steroids.

Hackworth@lemmy.world on 22 Aug 2024 18:41 next collapse

Did you read the paper? Or at least have an llm explain it?

yesman@lemmy.world on 22 Aug 2024 19:00 collapse

I read the abstract, and the connection to your title is a mystery. Are you using “grock” as in “transcendental understanding” or as Musk’s branded AI?

Hackworth@lemmy.world on 22 Aug 2024 19:03 collapse

No c, just grok, originally from Stranger in a Strange Land. But a more technical definition is provided and expanded upon in the paper. Mystery easily dispelled!

Blueberrydreamer@lemmynsfw.com on 22 Aug 2024 20:34 next collapse

Thanks for clarifying, now please refer to the poster’s original statement:

AI doesn’t grok anything. It doesn’t have any capability of understanding at all. It’s a Markov chain on steroids.

Hackworth@lemmy.world on 22 Aug 2024 20:48 collapse

We follow the classic experimental paradigm reported in Power et al. (2022) for analyzing “grokking”, a poorly understood phenomenon in which validation accuracy dramatically improves long after the train loss saturates. Unlike the previous templates, this one is more amenable to open-ended empirical analysis (e.g. what conditions grokking occurs) rather than just trying to improve performance metrics

catloaf@lemm.ee on 22 Aug 2024 22:23 collapse

Oh okay so they’re just redefining words that are already well-defined so they can make fancy claims.

Hackworth@lemmy.world on 22 Aug 2024 22:36 collapse

Well-defined for casual use is very different than well-defined for scholarly research. It’s standard practice to take colloquial vocab and more narrowly define it for use within a scientific discipline. Sometimes different disciplines will narrowly define the same word two different ways, which makes interdisciplinary communication pretty funny.

technocrit@lemmy.dbzer0.com on 23 Aug 2024 15:49 next collapse

It’s standard practice to take colloquial vocab and more narrowly define it for use within a scientific discipline.

No. It’s not standard at all, especially when the goal is overtly misleading.

Sometimes different disciplines will narrowly define the same word two different ways

Maybe one or both disciplines is promoting bullshit.

Hackworth@lemmy.world on 23 Aug 2024 16:26 collapse

Did you have a question?

EncryptKeeper@lemmy.world on 24 Aug 2024 04:24 collapse

Yeah what ails you, stranger?

[deleted] on 23 Aug 2024 18:21 collapse

.

yesman@lemmy.world on 22 Aug 2024 20:36 collapse

In that case I refer you to u/catloaf 's post. A machine cannot grock, not at any speed.

Thorny_Insight@lemm.ee on 23 Aug 2024 05:02 collapse

…is how generative-AI haters redefine terms and move the goalposts to fight their cognitive dissonance.

technocrit@lemmy.dbzer0.com on 23 Aug 2024 15:47 collapse

Imagine believing that AI-haters are the ones who redefine terms and move goalposts to fight their cognitive dissonance.

eggymachus@sh.itjust.works on 22 Aug 2024 19:29 collapse

Thanks for posting, please ignore the stochastic luddites 🙂

Hackworth@lemmy.world on 22 Aug 2024 21:29 collapse

I appreciate it. I’ve had little luck engaging people in conversation about AI research in general. Since abandoning reddit, I’ve been litmus testing other platforms. I’m afraid this puts lemmy at about a 12. /shrug. Still better than reddit.

Thorny_Insight@lemm.ee on 23 Aug 2024 05:05 collapse

I couldn’t think of a worse platform to try and discuss this topic than Lemmy. The consensus here is essentially that big companies = bad, AI companies = big, and thus AI = bad.

Hackworth@lemmy.world on 23 Aug 2024 12:37 collapse

Know of any good platforms for this, by chance?

Thorny_Insight@lemm.ee on 23 Aug 2024 13:01 next collapse

No, but probably the dedicated subreddit

Hackworth@lemmy.world on 23 Aug 2024 14:52 collapse

You’d think, but not really. /r/chatgpt and a couple AI art subs are the only active ones. And “active” means bots and parrots in this case.

Thorny_Insight@lemm.ee on 23 Aug 2024 15:19 collapse

Well, I’m on Lemmy myself, so perhaps that’s some sort of an indication of where I prefer to discuss thing with people in general, not just about AI. My list of blocked users is rather vast though, so a big part of the loudest haters are being filtered out from my feed. That surely contributes to the better experience here - or atleast less bad.

Definitely prefered it over there at reddit, but I’m a man of principle so I’m not going back either.

technocrit@lemmy.dbzer0.com on 23 Aug 2024 15:50 collapse

Maybe ycombinator? Just look for places where grifters and marks meet up.