ChatGPT's Growth Is Flatlining: Where Does It Go From Here? (www.thewrap.com)
from catculation@lemmy.zip to technology@lemmy.world on 20 Feb 2024 12:17
https://lemmy.zip/post/10246733

#technology

threaded - newest

Gradually_Adjusting@lemmy.world on 20 Feb 2024 12:33 next collapse

It writes my most boring emails so that I can save a scrap of mental energy for parenting properly after work. Even though my WPM ranges between 70-90 with >98% accuracy, I would rather save some of that mental energy to respond more thoughtfully as a dad.

Of note, I do not give one cold shit about GPT’s “growth”. It’s a linguistic power tool that needs to be carefully handled if you use it for any valuable work.

deweydecibel@lemmy.world on 20 Feb 2024 12:45 next collapse

Of note, I do not give one cold shit about GPT’s “growth”

I mean, if you like the platform, it’s growth is tied to its continued existence and free usability. Still in the honeymoon phase as long as it’s growing.

AdamEatsAss@lemmy.world on 20 Feb 2024 12:52 next collapse

Why is growth tied to continued existence?

Khanzarate@lemmy.world on 20 Feb 2024 12:57 next collapse

Because companies insist on it and when growth stops they’ll start to cannibalize their own company and charge more money for things that used to be free or fairly-priced until they price themselves out of the market entirely and die as a service.

Yay, capitalism!

iAmTheTot@kbin.social on 20 Feb 2024 13:35 collapse

Capitalism demands that number must go up.

rottingleaf@lemmy.zip on 20 Feb 2024 18:06 collapse

Rather human psyche wants that, it’s scary to invest. There are still rare mom&pop stores\cafes which make sense economically for their owners. And there are individual artists.

What is visible now is a bit like colonial companies, it will end, until the next such thing.

“Capitalism” is a very variable thing.

muntedcrocodile@lemmy.world on 20 Feb 2024 15:19 collapse

They will start charging and or plaster it full of ads ive already sidestepped that with an api key and a foss frontent.

isles@lemmy.world on 20 Feb 2024 16:22 collapse

Before I respond to your question, first a message from our sponsor LMNT: Did you know that you’re about to die of dehydration? Our product stops that!

Fisch@lemmy.ml on 12 Mar 2024 12:24 collapse

Just wanted to say that “GPT” is a general term and not just a name. OpenAI tried to trademark it but couldn’t because of that. It’s as if Nintendo was trying to trademark the word “Kart” because of “Mario Kart”.

bassomitron@lemmy.world on 20 Feb 2024 12:38 next collapse

This was inevitable, not sure why it’s newsworthy. ChatGPT blew up because it brought LLM tech to the masses in an easily accessible way and was novel at the mainstream level.

The majority of people don’t have a use for chat bots day-to-day, especially one that’s as censored and outdated as ChatGPT (its dataset is from over 2 years ago). Casual users would want it for simple stuff like quickly summarizing current events or even as a Google search-like repository of info. Can’t use it for that when even seemingly innocuous queries/prompts are met with ChatGPT scolding you for being offensive, or that its dataset is old and not current. Sure, it was fun to have it make your grocery lists and workout plans, but that novelty eventually wears off as it’s not very practical all the time.

I think LLMs in the form of ChatGPT will truly become ubiquitous when they can train in real time on up-to-date data. And since that’s very unlikely to happen in the near future, I think OpenAI has quite a bit of progress left to make before their next breakout moment comes again. Although, Sora did wow the mainstream (anyone in the AI scene has been well aware of AI generated video for awhile now), OpenAI has already said they’re not making that publicly available for now (which is a good thing for obvious reasons unless strict safety measures are implemented).

blargerer@kbin.social on 20 Feb 2024 13:27 next collapse

The P in GPT is Pretrained. Its core to the architecture design. You would need to use some other ANN design if you wanted it to continuously update, and there is a reason we don't use those at scale atm, they scale much worse than pretrained transformers.

paddirn@lemmy.world on 20 Feb 2024 15:19 next collapse

I’m genuinely surprised anytime I get anything remotely useful from any of the AI chatbots out there. About half the responses are beyond basic-level shit that I could’ve written on my own or just found by Googling it, or it’ll give just plain wrong information. It’s almost useless with important, fact-based information if you can’t trust any of its responses, so the only thing it’s good for is brainstorming creative ideas or porn, and the majority of them out there won’t touch anything even mildly titillating, so you’re just left with this overly sensitive chatbot that takes about as much work to craft a good prompt as it would to just write the answer out yourself.

I tried playing a game of 20 Questions with one of them (my word was “donkey”, it was way off and even cheated a bit) and it kind of scolded me at the end because I told it the thing wasn’t bigger than a house, as if I was the one who got that fact wrong.

rottingleaf@lemmy.zip on 20 Feb 2024 18:10 collapse

Same, I don’t like my own habit of compulsively writing long nervous texts, but the side effect is that I can write quicker and easier myself most of what people want from LLMs.

paddirn@lemmy.world on 20 Feb 2024 18:27 collapse

I tend to overwrite in everything that I do, I actually kind of enjoy writing. Coming up with ideas and concepts and stuff is probably one of the more enjoyable aspects of the creative process for me, it’s about exploring possibilities and discovery and you never know where you’ll end up. Brainstorming is partly about making connections between seemingly unrelated things. Having a chatbot just blurt out a bunch of lazy half-formed ideas seems more counter-productive to me, it kind of taints the pool of ideas before you’ve even started. You’re starting off having to sift through a bunch of lazy ideas to try to find anything of value.

The image generation stuff is fun though, it’s interesting how what it comes up with sometimes, but the LLM text shit is just not there yet.

rottingleaf@lemmy.zip on 20 Feb 2024 18:33 collapse

What you describe is fun, being a chat bot yourself, habitually putting together words and pictures you don’t quite understand, is not, that’s what I’m talking about.

FaceDeer@kbin.social on 20 Feb 2024 15:25 collapse

It's not exactly training, but Google just recently previewed a LLM with a million-token context that can do effectively the same thing. One of the tests they did was to put a dictionary for a very obscure language (only 200 speakers worldwide) into the context, knowing that nothing about that language was in its original training data, and the LLM was able to translate it fluently.

OpenAI has already said they’re not making that publicly available for now

This just means that OpenAI is voluntarily ceding the field to more ambitious companies.

bassomitron@lemmy.world on 20 Feb 2024 19:45 collapse

Gemini is definitely poised to bury ChatGPT if its real world performance lives up to the curated examples they’ve demostrated thus far. As much as I dislike that it’s Google, I am still interested to try it out.

This just means that OpenAI is voluntarily ceding the field to more ambitious companies.

Possibly. While text to video has been experimented with for the last year by lots of hobbyists and other teams, the end results have been mostly underwhelming. Sora’s examples were pretty damn impressive, but I’ll hold judgment until I get to see more examples from common users vs cherry-picked demos. If it’s capable of delivering that level of quality consistently, I don’t see another model catching up for another year or so.

FaceDeer@kbin.social on 20 Feb 2024 21:16 collapse

Sora's capabilities aren't really relevant to the competition if OpenAI isn't allowing it to be used, though. All it does is let the actual competitors know what's possible if they try, which can make it easier to get investment.

bassomitron@lemmy.world on 22 Feb 2024 04:47 collapse

They are allowing people and companies to use it, it’s just limited access. I do not think it’s a good idea for them to open it to the public without plenty of safeguards. Deep fakes are becoming way, way too easy to manufacture nowadays, and I’m in no hurry to throw even more gasoline on a fire that’s already out of control.

furzegulo@lemmy.dbzer0.com on 20 Feb 2024 12:46 next collapse

hopefully it dies a quick but very painful death

FaceDeer@kbin.social on 20 Feb 2024 15:22 collapse

How dare they provide a useful tool like this, those bastards.

LazaroFilm@lemmy.world on 20 Feb 2024 12:53 next collapse

Was this article written by an ai?

FaceDeer@kbin.social on 20 Feb 2024 15:21 next collapse

Why do you think so, and why does it matter?

LazaroFilm@lemmy.world on 20 Feb 2024 16:33 collapse

<img alt="" src="https://lemmy.world/pictrs/image/9faa6335-c255-454f-be20-3e9fc5af0d89.jpeg">

FaceDeer@kbin.social on 20 Feb 2024 16:38 collapse

Exactly. Article looked fine to me, if it was AI-written then it did a good job.

homesweethomeMrL@lemmy.world on 20 Feb 2024 16:30 collapse

The image is AI. Look at the keys on that keyboard. What fucking language is that?

And for you AI fanbois who have to downvote this because nooooooo AI images future - pffft. Your boos mean nothing to me, I’ve seen what makes you cheer.

TheOctonaut@mander.xyz on 20 Feb 2024 17:59 next collapse

I’m downvoting you because you’re annoying and a detriment to the conversation, not because you recognised an AI generated image, which really didn’t require an inspection of the keyboard to determine.

homesweethomeMrL@lemmy.world on 21 Feb 2024 20:27 collapse

Oh yeah well you’re snobbish and truculent and i hereby demote you to poophead. Plus, you should see the other thread where the “obvious” AI image was roundly supported as being real.

Kolrami@lemmy.world on 24 Feb 2024 02:29 collapse

That looks like a human generated image. If you’ve played around with text to image generators you’d be hard pressed to find a keyboard that accurate. If I had to guess it’s a separate keyboard and monitor. That’s why the keyboard doesn’t seem to be centered. The hands are in the wrong place probably because they’re simply placed further to the right than a normal typist would be.

For real, try to generate images with a variety of current text to image models and you’ll see what I mean.

Kolrami@lemmy.world on 22 Feb 2024 13:55 collapse

They explicitly say that the image is AI. That doesn’t mean the article is. I’m not sure what your comment is implying.

Toes@ani.social on 20 Feb 2024 14:21 next collapse

GPT tried to convince me that there was more time in 366 days than 1.78 years.

FaceDeer@kbin.social on 20 Feb 2024 15:21 collapse

Large language models are notoriously poor at math, you should probably use a different tool for that sort of thing.

strawberry@kbin.run on 20 Feb 2024 16:58 next collapse

glorified autocorrect bad at math. who could have guessed

Windex007@lemmy.world on 20 Feb 2024 17:27 collapse

How do reconcile that with all of the people claiming they use it to write code?

FaceDeer@kbin.social on 20 Feb 2024 17:47 next collapse

Writing code to do math is different from actually doing the math. I can easily write "x = 8982.2 / 98984", but ask me what value x actually has and I'll need to do a lot more work and quite probably get it wrong.

This is why one of the common improvements for LLM execution frameworks these days is to give them access to external tools. Essentially, give it access to a calculator.

[deleted] on 20 Feb 2024 19:45 next collapse

.

whoelectroplateuntil@sh.itjust.works on 21 Feb 2024 05:16 collapse

If you’re like most developers, cognitive dissonance? gitclear.com/coding_on_copilot_data_shows_ais_dow…>

Modva@lemmy.world on 20 Feb 2024 15:08 next collapse

Jesus Christ, can we leave things alone that aren’t infinitely growing

micka190@lemmy.world on 20 Feb 2024 15:43 next collapse

“Gentlemen, it’s come to our attention that every one who could pay to use our product is paying to use our product. Unfortunately, it also means we’re no longer growing infinitely like we promised the shareholders we would. How do we fix this?”

The infinite growth mindset is so fucking stupid. Like, you’re still making an insane amount of money, what’s the fucking problem?

Modva@lemmy.world on 20 Feb 2024 16:35 next collapse

Yup. Shareholders are the problem, who bought shares at price X and want to sell those shares at X+Y.

And they will do anything to get it.

slacktoid@lemmy.ml on 21 Feb 2024 01:21 collapse

Yes but what they stupidly never realize is Y is a signed integer not unsigned

z3rOR0ne@lemmy.ml on 20 Feb 2024 17:19 next collapse

Because stock bros be lazy AF. They can’t even be bothered to buy and sell stock based off of who is and isn’t doing well, so they utilize investment firms who offer safe and risky bets like ETFs and Futures respectively. Ultimately, everyone really just wants to buy one stock, have it make them money that exponentially makes even more money quarter after quarter forever, and then do whatever they’d actually do if money were no object (i.e. actually live life).

We don’t live in a world where desire/need scales evenly with this desire for exponential, eternal growth. Therefore capitalists, who promise this impossible prospect to Wall Street, exploit human fears, desires, and needs however they can (union busting, lobbying, etc.) to keep growth up for as long as they can.

George Carlin probably put this concept best in what has to be one of the greatest bits of all time, on The Big Club. Although not directly related to this topic per se, it points to the truth of how this game between government politicians and capitalist corporate overlords is played. All the while, the majority of people, who are not in “The Big Club”, are basically fucked.

rottingleaf@lemmy.zip on 20 Feb 2024 17:59 collapse

Still I’m feeling tickles of admiration with nature seeing how these two seemingly unconnected things work together (human dream of making something from nothing without work, politicians being corrupt without realizing it).

stoly@lemmy.world on 20 Feb 2024 20:49 collapse

Business people really are just monkeys chasing shiny things. They tend to be less developed emotionally and are often very insecure on top of the entitlement. All they have is the chase, nothing else.

The most useless degree a university can grant is one in business administration.

SlopppyEngineer@lemmy.world on 20 Feb 2024 17:22 next collapse

No. Money has to make money with those sweet sweet interested payments. It’s baked in the system. How else are you going to maintain a small elite of filthy rich people?

Aceticon@lemmy.world on 22 Feb 2024 09:02 collapse

Ever more wealth must be constantly created in the World purelly to service the interest on all that debt out there otherwise you would get defaults and banks failing.

It’s not by chance that everywhere the “solution” for the 2008 Crash (that happenned due to over-indebtness mainly in the mortgage segment) was to lower interest rates to pretty much zero - it weakens the pressure on the entire system to constantly grow merelly to generate the additional wealth needed to pay the interest on the debt.

You’ll also notice that as soon as interest rates went up just a bit bank profits mssivelly grew.

rottingleaf@lemmy.zip on 20 Feb 2024 17:56 next collapse

Well, there are demands unsatisfied as long as humanity exists, so there is always space for good growth.

Only that is about infrastructure, or housing, or food production. Not chat bots.

Keineanung@lemmy.world on 20 Feb 2024 18:17 collapse

This!

werefreeatlast@lemmy.world on 20 Feb 2024 15:42 next collapse

Controlling drones to go get putin dead or…hey! Is that Buick? Anyway yes, putin please 🙏.

phi1997@kbin.social on 20 Feb 2024 16:07 next collapse

I hope it goes away

homesweethomeMrL@lemmy.world on 20 Feb 2024 16:31 next collapse

Obviously you’re not evolved enough to realize th AI is THE FUTURE of all things and everything is better with AI! A child in a poor environment was saved by AI! A king who was mean was dethroned with AI! Everyone was made happy by AI! Say it! SAY IT!!!

nul@programming.dev on 20 Feb 2024 17:06 collapse

Who’s Al??

atrielienz@lemmy.world on 21 Feb 2024 04:50 collapse

Allen Iverson.

FeelThePower@lemmy.dbzer0.com on 20 Feb 2024 18:19 next collapse

hopefully it shrinks :)

stoly@lemmy.world on 20 Feb 2024 20:48 next collapse

This was always going to be limited. Eventually, it doesn’t matter how much data you dump in, it won’t be unique enough to train anything new out of the model.

N00dle@lemmy.world on 21 Feb 2024 03:50 next collapse

That’s what the 7 TRILLION dollars they are seeking are for.

phoneymouse@lemmy.world on 21 Feb 2024 05:57 next collapse

I somehow think its usefulness isn’t tied to consumers logging in and just using it. Eventually, this thing will be bundled into a personal assistant like Siri or Alexa and that will be how most people use it.

Additionally, businesses are going to try to use it in a lot of different ways… replacing phone and chat support, writing ad copy, articles, code, legal documents, etc, etc, etc. It still feels a bit early for companies to have adopted it. I imagine it will just take a lot of work integrating it. ChatGPT also needs to be able to DO things, and wiring that all up is some work. For example, if I call a company for support with a product and ask for a refund, the AI needs to have access to the company’s systems to be able to do that task. It also has to do it reliably and correctly all the time.

It’s still really early days.

slimarev92@lemmy.world on 21 Feb 2024 07:02 collapse

Microsoft has a library that does exactly what you describe - Semantic Kernel. You can register plugins that do all sorts of things in the real world, and the AI API responds with instructions on how to use these plugins.

I’m very sceptical of LLMs, but this is the closest this technology came to actually being useful.

kromem@lemmy.world on 21 Feb 2024 06:18 next collapse

The free version sucks and the paid version increasingly refuses to do things for ‘safety’ and they have competitors finally catching up.

So where it goes is GPT-5 this year.

phoneymouse@lemmy.world on 22 Feb 2024 05:38 collapse

It pisses me off when I ask it to do something specific and it comes back with some verbose response about all the things I should think about or look into if I were to want to do that thing. Like, bitch, I’m not asking for advice, do it.

kromem@lemmy.world on 22 Feb 2024 07:42 collapse

The patronizing aspect is really ridiculous.

Especially when it gets the situation wrong as often as it does.

OpenAI have the best tech, but are making some really bad choices when it comes to productizing that tech.

Either the tech outpaces their bad decision making, or they are going to get eclipsed by companies catching up to their tech but with better product vision.

As amazing as I find their technology, I wouldn’t personally invest in the company.

feedum_sneedson@lemmy.world on 21 Feb 2024 06:23 next collapse

Jesus Christ it’s not all about growth.

Kbobabob@lemmy.world on 21 Feb 2024 07:11 collapse

Line must go up

Luisp@lemmy.dbzer0.com on 21 Feb 2024 07:18 next collapse

I think they mean we should put it out its misery?

Mastengwe@lemm.ee on 21 Feb 2024 07:47 next collapse

Collapse inward on itself like a dying star is the hope.

Cryan24@lemmy.world on 21 Feb 2024 20:39 next collapse

Given they quietly walked back their stance on military projects during the altman drama my guess would be MI related contracts.

SanndyTheManndy@lemmy.world on 22 Feb 2024 05:27 collapse

What does your mother-in-law have to do with AI?

webghost0101@sopuli.xyz on 22 Feb 2024 06:37 collapse

This article will be aged junk in 3,2 …

I get that the article is about user count but that really is about perceived usefulnesses and also more decent ai competitors to chatgpt pro.

They literally only just released text to video which they say will be used as a foundation for agi reasoning.

They have also hinted that training on gpt5 has begun and that it will be faster to train then gpt4

Just before that google came out with a new model that can keep track off 10 mil tokens, beats gemini pro and is also much faster to train. Gemini pro is barely a month old

This will not be a quite year for ai, if theres any flatline its going go be vertical, googles progress nearly is. Most ai progress benefits the entire industry over time.