Voroxpete@sh.itjust.works
on 26 Sep 2024 09:57
nextcollapse
Least shocking news ever. This has clearly been in the works for a while. Not that it’ll matter at this point, given that the notion of OpenAI making any profit is kind of a pipe dream right now.
This is mostly just a play to get investors to sink more money into covering their absolutely insane cash burn for another year.
They might not make a profit, but Altman will be able to extract a lot of wealth by using 7% of a billions of dollars valuation. Even if he doesn’t sell any he can use it as collateral against loans to effectively turn them into cash.
Voroxpete@sh.itjust.works
on 26 Sep 2024 12:27
nextcollapse
Oh, absolutely. Altman is going to plunder this sinking ship for everything it’s worth, and then bail into a CTO position somewhere else. All the C suite at OpenAI will win big no matter what, everyone else there will get fucked.
AdamBomb@lemmy.sdf.org
on 26 Sep 2024 14:40
collapse
But wouldn’t he have to repay such loans?
amzd@lemmy.world
on 26 Sep 2024 14:59
nextcollapse
Only if the collateral he put up goes down in value too much
Alphane_Moon@lemmy.world
on 26 Sep 2024 16:50
nextcollapse
It’s not like he will be spending the cash exclusively on blow, model escorts and yachts.
Part will go into real investments. And he is well positioned to time an AI pump and dump.
EncryptKeeper@lemmy.world
on 26 Sep 2024 17:46
collapse
Yes, with the money he’d earn off the money he borrowed. This is why taxing unrealized gains is a national conversation. “It’s not money until you sell it” but you can borrow it like it’s money and make actual other money with it likes it’s money.
AdamBomb@lemmy.sdf.org
on 27 Sep 2024 16:57
collapse
This is an informative answer, thank you
Fuzzypyro@lemmy.world
on 26 Sep 2024 10:05
nextcollapse
Aaaaand
^Pop^ goes the AI bubble.
Last stages of capitalism for tech is usually in the form of an ipo of some sort which is what this will lead to.
There will be other cool shit obviously with integrations and tools that will hopefully trickle down to open source models but the writing is on the wall. This is a cash out and enshittify move.
The best news out of it is we will start to see less and less
“our company is Ai and we shoved Ai into said thing” as the companies late to the game will continue to shoot their shot until OpenAI has completely dominated the market and investors stop caring.
AI peaked a while ago IMO, the nail in the coffin for me was Microsoft making deals for nuclear power plants to power their data centers for ML and AI. It’s great they’re using nuclear power since it’s at least a clean source of energy, but it’s also extremely telling of the limitations and power requirements for these languages models. Without some kind of power reduction breakthrough, AI will continue to stall while these companies think of new ways to sell snake oil and gimmicks.
I was just thinking to myself as I got mad at my Google Home speaker for now sucking that they probably did it on purpose because the electrical and processing requirements were too high to keep it at the levels from, say, 2019. They had to cut off half of the assistant’s brain to stop draining money.
vonxylofon@lemmy.world
on 26 Sep 2024 17:25
nextcollapse
Glad to see I’m not the only one harboring this conspiracy.
It’s the only way to explain the lobotomy going from Google Now to Assistant
slaacaa@lemmy.world
on 26 Sep 2024 11:33
nextcollapse
ClosedAI
bloup@lemmy.sdf.org
on 26 Sep 2024 12:32
nextcollapse
When you organize a nonprofit, you dedicate it to the public benefit. it’s not supposed to ever have owners, everything it does it supposed to be for me and you. as far as I’m concerned, this is a multi billion dollar larceny against the general public and we really need better laws that preserve our nonprofit institutions. Just even trying to plan this out is a crime against humanity
Rekall_Incorporated@lemm.ee
on 26 Sep 2024 13:33
nextcollapse
To implement something like this, you would need a radical change in judicial and criminal systems.
Something along the lines of any white collar crime worth more than say 10 annual local median salaries, would require a rehabilitation program (if convicted) that would start with full asset seizure (absolutely everything) and a minimum of 10 years real community service (live-in junior janitor at an Alzheimer’s outpatient institution with minimum wage and limited access to internet and smartphones). The community service could easily be extended to 20, 30 or 40 years depending the on the severity of the crime.
You would also need to get rid of various “get out of jail free” laws and make it easy to organized criminals and send them to rehabilitation programs.
stoly@lemmy.world
on 26 Sep 2024 17:00
nextcollapse
I also come to the conclusion that this was planned from the start–that if it ever took off, they would change the status and profit from it. They took tax breaks for years in the early days and now want to take a capital benefit.
Eyeuhnluuung@lemmy.world
on 26 Sep 2024 17:09
collapse
With healthcare systems and churches as some of the biggest offenders.
_sideffect@lemmy.world
on 26 Sep 2024 12:38
nextcollapse
PumpkinEscobar@lemmy.world
on 26 Sep 2024 14:31
nextcollapse
It’s a good thing that real open source models are getting good enough to compete with or exceed OpenAI.
Vorticity@lemmy.world
on 26 Sep 2024 15:08
collapse
Can you recommend some models to try?
PumpkinEscobar@lemmy.world
on 26 Sep 2024 16:00
collapse
First a caveat/warning - you’ll need a beefy GPU to run larger models, there are some smaller models that perform pretty well.
Adding a medium amount of extra information for you or anyone else that might want to get into running models locally
Tools
Ollama - great app for downloading/managing/running models locally
OpenWebUI - A web app that provides a UI like the ChatGPT web app, but can use local models
continue.dev - A VS Code extension that can use ollama to give a github copilot-like AI assistant running against a local model (can also connect to Anthropic Claude, etc…)
Model size is measured by parameter count. Generally higher parameter models are better (more “smart”, more accurate) but it’s very challenging/slow to run anything over 25b parameters on consumer GPUs. I tend to find 8-13b parameter models are a sort of sweet spot, the 1-4b parameter models are meant more for really low power devices, they’ll give you OK results for simple requests and summarizing, but they’re not going to wow you.
If you look at the ‘tags’ for the models listed below, you’ll see things like 8b-instruct-q8_0 or 8b-instruct-q4_0. The q part refers to quantization, or shrinking/compressing a model and the number after that is roughly how aggressively it was compressed. Note the size of each tag and how the size reduces as the quantization gets more aggressive (smaller numbers). You can roughly think of this size number as “how much video ram do I need to run this model”. For me, I try to aim for q8 models, fp16 if they can run in my GPU. I wouldn’t try to use anything below q4 quantization, there seems to be a lot of quality loss below q4. Models can run partially or even fully on a CPU but that’s much slower. Ollama doesn’t yet support these new NPUs found in new laptops/processors, but work is happening there.
Llama 3.1 - The 8b instruct model is pretty good, decent speed and good quality. This is a good “default” model to use
Llama 3.2 - This model was just released yesterday. I’m only seeing the 1b and 3b models right now. They’ve changed the 8b model to 11b, I’m assuming the 11b model is going to be my new goto when it’s available.
Command-r - This is a more niche model, mainly useful for RAG. It’s only available in a 35b parameter model, so not all that feasible to run locally
Mistral small - A really good model, in the ballpark of Llama. I haven’t had quite as much luck with this as with Llama but it is good and I just saw that a new version was released 8 days ago, will need to check it out again
homesweethomeMrL@lemmy.world
on 26 Sep 2024 15:11
nextcollapse
Y’all hear the scary music yet?
benni@lemmy.world
on 26 Sep 2024 20:07
nextcollapse
I hate him so much bros
helenslunch@feddit.nl
on 27 Sep 2024 20:46
collapse
I’m so confused. I thought this was illegal?
The OpenAI non-profit will continue to exist and own a minority stake in the for-profit company
Wait what? Are they restructuring to a for-profit or not? They already have a separate for-profit company.
TheGalacticVoid@lemm.ee
on 27 Sep 2024 23:15
collapse
OpenAI the non-profit owned OpenAI the company since the company was created. The non-profit is simply reducing its stake/share of the company and giving it to investors and/or Altman
helenslunch@feddit.nl
on 28 Sep 2024 00:00
collapse
threaded - newest
Least shocking news ever. This has clearly been in the works for a while. Not that it’ll matter at this point, given that the notion of OpenAI making any profit is kind of a pipe dream right now.
This is mostly just a play to get investors to sink more money into covering their absolutely insane cash burn for another year.
They might not make a profit, but Altman will be able to extract a lot of wealth by using 7% of a billions of dollars valuation. Even if he doesn’t sell any he can use it as collateral against loans to effectively turn them into cash.
Oh, absolutely. Altman is going to plunder this sinking ship for everything it’s worth, and then bail into a CTO position somewhere else. All the C suite at OpenAI will win big no matter what, everyone else there will get fucked.
But wouldn’t he have to repay such loans?
Only if the collateral he put up goes down in value too much
It’s not like he will be spending the cash exclusively on blow, model escorts and yachts.
Part will go into real investments. And he is well positioned to time an AI pump and dump.
Yes, with the money he’d earn off the money he borrowed. This is why taxing unrealized gains is a national conversation. “It’s not money until you sell it” but you can borrow it like it’s money and make actual other money with it likes it’s money.
This is an informative answer, thank you
Aaaaand
^Pop^ goes the AI bubble.
Last stages of capitalism for tech is usually in the form of an ipo of some sort which is what this will lead to.
There will be other cool shit obviously with integrations and tools that will hopefully trickle down to open source models but the writing is on the wall. This is a cash out and enshittify move.
The best news out of it is we will start to see less and less “our company is Ai and we shoved Ai into said thing” as the companies late to the game will continue to shoot their shot until OpenAI has completely dominated the market and investors stop caring.
AI peaked a while ago IMO, the nail in the coffin for me was Microsoft making deals for nuclear power plants to power their data centers for ML and AI. It’s great they’re using nuclear power since it’s at least a clean source of energy, but it’s also extremely telling of the limitations and power requirements for these languages models. Without some kind of power reduction breakthrough, AI will continue to stall while these companies think of new ways to sell snake oil and gimmicks.
I was just thinking to myself as I got mad at my Google Home speaker for now sucking that they probably did it on purpose because the electrical and processing requirements were too high to keep it at the levels from, say, 2019. They had to cut off half of the assistant’s brain to stop draining money.
Huh, never thought of that that way.
Glad to see I’m not the only one harboring this conspiracy.
It’s the only way to explain the lobotomy going from Google Now to Assistant
ClosedAI
When you organize a nonprofit, you dedicate it to the public benefit. it’s not supposed to ever have owners, everything it does it supposed to be for me and you. as far as I’m concerned, this is a multi billion dollar larceny against the general public and we really need better laws that preserve our nonprofit institutions. Just even trying to plan this out is a crime against humanity
To implement something like this, you would need a radical change in judicial and criminal systems.
Something along the lines of any white collar crime worth more than say 10 annual local median salaries, would require a rehabilitation program (if convicted) that would start with full asset seizure (absolutely everything) and a minimum of 10 years real community service (live-in junior janitor at an Alzheimer’s outpatient institution with minimum wage and limited access to internet and smartphones). The community service could easily be extended to 20, 30 or 40 years depending the on the severity of the crime.
You would also need to get rid of various “get out of jail free” laws and make it easy to organized criminals and send them to rehabilitation programs.
I also come to the conclusion that this was planned from the start–that if it ever took off, they would change the status and profit from it. They took tax breaks for years in the early days and now want to take a capital benefit.
With healthcare systems and churches as some of the biggest offenders.
Lmao, this has been a scam from the start.
This was precisely what I thought the moment I heard the news a couple days ago.
.
It’s a good thing that real open source models are getting good enough to compete with or exceed OpenAI.
Can you recommend some models to try?
First a caveat/warning - you’ll need a beefy GPU to run larger models, there are some smaller models that perform pretty well.
Adding a medium amount of extra information for you or anyone else that might want to get into running models locally
Tools
Models
If you look at ollama.com/library?sort=featured you can see models
Model size is measured by parameter count. Generally higher parameter models are better (more “smart”, more accurate) but it’s very challenging/slow to run anything over 25b parameters on consumer GPUs. I tend to find 8-13b parameter models are a sort of sweet spot, the 1-4b parameter models are meant more for really low power devices, they’ll give you OK results for simple requests and summarizing, but they’re not going to wow you.
If you look at the ‘tags’ for the models listed below, you’ll see things like
8b-instruct-q8_0or8b-instruct-q4_0. The q part refers to quantization, or shrinking/compressing a model and the number after that is roughly how aggressively it was compressed. Note the size of each tag and how the size reduces as the quantization gets more aggressive (smaller numbers). You can roughly think of this size number as “how much video ram do I need to run this model”. For me, I try to aim for q8 models, fp16 if they can run in my GPU. I wouldn’t try to use anything below q4 quantization, there seems to be a lot of quality loss below q4. Models can run partially or even fully on a CPU but that’s much slower. Ollama doesn’t yet support these new NPUs found in new laptops/processors, but work is happening there.A really nice summary. Very useful. Thanks!
Y’all hear the scary music yet?
I hate him so much bros
I’m so confused. I thought this was illegal?
Wait what? Are they restructuring to a for-profit or not? They already have a separate for-profit company.
OpenAI the non-profit owned OpenAI the company since the company was created. The non-profit is simply reducing its stake/share of the company and giving it to investors and/or Altman
Ah, that makes more sense, thanks.