gpt-oss: OpenAI releases 2 open-source models (openai.com)
from hisao@ani.social to technology@lemmy.world on 06 Aug 10:58
https://ani.social/post/17925995

#technology

threaded - newest

Mwa@thelemmy.club on 06 Aug 11:10 next collapse

Crazy but sure ig

jeena@piefed.jeena.net on 06 Aug 11:14 next collapse

I tried the 20b on my PC with ollama and Open WebUI and I have to say for some of my use cases it preforms similar to the online version, I was impressed.

glimse@lemmy.world on 06 Aug 12:33 collapse

What card are you running it on?

jeena@piefed.jeena.net on 06 Aug 12:49 collapse

Nvidia rtx 3060 the 12GB Vram one

glimse@lemmy.world on 06 Aug 13:27 collapse

Not bad. Does it use all the VRAM?

jeena@piefed.jeena.net on 07 Aug 01:41 collapse

I need to check with that model but usually yes.

thoon@feddit.nl on 06 Aug 11:52 next collapse

Finally, their company name is starting to make SOME sense

nymnympseudonym@lemmy.world on 06 Aug 14:30 next collapse

It’s awesome but that 128k context window is a throwback to Llama3 days

I bet the closed $ource model has like 2MB context

fubarx@lemmy.world on 13 Aug 06:09 collapse

Ran the 20B on a Mac under LMStudio. Pretty zippy and did OK on basic coding tasks.