13 Best Open Source ChatGPT Alternatives
(itsfoss.com)
from Eezyville@sh.itjust.works to technology@lemmy.world on 12 Jan 2024 14:44
https://sh.itjust.works/post/12639643
from Eezyville@sh.itjust.works to technology@lemmy.world on 12 Jan 2024 14:44
https://sh.itjust.works/post/12639643
For those of you who don’t want to use a ChatGPT but want a LLM.
threaded - newest
I use chat.petals.dev I think that is also open source
I asked it “how are you?”
After waiting 5 minutes it errors and my browser crashed.
That’s a perfectly acceptable response from Gen-A.
That’s unfortunate! I never had it crash and i use it a lot
It’s got a sense of humor maybe…
i.postimg.cc/26XDCcsY/IMG-9182.jpg
Shit…it’s become self aware.
Yeah… That’s the problem with FOSS LLMs, either you have a whole expensive setup to run your own personal AI chatbot or you might as well just use ChatGPT.
That would be my answer too TbF
Also want to mention privateGPT
.
I’ve been using iask.ai or Phind.com for mostly quick answers to my simple questions, these get me by but I’m no coder or author and I have noticed these options are often pretty terrible for math queries.
Edit: the above services I’m pretty sure are not open source, but their privacy policies seem reasonable.
Holy Cyberjesus… I don’t experience with ChatGPT and the likes, and it’s obviously only one response, but the answer I got from api.together.xy to “Is it okay to do intense tempo runs in winter?” is absolutely useless and wrong and neglecting the actual problems that are usually mentioned (cold air while breathing intensely):
No mention of the ai horde , seriously? We have thousands of users!
That’s dope never heard of it until now
As it’s to be expected from this website, the article quality is subpar.
They mix third party hosted LLMs, with frontends (KoboldAI, GPT4ALL) and with local models (which BTW, every single one of them is a llama finetune. They’ve never heard of mistral or others, apparently).
If I hadn’t read this website years ago and knew that the quality was already trash back then, I’d say this very article was written by a LLM.
It’s a bad list.
YSK: There are several things mixed in it.
There is a bewildering array of models out there. Mostly, they are specialized and/or merged versions of some popular foundation models (by mistral, meta, and a few others). Without endorsing any service, I find that openrouter.ai and together.ai let you try a fairly large selection. There are other services.
You can find more/better information here: !localllama@sh.itjust.works
Very strange article. It lists several front ends, some of which are not open source, as well as some raw models without clearly distinguishing between them. RWKV was mentioned which is cool I guess.
The first option listed should have been huggingchat, followed by the various local UIs, with a separate section discussing the models themselves.
I feel like most of these “10 alternatives to xyz”-articles are basically a summary of alternativeto.net. Or they’ve just listed all projects they’ve found with a quick search. I’m almost certain they didn’t install them most of the time.
This also applies to “comparison” sites, which usually are a list of Amazon affiliate links. At this point, I don’t trust websites with affiliate links anymore, as they’ve never actually tried the products. Sadly those spam sites make it difficult to find actually good reasearched tests.
Back to itsfoss, they write many articles, and some are good, but they still are blog spam.
Pretty bad article, but here are my two cents on the actual answer, as of right now:
These perform similar to or better than ChatGPT 3.5, in some cases comparable to 4.
For specific niche applications (role playing, nsfw stories, etc), just search on huggingface.co and read the user reviews.