Connecting Hobby Project to LLM (hijacked.link)
from zinderic@programming.dev to selfhosted@lemmy.world on 10 Jun 13:56
https://programming.dev/post/15330366

I love playing with LLMs locally at home. The cost of running hobby projects against paid services like OpenAI is too high for me so in this article you can find out how I work around that to keep my LLM infra deployed locally at home and still use it anywhere I like.

#selfhosted

threaded - newest

F4U57@lemmy.ml on 22 Jun 05:24 collapse

This is literally what I do all day everyday for the last like 6 months or so. Kind of at the point where my Hardware is limiting me on what I can do but I continue to press forward so kudos. I am 100% sure it’ll be worth it.