this post was submitted on 23 Aug 2026
76 points (82.2% liked)

Technology

87575 readers
3796 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] majster@lemmy.zip 2 points 3 days ago (6 children)

This really killed a wish to run local LLMs. So fiddly...

[–] frongt@lemmy.zip 5 points 3 days ago (4 children)

Not any more than any other local service. Ollama makes it really easy to get started. The ministral models are small but still useful.

[–] nullroot@lemmy.world 1 points 2 days ago* (last edited 2 days ago)

~~Pretty funny. Most of this article was saying that ollama sucks now and they're just popular because there were one of the first.~~ Personally I started with them, too, but constantly ran into issues with them. I've have much better experiences with jan, open web UI, and LM studio. The first two are foss, and the second properly attributes their use of open source projects, unlike ollama.

Edit: nevermind, it's the link below me. It's still early in the morning, my bad

load more comments (3 replies)
load more comments (4 replies)