this post was submitted on 06 Aug 2026
33 points (100.0% liked)
Technology
87627 readers
3650 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
End of the day, if it's in the cloud instead of local
and this applies for pretty much any service, not just LLM models
you're relying on trust in the service provider (as well as anyone who might buy them, and trust that they are able to secure their network against people who might break into it).
Only real exception to that is situations where you use client software from another source and the service provider only gets to see any data in encrypted form
think of someone providing storage for a
resticbackup, say.In 2026, we don't have enough memory to do local LLM computation everywhere, so there's a real limitation versus most other forms of SaaS
we can't choose to run LLMs locally for more than a fraction of society. Cloud-based LLMs require less memory to provision one machine in the cloud and share that hardware, since any one user is only using it a fraction of the time. But as the memory shortage ends, I expect you'll have more people running LLMs locally. Still be more-expensive from a hardware standpoint than cloud computation, though.