this post was submitted on 27 Aug 2026
308 points (99.0% liked)

Technology

87649 readers
3525 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] BassTurd@lemmy.world 79 points 3 days ago (24 children)

Sounds like there's a market for a hugging face comeptitor.

Nvidia is seeing the writing on the wall that local models are the only viable future for AI. They have to try and squash that now before it's too late. I mean, it is already is too late, as they've hooked there wagons to these AI companies, and that shit's going to end and nividia is going to be a bag holder. I can't wait.

[–] tias@discuss.tchncs.de 24 points 3 days ago (9 children)

NVidia wins if people run local models on their hardware too. Hugging face is not a competitor, it is an enabler.

[–] BassTurd@lemmy.world 8 points 3 days ago (5 children)

Maybe, but CPUs are coming out with LLM tuned chips, and I can run a basic model on an i5, 8gb ram, and no dedicated card. It's not super powerful, but for most users, it's more than enough for what they use the big models for. Also, if it does take a discrete card to get that needed boost in performance, then at least consumers would be able to get GPUs again.

I think as hardware improve and is further designed around LLM efficiency, and local models are tuned for specific uses and being able to run on lesser hardware, it will make Nvidia obsolete for large swaths of the population. A good GPU will still be necessary for high performance, graphic/physics intense gaming, but that's a really small subset of all users.

Hopefully Nvidia just shits and has to grovel back to the consumer to get there marketshare back when all of the DCs go tits up.

[–] mesamunefire@piefed.social 1 points 2 days ago (1 children)

Bitcoin went through a similar trajectory. Graphic cards to specualty chips.

[–] squaresinger@lemmy.world 1 points 8 hours ago (1 children)

AI won't really do that, because it's a very different workload.

Mining Bitcoin needs very little memory but extremely complex maths calculations. It has a built-in difficulty mechanism that makes the math more difficult if mining goes too fast.

ASICs are unbeatable when it comes to super-fast pure calculation.

AI work is mostly memory-bound. You need huge amounts of RAM (24GB for a somewhat decent model, a few TB for frontier models) and then you perform pretty simple vector math on that huge amount of data in memory. So the main limiting factors are RAM size and bandwidth. The computation power of a GPU doesn't matter that much. Also GPUs contain ASICs for vector math already.

Standalone ASICs have no advantage over GPUs for this workload. The only thing you could do with a specialty chip is remove some unnecessary parts of a GPU to save a bit of cost and energy, thus turning a GPU that can be repurposed or resold if the AI bubble pops into a single-purpose device that has to be discarded if the bubble pops.

[–] mesamunefire@piefed.social 1 points 7 hours ago

You bring up some good points. Just FYI my research was specifically on ai, but a very specific branch in college. So not llm but only somewhat llm flavored.

The are already including ai chips in consumer hardware. And your thinking of llm specific limitations. But the smaller models can absolutly be thrown into hardware. Its just the algorithms are moving so fast that the hardware needs to be flexible enough. Thars the biggest reason we dont see more hardware faster than gpus. Hooe that makes sense!

load more comments (3 replies)
load more comments (6 replies)
load more comments (20 replies)