Will anyone need high end hardware to run local LLMs in 12-24 months time?
A Reddit user questioned whether high-end hardware, specifically a 512GB Mac Studio, would be a smart investment for running local LLMs in the next 12-24 months. They pondered if 64GB or less would suffice for open-weight models, considering the current state of the art and future developments in the field.
Time & source
- Published
- 09/08, 23:39 UTC+0
- Ingested
- 09/09, 18:00 UTC+0
- Source type
- Dev community
- Tier
- Community
- Source status
- Healthy
Tier is a per-source editorial setting, not a per-item score.
Discussion trend
The percentage is based on collected discussion signal, not new comments or independent people. The curve only compares the same topic across time.
You're better positioned to have a swing at this..
If I buy (or get in line for) a 512GB mac studio, is that a smart investment today? Or do we think that 64GB or less is going to be good enough to run any open weight model in 12-24 months time... given the current state of the art, and the way things are playing out?