Planning to get a cheap-ish GPU. Would appreciate some advice.
一位用户正在寻求购买预算显卡的建议，最高预算为700美元，旨在运行本地大型语言模型，例如Qwen 3.8 27 B Q4_K_M，并达到每秒20个令牌以上的速度。他们正在考虑购买一块改装的2080 Ti 22 GB显卡，价格约为530美元，或者一块AMD Mi50 32 GB显卡，并对2080 Ti的上下文窗口表示担忧。该用户还在探索购买两块Mi50 16 GB显卡（总价240美元）的方案，或者批量购买Mi50 32 GB显卡的选择。
- 发布
- 2026年9月6日 17:25
- 来源类型
- 开发者社区
- 档位
- 社区
- 信源状态
- 正常
时间以 UTC 显示
更多信息
Hi, I've been wanting to run my own local LLM for some time and I finally saved enough to get a budget GPU. I can spend 700$ at most, and I'm looking for a GPU that can run quantized 30B~ parameter models with decent speed. Being able to run Qwen 3.8 27 B Q4_K_M and similar models at +20 T/s is good enough for me.
I mostly looked at Chinese shopping platforms such as Taobao and Alibaba since I've read here that they had cheaper listings and I found these prices:
Modified RTX 3080 20 GB for 570$
AMD Mi 50 32GB for 390$
Modified 2080 Ti 22 GB for 330$
These are all from sellers with 10+ sales, so they're probably trustworthy. Any cheaper selling prices I found are from accounts with 0 trading history and look like scams.
I'm planning to buy a modified 2080 Ti 22 GB, which, with customs, shipping, and other expenses, adds up to around 530$. Do you think this is a bad deal overall? Should I instead go for an AMD Mi50 with 32 GB? Because the model will have a really small context window with only 22 GB. Should I just go for two Mi50 16 GB for 240$ total? I even found a seller with a high number of sales who sold Mi50 32 GBs for 230$ but they were selling in bulk, so I needed to buy at least 5 of them, which is unfeasible for me.
Sorry for the long post. I didn't expect it to be so hard to find a good deal, and I don't live in the US or the EU, so I can't look for local or Facebook Marketplace deals. I would really appreciate some advice.