Best model + setup for remote deployment.
一位用户正在为一个偏远村庄寻求本地运行大型语言模型的计算机设置建议。该村庄没有互联网，但电话畅通。预算约为5000美元，用于购买一台能够运行大型语言模型以提供基础知识和简单问答的计算机，效果类似于ChatGPT。接收者具备技术能力，可以学习运行命令。用户正在寻求满足这些特定需求的GPU推荐。
- 发布
- 2026年9月6日 18:40
- 来源类型
- 开发者社区
- 档位
- 社区
- 信源状态
- 正常
时间以 UTC 显示
更多信息
Hi everybody, I am in a tricky situation.
My grandfather + grandmother live in a remote village in asia, and were visiting us in the city. My grandfather has absolutely fallen in love with AI, and it is completely new for him. He loves how he can talk to it, and get information from it. The caveat is that I showed him chat gpt, not a localllm.
He wants something like this in his own village, just for basic knowledge + light qa. There is no internet in the village, but phone calls work. I have a budget of about 5k for a computer that can run LLMS locally, for him. (and he specifically requested something like this). He is technically "savvy", where if something needs a command to be run or something else, he can learn to do it. What gpu should I buy him that will satisfy his needs? again, I want some chat gpt level, but for basic q/a stuff.
I am currently running deepseek v4 flash on two 6000 pro blackwells(got them when they were just 8k lol), so I know that this is "possible".
Im thinking amd ai pro 9700 and gemma 31b at a good quantization. (maybe I can do two gpus of 9700s to fit bigger quant).
He is not doing frontier level coding, he just needs a good knowledge base. He implied that people from his village may also come to use the machine, or atleast request queries to be asked (he is some sort of governmental figure in his village).
I want recommendations.