RCreddit.com
9
·开发者社区 · RSS
Devs - you have 64gb of VRAM - which model do you use for coding?
这条记录涉及编程工具或代码能力更新，适合开发者评估工作流变化和可复用价值。
I've currently settled on an unsloth version of Qwen 3.5 122b-a10b model (UD-IQ4_NL). With 100k bf16 context window, I only had to load a few layers into CPU/RAM, it runs around 30 tok/sec which is fine for me.
I've tested many models, hours of testing but I am currently deeply impressed with this one. I also use the Qwen 3.6 models (both) depending on need, but I think this biggun' is about to become my daily driver.
Curious to know what others with similar VRAM capacity use?
主题标签模型发布
原始关键词#coding#model#which#64gb#devs#vram