返回
RCreddit.com
10
·开发者社区 · RSS

Biggest, baddest model to fill 144GB VRAM + 120GB RAM to the brim, regardless of speed

查看原文
推荐理由

这条记录涉及编程工具或代码能力更新,适合开发者评估工作流变化和可复用价值。

I'm trying to round out my quiver of daily driver models for my personal harness. Right now I drive qwen3.6 27b for balanced code and gemma4 31b for human interaction with lots of context and a few parallel sessions. Minimax M2.7 at Q6 clocks in at 207gb base and just barely fits once I get KV cache and context down for when I have a "take all day to answer; just be right" problem. I'm debating on moving to M3 at Q3, but I'm wondering if there are any other chonky models that will fill my 264GB with base + KV + context -- qwen3.6 is pretty special in terms of punching above its weight but I really want the most intelligent model possible for more complex reasoning, coding, and tool calling. Any favorites? Anyone compared M3@Q3 vs M2.7@Q6? They seem fairly equivalent to me but I love me some anecdata :)

主题标签模型发布
原始关键词#regardless#baddest#biggest#120gb#144gb#model
查看原文reddit.com
单一来源,暂无交叉验证
Biggest, baddest model to fill 144GB VRAM + 120GB RAM to the brim, regardless of speed · BuzzRadr