Unsloth UD-quants - Qwen 3.8 27b for example - worth using 8-bit or stick with faster 6 bit for coding?
A developer is asking the community about the optimal quantization for coding projects using Unsloth UD-quants, specifically Qwen 3.8 27b. They are debating whether to use 8-bit quants, if memory allows, or to stick with the faster UD-Q6_K_XL (6-bit). The developer notes that 6-bit is noticeably faster on their setup, despite others claiming the difference is imperceptible, and seeks community input on their experiences and test results.
时间与来源
时间显示为 UTC
显示时区：UTC
本地时区尚不可用，暂时显示 UTC。
发布当时偏移：UTC+02026年9月12日 04:18 UTC
收录当时偏移：UTC+02026年9月12日 22:01 UTC
- 发布
- 2026年9月12日 04:18
- 收录
- 2026年9月12日 22:01
- 来源类型
- 开发者社区
- 档位
- 社区
- 信源状态
- 正常
档位是按信源手工设定的编辑判断，不是逐条打分。
For those using these models for coding in larger projects where things can get complex, do you find yourself using the 8-bit quants if you have enough memory? Or do you stick with UD-Q6_K_XL?
The 6-bit is faster, noticeably so on my setup. And I keep seeing people say it's imperceptible. I've been doing tests myself, and well, I can't tell, but maybe that's just because I'm an idiot.
That said, can you tell? Have you ever done some tests to see?