Deceptive model quantization from AtomicChat?
热度趋势
趋势数据积累中
百分比基于当前可用热度信号，而非评论数或独立用户人数。
AtomicChat的Qwen3.8-Flash-Next量化模型因可能存在欺骗性做法而受到审查。用户发现其Q4_K_M量化模型异常小（约56GB），并且可以在unsloth的模型无法运行的机器上运行。调查显示，大多数张量是IQ2_S，而非预期的Q4_K、Q5_K或Q6_K，GGUF元数据也证实了这一点。此外，该模型卡片中Q4_K_M的KLD值（0.084）异常高，引发了对其真实量化水平的担忧。
I kept seeing guys in this sub saying how AtomicChat's Qwen3.8-Flash-Next quant is so good, fits in their machine when unsloth's can't, runs faster than other quants etc, so I went check out what's happening there.
First thing I noticed was that AtomicChat's Q4_K_M quant is suspiciously small when the ngram table is removed (only ~56GB), it seems like most of the tensors in this quant are IQ2_S instead of the usual Q4_K, Q5_K and Q6_K that you usually find in Q4_K_M quants, the GGUF filetype metadata also says IQ2_S instead of Q4_K_M. In their model card, their Q4_K_M also has suspiciously high KLD (0.084).
It seems pretty obvious to me that they're pretending a IQ2_S quant as a Q4_K_M, but at the same time I'm genuinely not sure because it can't be only me who found this right? How can nobody be pointing this out? Am I missing something or what may they be doing?
Their HF repo ID: AtomicChat/Qwen3.8-Flash-Next-GGUF