Back
RCreddit.com

Maybe a noob question, but why aren't there safetensor quants of inclusionAI/Ling-3.0-flash-Fin?

View original
LlamaModel releaseModel access
Time & source
Published
09/06, 18:26
Ingested
09/06, 23:00
Source type
Dev community
Tier
Community
Source status
Healthy
Tier is a per-source editorial setting, not a per-item score.
AI summary

A user on a developer community forum inquired why there are no safetensor quants available for the inclusionAI/Ling-3.0-flash-Fin model, noting that typically many different quants are released for new models. They observed that only llama.cpp quants are currently available for this specific model, prompting them to question if the absence of safetensor quants is due to architectural reasons.

Usually, everyone and their dog jumps on releasing different quants for new models, but when I check for inclusionAI/Ling-3.0-flash-Fin, I see quants only for llama.cpp.

So I'm just wondering, is it architectural?