返回
RCreddit.com

Which qwen for vllm?

Qwen
时间与来源
发布
09/06 09:29
收录
09/06 16:00
来源类型
开发者社区
档位
社区
信源状态
正常
档位是按信源手工设定的编辑判断,不是逐条打分。

Hugging face has over 300 versions of qwen3.8-27b. I have no idea how to identify the beat model to download and use.

Should I sort by “most likes” or “most downloads”? Is there any sort of other guidance on which model to select?

I’m finally getting my local linux box up and running and just realized that actually picking a model may be one of the most difficult choices I’ll have to make. I’m hoping someone here can shed some light on the subject.

Also, if you could, I’m looking for concepts more than “use this one” because it’s not just about qwen, but also other models now (gemma/etc.) and in the future and I’m hoping to learn how to pick what I need from the mess of options out there (sure glad we have all these options though!).