Back
RCreddit.com

M5 Max users: what models are you using & what tk/s are you getting?

View original
Model release
Time & source
Published
09/06, 01:32
Ingested
09/06, 16:00
Source type
Dev community
Tier
Community
Source status
Healthy
Tier is a per-source editorial setting, not a per-item score.

I was using antirez’s ds4 for a while and getting around 20 tk/s, which worked for my purposes. But I know there have been big advancements between Qwen, the DS4 vision model, and GLM.

I’m not sure how the quants affect performance, so what’s the best thing to run right now & how fast is it?