DeepSeek-V4-Flash-Vision Q8 vs Qwen3.8-Flash-Next Q8
- Published
- 09/06, 20:15
- Ingested
- 09/06, 23:00
- Source type
- Dev community
- Tier
- Community
- Source status
- Healthy
A user compared DeepSeek-V4-Flash-Vision (DS-V4-Flash-Vision) Q8_K_XL with Qwen3.8-Flash-Next (Q3.8FN) Q8_K_XL, running both locally on hardware including 2x StrixHalo 128GB. While previously a fan of Qwen models, the user now primarily uses DS-V4-Flash-Vision due to its performance on their current hardware, despite acknowledging Qwen 3.8 27B as a great model.
I'm using DS-V4-Flash-Vision with Q8_K_XL quantization locally as my everyday engine, and for some time now I've been doing a lot of comparisons with Qwen3.8-Flash-Next, also with Q8_K_XL quantization. It took me quite a while to get Q3.8FN to work reasonably well, and here are my observations. My hardware: 2x StrixHalo 128GB, USB-C 4 connector, Llama (RPC) as inteference engine.
- DSV4FV is about 40% slower than Q38FN at the same quantization level when it comes to token generation alone.
- DSV4FV completes tasks about twice as fast as Q38FN! This means that DSV4FV “hallucinates” less (I observe this based on the obstacles the models encounter along the way).
- The Q38FN is unusable in “xhigh” mode. A simple task that the Q38FN completed in 25 minutes on “medium” mode, it failed to complete in ~3 hours on “xhigh” mode.
- The same task that the Q38FN completed in 25 minutes (average), the DSV4FV completed in 12 minutes (fastest round) on “medium”.
- The DSV4FV completed the same task on “max” in 37 minutes in first iteration, second took 44 minutes.
- Qwen3.8 tends to overinterpret my instructions. If I don’t write them out in great detail and leave room for creative interpretation, it will take advantage of that. Perhaps this is where it gets bogged down in its own creativity. In what it does, I’ve noticed that Qwen clearly adds too much and struggles to flesh out the details.
In my opinion, DSV4FV is the better solution when working with professional code.
Just so there’s no misunderstanding - I was a huge fan of Qwen 3.6 27B and of course now I'm Qwen 3.8 27B big fan, which I’ve been using a lot and is great! In general i’m a huge fan of Qwen, but ever since I’ve had the hardware on which I can run DSV4FV, I’ve been using it, and I’m super happy with how good this model is.