返回
·1天前
较热 · 17
已不在热榜 · 最后追踪于 08/30 07:00

Qwen3.8-Next streaming - 150tps prefill, 3.6 tps decode on M5 Air

RCreddit.com
查看原文
AI 摘要

A developer successfully adapted their DSv4 streaming stack to run Qwen3.8-Next on a 32GB M5 Air, achieving faster performance than a dense 27b model. Using a 3-bit version of the MoE, Qwen3.8-Flash-Next-MLX-oQ3-MTP, it reached 150 tps prefill and 3.6 tps decode for a 2k token prompt in low power mode. This compares favorably to the 27b-4bit model's 70 tps prefill and 3 tps decode.