跳到正文
RCreddit.com·
暂不在当前实时榜单

Qwen3.8-Flash-Next (5.05bpw + ngram at bf16) exl3 on one r9700: 863 t/s prefill and 35 t/s decode at 230k context (256k max), is that ok or am i missing something?

AI 摘要

A user is seeking validation for their Qwen3.8-Flash-Next model setup on a single r9700, using the turboderp exl3 5.05 bpw version. They report 863 t/s prefill and 35 t/s decode at 230k context, with a 256k max. The user is unsure if these performance metrics are optimal or if further tuning is possible for their specific hardware configuration.

时间与来源

时间显示为 UTC

显示时区:UTC

本地时区尚不可用,暂时显示 UTC。

收录当时偏移:UTC+02026年10月2日 17:00 UTC

收录
2026年10月2日 17:00
来源类型
开发者社区

本站未收录正文。

前往源站阅读 →
来源·reddit.com