Skip to content
RCreddit.com·
Not on the current live radar

Qwen3.8 flash next + exllamav3 + hermes is amazing

AI summary

A user reports that the Qwen3.8 flash next model, combined with exllamav3 and the Hermes agent, delivers impressive performance. Running Qwen3.8fn 6bpw exl3 (from turboderp) on a 6x3090 setup yields 80-120 tokens per second with good quality. The user highlights the engine's efficiency for CUDA, suggesting that lower quantizations on fewer GPUs might achieve similar results.

Time & source

Times shown in UTC

Display time zone: UTC

Local time zone unavailable; showing UTC.

IngestedOffset at this time: UTC+0Sep 27, 2026, 10:00 UTC

Ingested
Sep 27, 2026, 10:00
Source type
Dev community

Full text isn't available here.

Read at source →
Source·reddit.com