Skip to content
RCreddit.com·
Not on the current live radar

One more 'you should try ExllamaV3/exl3 for flash next' appreciation post

AI summary

A user shared their positive experience with ExllamaV3/exl3 3bpw for running "flash next," noting impressive results. On a setup with 3x3090s and 128GB DDR4, they achieved 1500 prefill and 80 tps decode. A single 5090 with 128G DDR4 yielded 1500 prefill and 29 tps decode. Both configurations operated at 262k context with vision/spec decoding, leading the user to replace vllm/llama.cpp with ExllamaV3 for this model. They also plan to test the 4bpw version.

Time & source

Times shown in UTC

Display time zone: UTC

Local time zone unavailable; showing UTC.

IngestedOffset at this time: UTC+0Sep 21, 2026, 03:01 UTC

Ingested
Sep 21, 2026, 03:01
Source type
Dev community

Full text isn't available here.

Read at source →
Source·reddit.com