Skip to content
RCreddit.com·
Archived topic · source no longer tracked

Ran Qwen3.8-Flash-Next (79 GB, 2-bit) at 350K ctx for 3.5 hours on a 128 GB M5 Max — speed vs context depth, 100 turns, one graph

AI summary

A user successfully ran Qwen3.8-Flash-Next (79 GB, 2-bit) with a 350K context for 3.5 hours on a 128 GB M5 Max MacBook Pro. The setup utilized llama.cpp b10686 with Metal and a 358,400-token context slot via YaRN. Performance was strong for the first 100K context, but beyond that, the model exhibited role confusion, mixing user messages with its own output. Suspects for this degradation include the 2-bit quantization or the preview model's long-context quality.

Time & source

Times shown in UTC

Display time zone: UTC

Local time zone unavailable; showing UTC.

IngestedOffset at this time: UTC+0Aug 30, 2026, 07:00 UTC

Ingested
Aug 30, 2026, 07:00
Source type
Unclassified

Full text isn't available here.

Read at source →
Source·reddit.com