Skip to content
RCreddit.com·
Not on the current live radar

I re-trained the DFlash 2 drafter for Ternary Bonsai 2 27B: 2.2x on an L4 (3.2x on code edits with ngram lookup), 1.5x on a Mac, 1.2x in Chrome

AI summary

The DFlash 2 drafter, originally trained on bf16 Qwen3.8-27B, was re-trained for PrismML's Ternary Bonsai 2 27B model using 1.5M tokens of Bonsai 2's greedy output. This fine-tuning resulted in significant performance improvements: 2.2x faster on an L4, 3.2x faster for code edits with ngram lookup, 1.5x faster on a Mac, and 1.2x faster in Chrome. The Ternary Bonsai 2 27B model fits on a 24 GB card or Mac, with decoding speeds of ~30 tok/s on an L4 and ~21 tok/s on an M4 Pro.

Time & source

Times shown in UTC

Display time zone: UTC

Local time zone unavailable; showing UTC.

IngestedOffset at this time: UTC+0Oct 7, 2026, 20:00 UTC

Ingested
Oct 7, 2026, 20:00
Source type
Dev community

Full text isn't available here.

Read at source →
Source·reddit.com