跳到正文
RCreddit.com·
暂不在当前实时榜单

I re-trained the DFlash 2 drafter for Ternary Bonsai 2 27B: 2.2x on an L4 (3.2x on code edits with ngram lookup), 1.5x on a Mac, 1.2x in Chrome

AI 摘要

The DFlash 2 drafter, originally trained on bf16 Qwen3.8-27B, was re-trained for PrismML's Ternary Bonsai 2 27B model using 1.5M tokens of Bonsai 2's greedy output. This fine-tuning resulted in significant performance improvements: 2.2x faster on an L4, 3.2x faster for code edits with ngram lookup, 1.5x faster on a Mac, and 1.2x faster in Chrome. The Ternary Bonsai 2 27B model fits on a 24 GB card or Mac, with decoding speeds of ~30 tok/s on an L4 and ~21 tok/s on an M4 Pro.

时间与来源

时间显示为 UTC

显示时区:UTC

本地时区尚不可用,暂时显示 UTC。

收录当时偏移:UTC+02026年10月7日 20:00 UTC

收录
2026年10月7日 20:00
来源类型
开发者社区

本站未收录正文。

前往源站阅读 →
来源·reddit.com