Skip to content
RCreddit.com·
Not on the current live radar

Fork of FreeToken with DeepSeek-V4.1, vision and speculative decoding (2x3090 numbers inside)

AI summary

A developer has forked FreeToken, integrating DeepSeek-V4.1, vision capabilities, and speculative decoding, running on a 2x3090 setup. The fork aims to improve performance, with initial tests showing that while CUDA graphs on the plain path are a net loss, a per-batch-size verify graph boosted the MTP path from 16 to 28 tok/s in isolated runs. The developer acknowledges it's a work in progress and seeks feedback on models and quant formats.

Time & source

Times shown in UTC

Display time zone: UTC

Local time zone unavailable; showing UTC.

IngestedOffset at this time: UTC+0Sep 23, 2026, 02:01 UTC

Ingested
Sep 23, 2026, 02:01
Source type
Dev community

Full text isn't available here.

Read at source →
Source·reddit.com