跳到正文
RCreddit.com·
暂不在当前实时榜单

Fork of FreeToken with DeepSeek-V4.1, vision and speculative decoding (2x3090 numbers inside)

AI 摘要

A developer has forked FreeToken, integrating DeepSeek-V4.1, vision capabilities, and speculative decoding, running on a 2x3090 setup. The fork aims to improve performance, with initial tests showing that while CUDA graphs on the plain path are a net loss, a per-batch-size verify graph boosted the MTP path from 16 to 28 tok/s in isolated runs. The developer acknowledges it's a work in progress and seeks feedback on models and quant formats.

时间与来源

时间显示为 UTC

显示时区:UTC

本地时区尚不可用,暂时显示 UTC。

收录当时偏移:UTC+02026年9月23日 02:01 UTC

收录
2026年9月23日 02:01
来源类型
开发者社区

本站未收录正文。

前往源站阅读 →
来源·reddit.com