跳到正文
RCreddit.com·
暂不在当前实时榜单

Dynamic Quantiser - a way to make your own high quality dynamic quants

AI 摘要

The Dynamic Quantiser is a tool for creating high-quality dynamic quantizations. It precomputes dot products, squared norms, and byte counts for each tensor and quant level. The objective is to minimize whole-model cosine deviation, calculated as 1 - S / sqrt(AQ), subject to a file-size budget. This optimization uses Dinkelbach's algorithm, a separable Lagrangian inner loop, and a multi-start local search with single-tier and pair-swap moves.

时间与来源

时间显示为 UTC

显示时区:UTC

本地时区尚不可用,暂时显示 UTC。

收录当时偏移:UTC+02026年9月23日 02:01 UTC

收录
2026年9月23日 02:01
来源类型
开发者社区

本站未收录正文。

前往源站阅读 →
来源·reddit.com