Skip to content
RCreddit.com·
Not on the current live radar

Dynamic Quantiser - a way to make your own high quality dynamic quants

AI summary

The Dynamic Quantiser is a tool for creating high-quality dynamic quantizations. It precomputes dot products, squared norms, and byte counts for each tensor and quant level. The objective is to minimize whole-model cosine deviation, calculated as 1 - S / sqrt(AQ), subject to a file-size budget. This optimization uses Dinkelbach's algorithm, a separable Lagrangian inner loop, and a multi-start local search with single-tier and pair-swap moves.

Time & source

Times shown in UTC

Display time zone: UTC

Local time zone unavailable; showing UTC.

IngestedOffset at this time: UTC+0Sep 23, 2026, 02:01 UTC

Ingested
Sep 23, 2026, 02:01
Source type
Dev community

Full text isn't available here.

Read at source →
Source·reddit.com