[2506.13771] LittleBit: Ultra Low-Bit Quantization via Latent Factorization

Research into quantization aware training (QAT) is showing improvements, leading to the development of very small models. An example of this is the paper "[2506.13771] LittleBit: Ultra Low-Bit Quantization via Latent Factorization," which explores ultra low-bit quantization methods. This work highlights advancements in creating highly efficient and compact models through innovative quantization techniques.