Back
RCreddit.com
20
·18 hr ago·RSS
Not on the current live radar

Warning: llama.cpp --lazy-mode default changed to auto - large tables may stay on disk

View original
LlamaQwen

Heat trend

Collecting trend data

The percentage is based on available heat signal, not comment count or independent people.

AI summary

The default behavior of llama.cpp's --lazy-mode has changed to "auto" with b10726. This means large tables, such as the 51B-parameter PLE n-gram embedding table of Qwen 3.8 Flash Next, may now remain on disk and be memory-mapped, rather than loaded into RAM. This change can lead to significant performance penalties, including a 50% pp speed penalty and a 15% token generation speed penalty. Users with sufficient RAM are advised to use the flag --lazy-mode off to avoid these performance issues.