RCreddit.com
20
·18 hr ago·RSS
Not on the current live radar
Warning: llama.cpp --lazy-mode default changed to auto - large tables may stay on disk
Heat trend
Collecting trend data
The percentage is based on available heat signal, not comment count or independent people.
The default behavior of llama.cpp's --lazy-mode has changed to "auto" with b10726. This means large tables, such as the 51B-parameter PLE n-gram embedding table of Qwen 3.8 Flash Next, may now remain on disk and be memory-mapped, rather than loaded into RAM. This change can lead to significant performance penalties, including a 50% pp speed penalty and a 15% token generation speed penalty. Users with sufficient RAM are advised to use the flag --lazy-mode off to avoid these performance issues.