10%+ performance improvement on MoE ssd-streaming with expert-lookahead

An expert lookahead trick has yielded a 10%+ performance improvement for Mixture-of-Experts (MoE) models, specifically Qwen 3.8 flash, when running on low-memory Macs. This enhancement is achieved while utilizing expert-offloading/ssd-streaming via slotstream, building upon existing optimizations. Further details and implementation specifics for expert-lookahead are available on GitHub.

This report details a 10%+ performance gain on MoE models on low-memory Macs, unlike general optimizations that often focus on high-end hardware.