k_llama.cpp MoE Optimizations: Expert Residency, Hybrid CPU/GPU Execution, Q2_0 Support

A developer has released a fork of k_llama.cpp with MoE optimizations, including expert residency, hybrid CPU/GPU execution, and Q2_0 support. The fork, available on GitHub, aims to improve performance, especially on systems with limited VRAM. The developer is seeking feedback to potentially merge these optimizations upstream, highlighting features like --moe-resident auto and --moe-resident-mib for managing expert residency.