Someone apparently managed to kind of replicate what V4.1 flash does on KV for fast prefill on Qwen

A developer has reportedly replicated the V4.1 flash functionality on KV for fast prefill on Qwen, as detailed in a blog post, a HuggingFace repository (kishida/Q3-8B-KVA-Projector), and a GitHub project (kishida/webdemos). This innovation is demonstrated on a web demo page, prompting speculation about its potential application to 27B models. The community is actively discussing this development.

This report details a novel replication of V4.1 flash functionality for fast prefill on Qwen, unlike previous methods, with a live demo and source code available.