1M context with 17 GB model in 24 GB VRAM: "for the first time I was able to load a context of almost 1M tokens and extract 7 needles from various parts of the text"

Model release

Heat trend

Collecting trend data

The percentage is based on available heat signal, not comment count or independent people.