Aleph-Alpha/Kolibri-1 · Hugging Face - 78B parameters. 3.46B active. Up to 1M tokens of context - Apache 2.0

Aleph-Alpha has released Kolibri-1, a new model available on Hugging Face. This model features 78 billion parameters, with 3.46 billion active parameters, and supports up to 1 million tokens of context. Kolibri-1 is released under the Apache 2.0 license. Further details are available in their tech report.

Kolibri-1 is the first model to combine a 78B parameter count with 3.46B active parameters and a 1M token context window under an Apache 2.0 license.