Aleph Alpha releases Kolibri, a sovereign open-weight model from Germany

Heidelberg's Aleph Alpha has released Kolibri-1, an English and German model, and published the full weights on Hugging Face under the Apache 2.0 licence. It was released on German Unity Day.

The numbers

• 78.1 billion parameters in total, but only about 3.46 billion active for any one token (a mixture-of-experts design)
• trained on about 24 trillion tokens across 768 B200 GPUs, with German about a fifth of the pre-training mix
• context trained to 262,144 tokens, with serving set-ups up to 1 million
• built and trained in Germany and Finland

Aleph Alpha reports scores of about 96% on AIME, 84.3% on GPQA Diamond and 85.9% on LiveCodeBench. These are the company's own figures. No independent lab has checked them yet.

Why it matters

Kolibri is pitched at public administration, industry and aerospace: organisations that can't send their data to anyone else's cloud. Because the weights are open, it can run on machines the customer controls, in their own building, without asking anyone's permission. That's the point of it. Hold the benchmark numbers lightly until someone else reruns them.