AI
OVH announced the launch of the Olala mini 7A1B.
Publication: top scoring links : multi
Author: /u/clem844
Source published: 17/11/2026, 10:14:35 UTC
Briefing created: 17/11/2026, 16:15:19 UTC
Based on a feed excerpt; full article content has not been acquired. Source evidence retrieved 17/11/2026, 14:47:26 UTC.
Briefings
Olala mini 7A1B is an open-source LLM variant based on a 7-billion parameter architecture, featuring hybrid attention combining Differential-TPA and Mamba-3 in BF16 format. It achieves 160 tokens per second on an RTX A4500 GPU and 50 tokens per second on a standard processor, with a context window of 32,000 tokens. The model runs on minimal 8 GB of memory and is available on Hugging Face under the Apache 2.0 license.
Key points
- Olala mini 7A1B utilizes a 7-billion parameter architecture with 1 billion active parameters distributed across 256 experts per layer.
- The model achieves 160 tokens per second on an RTX A4500 GPU and 50 tokens per second on a standard processor using hybrid attention combining Differential-TPA and Mamba-3 in BF16 format.
Context
Olala mini 7A1B is an open-source Large Language Model variant available on Hugging Face under the Apache 2.0 license, utilizing hybrid attention mechanisms to optimize performance and memory efficiency.
Limitations
Evidence covers only the technical specifications and performance metrics; availability, training data, and specific use cases remain unverified.
Generated by Bittrees-hosted qwen35-2b sha256:aaf42c8b7c3c on 17/11/2026, 16:15:19 UTC. Based on publisher-provided feed evidence; may not cover the full original article. Check the source for details.
View archived briefing on IPFS
bafybeiebjlegtxfldzja64hmjfplaqfucc3cf5ntuxm6baxdt6var3gkhq