AI
Basalt 0.4.0: More models, still as fast - Qwen 27B up to 770 tok/s on a 5090
Publication: top scoring links : multi
Author: /u/jesdga95
Source published: 15/11/2026, 17:30:31 UTC
Briefing created: 15/11/2026, 23:55:26 UTC
Based on a feed excerpt; full article content has not been acquired. Source evidence retrieved 15/11/2026, 23:47:27 UTC.
Briefings
Basalt 0.4.0 released November 15, 2026, adding dense model Qwen 3.8 27B NVFP4 with 92.8% top-1 accuracy. Performance reached 776 tok/s on structured output, 262 on conversation, and 194 on prose using a 5090 GPU. The update includes multi-model and router support for DeepSeek V4.1 Flash, video support, and file handling, marking the first dense model release for the project.
Key points
- Basalt 0.4.0 introduced the first dense model, Qwen 3.8 27B NVFP4, achieving 92.8% top-1 accuracy on benchmarks.
- Structured output performance reached 776 tokens per second on a 5090 GPU, significantly outperforming the full BF16 model.
Context
This update follows multi-model and router support implementation starting with DeepSeek V4.1 Flash, alongside new video and file chat features. The project aims to prepare for Qwen 4 by establishing a baseline on dense kernels, with performance metrics tracking against the full BF16 model.
Limitations
Performance figures are snapshot-based and limited to the 5090 GPU; actual throughput may vary with context length. Benchmark data is unverified and lacks full context for all model types. No additional background on the project's history or community impact is provided.
Generated by Bittrees-hosted qwen35-2b sha256:aaf42c8b7c3c on 15/11/2026, 23:55:26 UTC. Based on publisher-provided feed evidence; may not cover the full original article. Check the source for details.
View archived briefing on IPFS
bafybeiagepux2yzxdic667gpzia2knp76bs6vx5yzyflifcrd5ydj6qddm