AI
Qwen3.8-27B: 159 tok/s on R9700, 64 tok/s on Strix Halo
Publication: top scoring links : multi
Author: /u/TheOriginalG2
Source published: 09/10/2026, 01:20:39 UTC
Briefing created: 20/11/2026, 01:53:05 UTC
Based on a feed excerpt; full article content has not been acquired. Source evidence retrieved 09/10/2026, 20:47:26 UTC.
Briefings
LemonSeed Studio enables on-device inference for Qwen3.8-27B on an AMD R9700 GPU, achieving 31.2 tok/s on iPadOS and 14.0 tok/s on a Strix Halo. The system uses the Linux amdgpu driver to run the LSE engine, which optimizes kernels by measuring multiple layouts and selecting the fastest. Prefill speed reached 1,636 tokens at 4K context, with new features including DFlash2 draft trees and fixed GPU faults.
Key points
- LemonSeed Studio runs Qwen3.8-27B on an AMD R9700 GPU with 131k context window, achieving 31.2 tokens per second on iPadOS.
- The LSE engine optimizes GPU kernels by measuring multiple layouts and selecting the fastest execution path for each operation.
Context
This article details on-device inference capabilities using the Linux amdgpu driver and LSE engine on various platforms, including iPadOS, macOS, and Linux, with specific performance metrics on AMD GPUs.
Limitations
Performance data is limited to specific hardware configurations and platform versions; no broader scalability or real-world usage scenarios are provided.
Generated by Bittrees-hosted qwen35-2b sha256:aaf42c8b7c3c on 20/11/2026, 01:53:05 UTC. Based on publisher-provided feed evidence; may not cover the full original article. Check the source for details.
View archived briefing on IPFS
bafybeiblic32rnlajn2cz5vmqzmos6potr75bvzxkemnhyq2lwftn6dy5e