AI
Joined the 4x R9700 Club | Initial Benchmarks for QFN 3.8 Below
Publication: top scoring links : multi
Author: /u/Anarchaotic
Source published: 08/11/2026, 23:36:45 UTC
Briefing created: 22/11/2026, 11:57:10 UTC
Based on a feed excerpt; full article content has not been acquired. Source evidence retrieved 09/11/2026, 13:47:25 UTC.
Briefings
A user built a 4x R9700 server with an EPYC 7402P and 128GB RAM to test Qwen3.8-Flash-Next long-context concurrency. Benchmarks show prefill at ~6,800 tok/s total, while follow-ups at 8 concurrent users write 80-225 tok/s per user. Cold prompts take 2.5 minutes to complete, but cached follow-ups finish in 0.2-2.5 seconds. The setup uses 17.4 GiB of model weights and 47.7 GiB of n-gram tables per card.
Key points
- Prefill runs at approximately 6,800 tokens per second total regardless of the number of concurrent users.
- With 8 users each sending 128K prompts, the system completes the entire conversation in about 2.5 minutes.
Context
This benchmark was conducted on an R9700 server with an EPYC 7402P CPU and 128GB DDR4 RAM running Ubuntu 26.04.1 with ROCm 10.1. The setup was built in late 2026 to test Qwen3.8-Flash-Next long-context concurrency, specifically evaluating how well the model handles multi-user interactions with 128K context windows.
Limitations
Data is limited to a single user's initial build and testing phase; no long-term stability or production reliability data is provided. Results are specific to the 4x R9700 configuration and may not generalize to other hardware or scaling scenarios.
Generated by Bittrees-hosted qwen35-2b sha256:aaf42c8b7c3c on 22/11/2026, 11:57:10 UTC. Based on publisher-provided feed evidence; may not cover the full original article. Check the source for details.
View archived briefing on IPFS
bafybeig2gbucc47qxxgfbmucf3lpxyfgc6rngw6adqwx3nvm7ksaelbism