AI
Qwen3.5 arch implementation in FPGA fabric for 9B/27B INT4 models on relatively cheap eBay mining hardware
Publication: top scoring links : multi
Author: /u/I_am_purrfect
Source published: 04/10/2026, 16:51:07 UTC
Briefing created: 04/10/2026, 23:38:52 UTC
Based on a feed excerpt; full article content has not been acquired. Source evidence retrieved 04/10/2026, 19:47:26 UTC.
Briefings
The author tested Qwen3.5-9B and Qwen3.8-27B on FPGA hardware using SQRL and Jungle Cat mining boards. Initial 9B runs on 2x FK33 FPGAs achieved ~6 tok/s prefill and ~3 tok/s generation at 75 MHz. Scaling to 4x VU35P with 4-way tensor parallelism at 200 MHz reached ~25 tok/s prefill and ~25 tok/s generation at short context, with 27B models requiring four dies to fit KV cache. The project focused on weight loading optimization and benchmarking inference performance on relatively cheap mining hardware.
Key points
- Qwen3.5-9B INT4 achieved ~6 tok/s prefill and ~3 tok/s generation on 4x VU35P FPGAs at 200 MHz with 4-way tensor parallelism.
- Qwen3.8-27B INT4 requires four FPGA dies to fit KV cache at 262k context length, limiting inference to ~10 tok/s at short context.
Context and limitations
Performance data is from a preprint; no live inference runs on the 27B model were completed. Clock speeds are fixed at 75 MHz and 200 MHz, and RTL resizing was tested without full optimization.
Generated by Bittrees-hosted qwen35-2b sha256:aaf42c8b7c3c on 04/10/2026, 23:38:52 UTC. Based on publisher-provided feed evidence; may not cover the full original article. Check the source for details.
View archived briefing on IPFS
bafybeid2xxhuahgmn3kjk74zuvpridjml6qlgzqa7p3msdmsluni6eiuai