AI
I made my iPhone a second GPU for my 24 GB MacBook: Qwen 3.8 27B prefills 29–44% faster & my holds part of the CTX window.
Publication: top scoring links : multi
Author: /u/StayLameBro
Source published: 02/10/2026, 16:59:22 UTC
Briefing created: 03/10/2026, 01:35:26 UTC
Based on a feed excerpt; full article content has not been acquired. Source evidence retrieved 02/10/2026, 20:47:25 UTC.
Briefings
A user built a second GPU on an iPhone 17 Pro Max to accelerate LLaMA 2.7B inference on a 24 GB M4 Pro MacBook. The setup leverages the iPhone's A19 Pro GPU for prefilling and attention operations on older context layers, while the Mac handles newer layers. Benchmarks show a 35% to 44% speedup in prefilling up to 32k tokens, with the phone taking over writing tasks after 64k tokens. The system runs at 29–44% faster than the Mac alone, but writing speed below 64k tokens remains limited to the Mac's capabilities.
Key points
- The iPhone 17 Pro Max's A19 Pro GPU achieves 2.4x faster matrix operations compared to the same device without the GPU, enabling significant prefill acceleration.
- At 32k context, the combined system processes tokens at 130 tok/s versus 101 tok/s for the Mac alone, representing a 29% speedup in prefilling tasks.
Context and limitations
Speedup is measured only for prefilling layers held by the phone; actual end-to-end writing speed remains limited to the Mac's capabilities below 64k tokens. Performance degrades as context grows beyond 64k, and the system does not yet support writing tasks for the phone's GPU.
Generated by Bittrees-hosted qwen35-2b sha256:aaf42c8b7c3c on 03/10/2026, 01:35:26 UTC. Based on publisher-provided feed evidence; may not cover the full original article. Check the source for details.
View archived briefing on IPFS
bafybeih6c52jppocx5o4fz2zrl62ruxc4ztwimli5xj4zoq7wf5vgqp6mq