AI

Sorry Sam, my "quite terrible" home DRAM is at 100% now: patched Strata to make DeepSeek V4.1 agent sessions start 20× faster on a good old standard gaming GPU, no datacenter required

Read full article at source ↗

Based on a feed excerpt; full article content has not been acquired. Source evidence retrieved 02/11/2026, 10:47:26 UTC.

Briefings

Sam Altman reported that global DRAM allocation is inefficient, prompting a user to patch Strata to optimize DeepSeek V4.1 agent sessions on a standard gaming GPU. By implementing KV splicing and resident-only routing, the user reduced prompt reading time from ~100 seconds to near-instantaneous speeds, utilizing VRAM and RAM for expert routing while keeping the SSD for generation. The fix was tested on a HIP GPU with OpenCode enabled, showing significant improvements in session start times without requiring datacenter infrastructure. The implementation includes specific configuration flags and a workaround for GPU page faults, though formal evaluation remains pending. The findings were shared on r/LocalLLaMA by user u/HearMeOut-13, with the code available on GitHub.

Key points

• The user Sam Altman reported that global DRAM allocation is inefficient, with experts sitting in their own computers being used only 5% of the time. A patched Strata implementation allows DeepSeek V4.1 agent sessions to start 20x faster on a standard gaming GPU by utilizing VRAM and RAM for prompt reading instead of streaming from the SSD.
• The patch involves two main changes: KV splicing to stop re-reading saved conversation history and resident-only routing to make RAM earn its keep by routing prompt reads to experts already sitting in VRAM or RAM, reducing the need to stream tokens from the SSD.

Context

This finding addresses a critical bottleneck in local LLM agent deployment, where inefficient global DRAM allocation forces users to rely on expensive datacenter-grade infrastructure for even basic tasks. The user's setup demonstrates a viable alternative using consumer-grade hardware, proving that optimizing local memory usage can drastically reduce latency without requiring datacenter access.

Limitations

Evidence is limited to a single user's experimental setup on a HIP GPU with OpenCode enabled; no formal evaluation or cross-platform testing is provided. The patch is approximate, and performance improvements may vary significantly on other hardware, particularly CUDA systems. The user did not build or test CUDA, SYCL, or Metal, and the fix includes a workaround for a specific GPU page fault issue.

Generated by Bittrees-hosted qwen35-2b sha256:aaf42c8b7c3c on 02/11/2026, 11:37:54 UTC. Based on publisher-provided feed evidence; may not cover the full original article. Check the source for details.

View archived briefing on IPFS
bafybeid7rm7kvwu6z7vgcegfnav7jxlcuzrto4duslfasl6ssg373jdsxm