ds4 manual cache safe-bytes cap (7/8 of recommended working set minus context)
Parent: Mac local LLMs: Clusters, RDMA, exo and ds4 · Published reference · snapshot 2026-10-05
↓ Facts as markdownall context files
Already covered: ds4-streaming-expert-cache-sizing-under-tp.md (ds4_streaming_manual_cache_safe_bytes: 7/8 of recommended working set minus context and graph memory, whole GiB, 1 GiB floor, per-rank, not exchanged). No new claim found.
These notes link each claim to its source. A source may be a research report hosted on this site rather than the primary document. A published reference means the content is available; it does not certify independent review or accuracy.Read the editorial policy and follow the sources before relying on a claim.
Facts
- Already covered: ds4-streaming-expert-cache-sizing-under-tp.md (ds4_streaming_manual_cache_safe_bytes: 7/8 of recommended working set minus context and graph memory, whole GiB, 1 GiB floor, per-rank, not exchanged). No new claim found. [source]
Children
- No children recorded.