Ollama KV rotation port (OLLAMA_KV_ROTATE)
Parent: Mac local LLMs: Ollama internals · Published reference · snapshot 2026-10-05
↓ Facts as markdownall context files
Ollama main's `envconfig/config.go` defines `OLLAMA_KV_CACHE_TYPE` ("Quantization type for the K/V cache (default: f16)") and `OLLAMA_FLASH_ATTENTION` among its KV-related variables and no variable named `OLLAMA_KV_ROTATE`.
These notes link each claim to its source. A source may be a research report hosted on this site rather than the primary document. A published reference means the content is available; it does not certify independent review or accuracy.Read the editorial policy and follow the sources before relying on a claim.
Facts
- Ollama main's `envconfig/config.go` defines `OLLAMA_KV_CACHE_TYPE` ("Quantization type for the K/V cache (default: f16)") and `OLLAMA_FLASH_ATTENTION` among its KV-related variables and no variable named `OLLAMA_KV_ROTATE`. [source]
- A GitHub issue search for `OLLAMA_KV_ROTATE` in ollama/ollama returned 0 results on 2026-10-04. [source]
- A GitHub pull request search for `KV_ROTATE` in ollama/ollama returned 0 results (0 open, 0 closed) on 2026-10-04. [source]
- Ollama's launcher passes the configured KV cache type to llama-server as `--cache-type-k` and `--cache-type-v` with the same value, and flash attention as `on`, `off` or `auto`. [source]
- The Ollama FAQ in the cache documents `OLLAMA_KV_CACHE_TYPE` with default `f16` and does not mention rotation. [source]
- Inferred: because the K/V type reaches upstream llama-server unchanged, any quantised-KV rotation that llama-server applies by default is inherited by Ollama on main with no Ollama setting involved. [source]
- Inferred: llama.cpp's `LLAMA_ATTN_ROT_DISABLE` opt-out (held in the existing dossier) is the matching control, and it reaches llama-server only if set in the environment Ollama passes to the subprocess. [source]
- Inferred: the `OLLAMA_KV_ROTATE` port is a dead branch artifact for Ollama main and should not be recommended to users. [source]
Children
- No children recorded.