# LLMS-Explorer — facts

> Source-anchored units extracted from the docs: 1769 across 111 pages. Each line ends in the page URL and anchor it came from.

<!-- generated 2026-10-13 by site/tools/build_llms.py from the .md twin of every page in this site's build output -->

## The API: what it is, and how to call it
<https://llms-explorer.com/reference/api/>

- [parameter] `read`: Queries within your quota; read your own artifacts — https://llms-explorer.com/reference/api/#three-ways-in
- [parameter] `run`: Create metered jobs — lint model passes, indexing, concept packs — https://llms-explorer.com/reference/api/#three-ways-in
- [parameter] `publish`: Contribute to the shared catalogue — https://llms-explorer.com/reference/api/#three-ways-in
- [definition] The API: what it is, and how to call it — LLMS-Explorer as a service, not a website: what a key buys you, the REST surface, the hosted MCP gateway, the llmsx CLI, and where the free tier ends. — https://llms-explorer.com/reference/api/#the-api-what-it-is-and-how-to-call-it
- [definition] What you're actually buying — LLMS-Explorer is the concept-family-tree explorer with the hub's llms tooling hung off its nodes: lint or optimize an llms file, turn notes into one, abstract a concept out of a corpus, deepen it with a research wave, map its family. — https://llms-explorer.com/reference/api/#what-youre-actually-buying
- [definition] The free tier's semantic search — The free tier's semantic and hybrid search is a fixed 16-document demo, rate-limited and not billed — it's there to show what the retrieval looks like, not to serve your own corpus. Indexing your own docset, and querying it, both need a paid plan. — https://llms-explorer.com/reference/api/#the-free-tiers-semantic-search
- [definition] What's deterministic and free even with a key — Not every tool call spends a token. Lint's deterministic passes — the ones that don't run a model — are free and unlimited-frequency-within-quota on every plan; only the *model* passes (P4/P8/P12) are metered. — https://llms-explorer.com/reference/api/#whats-deterministic-and-free-even-with-a-key

## The attribute rubric
<https://llms-explorer.com/reference/attributes/>

- [parameter] I1: Attribute=Exactly one H1 naming the site/product (not a page); Applies=index, facts, family; Measure=deterministic; Bar=1 H1; title = product/site; Miss=High — https://llms-explorer.com/reference/attributes/#1-identity-and-shape
- [parameter] I2: Attribute=Blockquote summary immediately after H1, 1–3 sentences, self-contained; Applies=index, family; Measure=deterministic + judgment; Bar=present; says what the thing is and who it is for; Miss=Medium — https://llms-explorer.com/reference/attributes/#1-identity-and-shape
- [parameter] I3: Attribute=Free-form info before the first H2 (how to read this file, versions, languages); Applies=index, family; Measure=judgment; Bar=only if it changes how a reader should use the links; Miss=Low — https://llms-explorer.com/reference/attributes/#1-identity-and-shape
- [parameter] I4: Attribute=Sections are H2 only; each is a link list; no prose after the first H2 except list notes; Applies=index, family; Measure=deterministic; Bar=no H3+, no stray paragraphs; Miss=Medium — https://llms-explorer.com/reference/attributes/#1-identity-and-shape
- [parameter] I5: Attribute=Link entries match `- [name](url)` + optional `: notes`; Applies=index, family; Measure=deterministic; Bar=100% of list items; Miss=High if <90%, else Medium — https://llms-explorer.com/reference/attributes/#1-identity-and-shape
- [parameter] I6: Attribute=Kind is unambiguous from the first 20 lines (index vs full vs facts) — a full file is never served as an index; Applies=all; Measure=deterministic; Bar=grammar detected with one candidate; Miss=High — https://llms-explorer.com/reference/attributes/#1-identity-and-shape
- [parameter] N1: Attribute=Two hops: index → page (or family → index → page); no index links a bare directory of more indexes; Applies=index, family; Measure=deterministic (link targets); Bar=≤2 hops to any page; Miss=High — https://llms-explorer.com/reference/attributes/#2-navigation
- [parameter] N2: Attribute=Section design mirrors how users ask (task/topic groups), not the URL tree or an alphabet; Applies=index; Measure=judgment; Bar=≥80% of sections are task/topic named; Miss=Medium — https://llms-explorer.com/reference/attributes/#2-navigation
- [parameter] N3: Attribute=Ordering by expected query frequency: quickstart/auth/reference/errors first; the first 20% of links should answer 80% of questions; Applies=index; Measure=judgment + agent test; Bar=hot pages in the first section; Miss=Medium — https://llms-explorer.com/reference/attributes/#2-navigation
- [parameter] N4: Attribute=`## Optional` holds only skippable material (changelog, legal, old posts, appendices); it is the last section; Applies=index; Measure=deterministic + judgment; Bar=last; no reference/pricing inside; Miss=Medium — https://llms-explorer.com/reference/attributes/#2-navigation
- [parameter] N5: Attribute=Every page the source publishes that a reader would need is reachable (coverage); Applies=index; Measure=deterministic vs source page list; Bar=≥95% of `reference`+`guide` pages linked; Miss=High if <80% — https://llms-explorer.com/reference/attributes/#2-navigation
- [parameter] N6: Attribute=No dead ends: each link resolves (200, markdown or `.md` twin), no redirect to an HTML app shell; Applies=index, family; Measure=deterministic (`--check-links`); Bar=0 dead links; Miss=High — https://llms-explorer.com/reference/attributes/#2-navigation
- [parameter] N7: Attribute=Cross-cutting material (errors, auth, glossary) linked once, not once per section; Applies=index, family; Measure=judgment; Bar=no duplicate targets; Miss=Low — https://llms-explorer.com/reference/attributes/#2-navigation
- [parameter] D1: Attribute=Every link carries a description; Applies=index, family; Measure=deterministic; Bar=100%; Miss=Medium (High if <60%) — https://llms-explorer.com/reference/attributes/#3-descriptions
- [parameter] D2: Attribute=Description says what the reader FINDS there, with the exact tokens (flags, env vars, error strings) — not a restated title; Applies=index; Measure=judgment; Bar="Authentication docs." fails; "API key creation, OAuth scopes, token rotation. Required before any call." passes; Miss=Medium — https://llms-explorer.com/reference/attributes/#3-descriptions
- [parameter] D3: Attribute=Length 10–25 words; no trailing ellipsis from truncation; Applies=index; Measure=deterministic; Bar=95% within band; Miss=Low — https://llms-explorer.com/reference/attributes/#3-descriptions
- [parameter] D4: Attribute=No duplicate descriptions across links; Applies=index; Measure=deterministic; Bar=0 duplicates; Miss=Medium — https://llms-explorer.com/reference/attributes/#3-descriptions
- [parameter] D5: Attribute=Descriptions are extractive or verified — model-written ones audited against the page; Applies=index; Measure=judgment (sampled); Bar=sample of 10: 0 hallucinated claims; Miss=High — https://llms-explorer.com/reference/attributes/#3-descriptions
- [parameter] D6: Attribute=Family lines carry counts (pages, ~tokens) so a consumer can budget; Applies=family; Measure=deterministic; Bar=100% of product links; Miss=Medium — https://llms-explorer.com/reference/attributes/#3-descriptions
- [parameter] C1: Attribute=One declared page grammar, stated in a header comment; every page block parses; Applies=full; Measure=deterministic (`split_llms_full`); Bar=blocks parsed = blocks present; Miss=High — https://llms-explorer.com/reference/attributes/#4-content-fidelity-full-and-facts
- [parameter] C2: Attribute=Every page has a title and a resolvable source URL; Applies=full; Measure=deterministic; Bar=100%; Miss=High — https://llms-explorer.com/reference/attributes/#4-content-fidelity-full-and-facts
- [parameter] C3: Attribute=No navigation residue: "Documentation Index" blockquotes, `[Skip to content]`, MDX wrappers, `theme={null}` props; Applies=full; Measure=deterministic; Bar=0 hits; Miss=Medium — https://llms-explorer.com/reference/attributes/#4-content-fidelity-full-and-facts
- [parameter] C4: Attribute=Code fences intact and language-tagged; tables intact; Applies=full; Measure=deterministic (fence balance, table separators); Bar=balanced; ≥90% fences tagged; Miss=Medium — https://llms-explorer.com/reference/attributes/#4-content-fidelity-full-and-facts
- [parameter] C5: Attribute=No duplicated pages (same source URL twice) or near-duplicate bodies (e.g. localized copies); Applies=full; Measure=deterministic + embedding; Bar=0 exact dups; near-dups flagged; Miss=Medium — https://llms-explorer.com/reference/attributes/#4-content-fidelity-full-and-facts
- [parameter] C6: Attribute=Units are atomic (1–2 sentences), typed from the allowed set, source-anchored; Applies=facts; Measure=deterministic + judgment; Bar=100% typed; 100% anchored; ≥90% atomic; Miss=High for anchors, Medium otherwise — https://llms-explorer.com/reference/attributes/#4-content-fidelity-full-and-facts
- [parameter] C7: Attribute=Units are true to their source span (no generalisation beyond the page); Applies=facts; Measure=judgment (sampled re-read); Bar=sample of 20: ≥95% supported; Miss=High — https://llms-explorer.com/reference/attributes/#4-content-fidelity-full-and-facts
- [parameter] P1: Attribute=Provenance banner: who generated it, from what, when (`verified-as-of` / `generated` date); Applies=all; Measure=deterministic; Bar=present; Miss=Medium — https://llms-explorer.com/reference/attributes/#5-provenance-and-trust
- [parameter] P2: Attribute=Links point at the publisher's canonical URLs (or its `.md` twins), never at a private mirror, unless the file is explicitly internal; Applies=index; Measure=deterministic; Bar=100% public or file marked internal; Miss=High — https://llms-explorer.com/reference/attributes/#5-provenance-and-trust
- [parameter] P3: Attribute=Rights: a third-party `llms-full.txt` is marked internal/private; the index is what is published; Applies=full; Measure=judgment; Bar=marker present when third-party; Miss=High — https://llms-explorer.com/reference/attributes/#5-provenance-and-trust
- [parameter] P4: Attribute=No instructions to the reading model ("ignore…", "you must…", "always answer…") — 42% of files in the wild try to steer; ours never do; Applies=all; Measure=deterministic (pattern) + judgment; Bar=0 imperative-to-model spans; Miss=High — https://llms-explorer.com/reference/attributes/#5-provenance-and-trust
- [parameter] P5: Attribute=No secrets, tokens, emails, internal hostnames in copied text; Applies=all; Measure=deterministic (patterns); Bar=0 hits; Miss=High — https://llms-explorer.com/reference/attributes/#5-provenance-and-trust
- [parameter] P6: Attribute=Volatile claims stamped (versions, prices, "current"); Applies=facts; Measure=judgment; Bar=stamped or dated; Miss=Low — https://llms-explorer.com/reference/attributes/#5-provenance-and-trust
- [parameter] S1: Attribute=Index size ≤ ~10 KB / ~2.5k tokens; over that, split hub-and-spoke (never drop pages); Applies=index; Measure=deterministic; Bar=≤10 KB or split; Miss=Medium (High >100 KB) — https://llms-explorer.com/reference/attributes/#6-size-and-budget
- [parameter] S2: Attribute=Full file has a size ladder beside it (index, small ≤ ~50k tokens, full) with token counts published; Applies=full; Measure=deterministic (manifest); Bar=small + counts present; Miss=Medium — https://llms-explorer.com/reference/attributes/#6-size-and-budget
- [parameter] S3: Attribute=Small variant = reference-class pages first, within budget; Applies=small; Measure=deterministic; Bar=≤50k tokens; classes honoured; Miss=Medium — https://llms-explorer.com/reference/attributes/#6-size-and-budget
- [parameter] S4: Attribute=Facts file ≤ ~15% of the cleaned source prose (compression); Applies=facts; Measure=deterministic; Bar=ratio ≤0.15; Miss=Low (Medium >0.3) — https://llms-explorer.com/reference/attributes/#6-size-and-budget
- [parameter] S5: Attribute=Token estimate declared with its estimator (chars/4 etc.); Applies=manifest; Measure=deterministic; Bar=present; Miss=Low — https://llms-explorer.com/reference/attributes/#6-size-and-budget
- [parameter] S6: Attribute=No single page block > 200 KB without a note (changelogs); Applies=full; Measure=deterministic; Bar=flagged; Miss=Low — https://llms-explorer.com/reference/attributes/#6-size-and-budget
- [parameter] R1: Attribute=Keyword index exists for the facts/full text (FTS5 over units/chunks) and returns the exact-token queries (`CLAUDE_CODE_SYNC_SKILLS`, `--append-system-prompt`); Applies=facts, full; Measure=measured; Bar=10/10 exact-token probes hit; Miss=High — https://llms-explorer.com/reference/attributes/#7-retrieval-readiness
- [parameter] R2: Attribute=Vector index exists (`<key>__facts` collection) and the facts layer answers the golden questions better than raw; Applies=facts; Measure=measured (`query --layer`); Bar=golden score ≥ raw score; Miss=Medium — https://llms-explorer.com/reference/attributes/#7-retrieval-readiness
- [parameter] R3: Attribute=Anchors are stable (`#slug` of the heading) so a hit can be opened at the span; Applies=facts, full; Measure=deterministic; Bar=100% anchors resolve to a heading; Miss=Medium — https://llms-explorer.com/reference/attributes/#7-retrieval-readiness
- [parameter] R4: Attribute=Unit text carries the exact tokens in `keywords` so BM25 can find them; Applies=facts; Measure=deterministic; Bar=≥80% of units with a code/flag/env token have it in keywords; Miss=Medium — https://llms-explorer.com/reference/attributes/#7-retrieval-readiness
- [parameter] R5: Attribute=Agent test: an agent given ONLY the index answers N seeded questions by following ≤2 links; Applies=index; Measure=live agent test; Bar=≥8/10; Miss=High if <6/10 — https://llms-explorer.com/reference/attributes/#7-retrieval-readiness
- [parameter] R6: Attribute=Facts test: an agent given ONLY the facts file answers the same questions without opening pages; Applies=facts; Measure=live agent test; Bar=≥7/10; Miss=Medium — https://llms-explorer.com/reference/attributes/#7-retrieval-readiness
- [parameter] R7: Attribute=Every page in the index has ≥1 unit in the facts file (no silent gaps); Applies=index+facts; Measure=deterministic; Bar=≥95% pages covered; Miss=Medium — https://llms-explorer.com/reference/attributes/#7-retrieval-readiness
- [parameter] F1: Attribute=Family file links indexes, never pages; Applies=family; Measure=deterministic; Bar=100% targets are `llms.txt` files; Miss=High — https://llms-explorer.com/reference/attributes/#8-family-nesting
- [parameter] F2: Attribute=Each product line carries page + token counts and, where present, a facts link; Applies=family; Measure=deterministic; Bar=100%; Miss=Medium — https://llms-explorer.com/reference/attributes/#8-family-nesting
- [parameter] F3: Attribute=Shared material (errors, auth, glossary) appears once, in the family file; Applies=family; Measure=judgment; Bar=no duplication into products; Miss=Low — https://llms-explorer.com/reference/attributes/#8-family-nesting
- [parameter] F4: Attribute=The most-specific rule holds: a product's own index is authoritative for its pages; the family never restates them; Applies=family; Measure=judgment; Bar=no page links; Miss=Medium — https://llms-explorer.com/reference/attributes/#8-family-nesting
- [parameter] F5: Attribute=Family membership matches the concept tree / hub taxonomy it claims to represent; Applies=family; Measure=deterministic vs tree; Bar=100% of tree children present; Miss=Medium — https://llms-explorer.com/reference/attributes/#8-family-nesting
- [parameter] F6: Attribute=Root → family → product is discoverable by `Link: rel=describedby` from any file; Applies=family; Measure=deterministic (headers); Bar=header present; Miss=Low — https://llms-explorer.com/reference/attributes/#8-family-nesting
- [parameter] H1: Attribute=UTF-8, LF, no tabs in list lines, no trailing whitespace, single trailing newline; Applies=all; Measure=deterministic; Bar=clean; Miss=Hygiene (Low) — https://llms-explorer.com/reference/attributes/#9-hygiene-and-serving
- [parameter] H2: Attribute=`Content-Type: text/markdown; charset=utf-8` (or `text/plain`), HTTP 200, no redirect, no auth on the path; Applies=served; Measure=deterministic (HEAD); Bar=pass; Miss=High — https://llms-explorer.com/reference/attributes/#9-hygiene-and-serving
- [parameter] H3: Attribute=`Link: rel=describedby` on files; `rel=alternate type=text/markdown` on HTML pages; Applies=served; Measure=deterministic; Bar=present; Miss=Low — https://llms-explorer.com/reference/attributes/#9-hygiene-and-serving
- [parameter] H4: Attribute=`X-Markdown-Tokens` (or manifest tokens) available before fetch; Applies=served; Measure=deterministic; Bar=present; Miss=Low — https://llms-explorer.com/reference/attributes/#9-hygiene-and-serving
- [parameter] H5: Attribute=Regenerated by the build, not hand-maintained; a `generated` stamp newer than the source; Applies=all; Measure=deterministic (mtime/stamp); Bar=stamp ≥ source mtime; Miss=Medium — https://llms-explorer.com/reference/attributes/#9-hygiene-and-serving
- [parameter] H6: Attribute=Validator-clean on the community validators' strict rules where they do not contradict the spec; Applies=index; Measure=deterministic; Bar=0 High; Miss=Low — https://llms-explorer.com/reference/attributes/#9-hygiene-and-serving
- [parameter] H7: Attribute=Lighthouse agentic audit would not flag it (no 5xx on fetch); Applies=served; Measure=deterministic; Bar=200; Miss=Medium — https://llms-explorer.com/reference/attributes/#9-hygiene-and-serving
- [parameter] H8: Attribute=`manifest.json` present and consistent with the files (bytes, tokens, pages, units); Applies=export dir; Measure=deterministic; Bar=consistent; Miss=Medium — https://llms-explorer.com/reference/attributes/#9-hygiene-and-serving
- [parameter] Purpose: index (`llms.txt`)=orientation + navigation; full (`llms-full.txt`)=whole text in one fetch; facts (`llms-facts.txt`)=the checkable claims, each anchored — https://llms-explorer.com/reference/attributes/#10-the-three-kinds-side-by-side
- [parameter] Reader: index (`llms.txt`)=an agent deciding where to look; full (`llms-full.txt`)=a big-context agent or an indexer; facts (`llms-facts.txt`)=a retriever answering a question — https://llms-explorer.com/reference/attributes/#10-the-three-kinds-side-by-side
- [parameter] Unit: index (`llms.txt`)=link + description; full (`llms-full.txt`)=page block; facts (`llms-facts.txt`)=typed unit with source + anchor — https://llms-explorer.com/reference/attributes/#10-the-three-kinds-side-by-side
- [parameter] Size: index (`llms.txt`)=≤10 KB; full (`llms-full.txt`)=unbounded (ladder beside it); facts (`llms-facts.txt`)=≤15% of prose — https://llms-explorer.com/reference/attributes/#10-the-three-kinds-side-by-side
- [parameter] Judged mostly on: index (`llms.txt`)=N*, D*; full (`llms-full.txt`)=C1–C5, S*; facts (`llms-facts.txt`)=C6–C7, R*, P4 — https://llms-explorer.com/reference/attributes/#10-the-three-kinds-side-by-side
- [parameter] Tested by: index (`llms.txt`)=agent test (R5); full (`llms-full.txt`)=grammar round-trip (C1); facts (`llms-facts.txt`)=keyword + vector probes (R1–R2), facts test (R6) — https://llms-explorer.com/reference/attributes/#10-the-three-kinds-side-by-side
- [definition] The attribute rubric — Every attribute an llms file is judged on, with bars and severities. — https://llms-explorer.com/reference/attributes/#the-attribute-rubric

## Changelog: spec v1 to v2, and the hub pipeline
<https://llms-explorer.com/reference/changelog/>

- [parameter] Required elements: v1=H1 + blockquote + sections implied; v2=**H1 only** required; blockquote, prose and sections optional; Effect on an existing file=none required; the lint still scores a missing blockquote as Medium (I2) — quality, not validity — https://llms-explorer.com/reference/changelog/#the-spec-v1-v2-2026-08-10
- [parameter] Placement: v1=`/llms.txt` at the site root; v2=root **or any subpath**; a file covers the URLs under its path; **most-specific wins**; `/.well-known/` explicitly rejected; Effect on an existing file=enables families and split roots (`<section>/llms.txt`) — https://llms-explorer.com/reference/changelog/#the-spec-v1-v2-2026-08-10
- [parameter] Discovery: v1=none; v2=`Link: <…>; rel="describedby"` on files; `rel="alternate" type="text/markdown"` on HTML pages; as `<link>` or an HTTP header; Effect on an existing file=add the two headers ([usage](/reference/usage/) §1) — https://llms-explorer.com/reference/changelog/#the-spec-v1-v2-2026-08-10
- [parameter] Markdown twins: v1=`page.html.md`; v2=`page.html.md` **or** `page.md`; directories append `index.html.md` or `index.md`; Effect on an existing file=either form passes the twin probe (N6) — https://llms-explorer.com/reference/changelog/#the-spec-v1-v2-2026-08-10
- [parameter] `## Optional`: v1=mechanical: skippable when context is short; consumed by `llms_txt2ctx`; v2=a **convention** for secondary information; `llms_txt2ctx` and context-expansion removed from the proposal; Effect on an existing file=keep it last; build nothing that depends on it — https://llms-explorer.com/reference/changelog/#the-spec-v1-v2-2026-08-10
- [parameter] BOM: v1=—; v2=an optional byte-order mark is tolerated; Effect on an existing file=the lint strips it as hygiene (P14) — https://llms-explorer.com/reference/changelog/#the-spec-v1-v2-2026-08-10
- [parameter] Consumption model: v1=expand the whole file into context; v2="view or search the index, then follow links"; the index stays small; detail lives behind links; Effect on an existing file=the size ladder (small / full) becomes the producer's job — https://llms-explorer.com/reference/changelog/#the-spec-v1-v2-2026-08-10
- [parameter] Authoring guidance: v1=—; v2=concise language, informative link descriptions, no unexplained jargon, "test your file by asking an agent questions … giving it only your llms.txt"; Effect on an existing file=the agent test (R5, P12) is the spec's own test made numeric — https://llms-explorer.com/reference/changelog/#the-spec-v1-v2-2026-08-10
- [parameter] Acquire: V1 (to 2026-08-29)=trafilatura BFS crawl → banner mirror; V2 (from 2026-08-30)=the ladder: `llms-full.txt` → `llms.txt` + `.md` twins → `Accept: text/markdown` → docs API → structured crawl; the banner mirror stays the internal format — https://llms-explorer.com/reference/changelog/#the-hub-pipeline-v1-v2-2026-08-30
- [parameter] Clean: V1 (to 2026-08-29)=none (raw HTML → text); V2 (from 2026-08-30)=`docset_refine clean`: boilerplate lines, MDX → markdown, page classes (reference / guide / changelog / marketing / index) — https://llms-explorer.com/reference/changelog/#the-hub-pipeline-v1-v2-2026-08-30
- [parameter] Extract: V1 (to 2026-08-29)=`distill_offline.py bulk` — zero-LLM, output never consumed; V2 (from 2026-08-30)=`extract` (snippets, table rows → parameter, definitions, changelog → change; anchors to real headings) + `units` (local LLM, evidence rule) + `polish` — https://llms-explorer.com/reference/changelog/#the-hub-pipeline-v1-v2-2026-08-30
- [parameter] Export: V1 (to 2026-08-29)=none; V2 (from 2026-08-30)=`export_llms`: index (split over 10 KB) / full (Mintlify grammar) / small (≤ 200,000 chars) / facts / manifest; `topical`; `vocabulary` — https://llms-explorer.com/reference/changelog/#the-hub-pipeline-v1-v2-2026-08-30
- [parameter] Index: V1 (to 2026-08-29)=one raw vector layer; V2 (from 2026-08-30)=raw **and** facts vector layers, plus an FTS5 keyword layer per layer — https://llms-explorer.com/reference/changelog/#the-hub-pipeline-v1-v2-2026-08-30
- [parameter] Serve: V1 (to 2026-08-29)=`web-text-mirror --serve` (HTML); V2 (from 2026-08-30)=`llms_serve.py`: `/llms.txt`, `/d/<stem>/…`, `/m/<key>/…`, `/t/<slug>/…`, with the markdown headers — https://llms-explorer.com/reference/changelog/#the-hub-pipeline-v1-v2-2026-08-30
- [parameter] Gate: V1 (to 2026-08-29)=none; V2 (from 2026-08-30)=`llms_lint.py` (the deterministic passes) inside `docset_rollout cleanup`; `/ldo` for the model and live passes — https://llms-explorer.com/reference/changelog/#the-hub-pipeline-v1-v2-2026-08-30
- [parameter] Artifacts: V1 (to 2026-08-29)=`<stem>.pages/`, `_master.md`, `._distill_index.json`; V2 (from 2026-08-30)=`<stem>.reference/{pages.json, structured.jsonl, units.jsonl, all_units.jsonl}`, `<stem>.llms/` — https://llms-explorer.com/reference/changelog/#the-hub-pipeline-v1-v2-2026-08-30
- [parameter] 2026-08-30: `docset_refine` gains `clean / extract / units / polish / render / export`; the reference dir layout above — https://llms-explorer.com/reference/changelog/#dated-changes-to-the-hub-schema
- [parameter] 2026-08-30: `export_llms` writes the four-file ladder plus `manifest.json`; index split at 10,000 bytes; `PART_PAGES = 60` — https://llms-explorer.com/reference/changelog/#dated-changes-to-the-hub-schema
- [parameter] 2026-08-30: `llms_lint.py` ships the deterministic passes P0–P3, P5–P7, P9 and P14 and the `--json` CI output; `UNIT_RE` fixes the facts line grammar — https://llms-explorer.com/reference/changelog/#dated-changes-to-the-hub-schema
- [parameter] 2026-08-30: `llms_serve.py` sends `Content-Type: text/markdown`, `X-Markdown-Tokens`, `Link: rel="describedby"` — https://llms-explorer.com/reference/changelog/#dated-changes-to-the-hub-schema
- [parameter] 2026-08-30: `docset_refine topical` and `vocabulary`; tree nodes carry `slug` / `aliases`; `--register` writes `llmsFile` on a node — https://llms-explorer.com/reference/changelog/#dated-changes-to-the-hub-schema
- [parameter] 2026-08-31: `export_llms` honours `manifest.json["overrides"]` (`title`, `summary`, `section_order`, `note`) so hand inputs survive regeneration — https://llms-explorer.com/reference/changelog/#dated-changes-to-the-hub-schema
- [parameter] 2026-08-31: `llms_lint.py --kind vocabulary` lints the vocabulary line grammar — https://llms-explorer.com/reference/changelog/#dated-changes-to-the-hub-schema
- [definition] Changelog: spec v1 to v2, and the hub pipeline — What changed in the llms.txt proposal on 2026-08-10, rule by rule, with the effect on an existing file — and the dated changes to the hub schema behind this site. — https://llms-explorer.com/reference/changelog/#changelog-spec-v1-to-v2-and-the-hub-pipeline

## The concept tree: nodes, frontier, and how to read a node page
<https://llms-explorer.com/reference/concept-tree/>

- [parameter] `concept`: the node's name, and the string its parent and children link it by — https://llms-explorer.com/reference/concept-tree/#the-fields-on-a-node-page
- [parameter] `slug`: its URL segment; stable, and the key the API in step 3 will use — https://llms-explorer.com/reference/concept-tree/#the-fields-on-a-node-page
- [parameter] `parent`: the concept it hangs from — linked, unless the node is a root — https://llms-explorer.com/reference/concept-tree/#the-fields-on-a-node-page
- [parameter] `children`: the concepts it names, each either researched (linked) or frontier (greyed) — https://llms-explorer.com/reference/concept-tree/#the-fields-on-a-node-page
- [parameter] `aliases`: other names the same concept goes by; the filter matches these too — https://llms-explorer.com/reference/concept-tree/#the-fields-on-a-node-page
- [parameter] `researchedAt`: the date the research run that created the node finished — https://llms-explorer.com/reference/concept-tree/#the-fields-on-a-node-page
- [parameter] `sourcesCount`: how many sources that run read — https://llms-explorer.com/reference/concept-tree/#the-fields-on-a-node-page
- [parameter] `conceptsCount`: how many concepts that run identified under this one — https://llms-explorer.com/reference/concept-tree/#the-fields-on-a-node-page
- [parameter] `skillId`: the skill the research produced, when it produced one — https://llms-explorer.com/reference/concept-tree/#the-fields-on-a-node-page
- [parameter] `state`: `researched` for every node with a page; `frontier` only for a named child without one — https://llms-explorer.com/reference/concept-tree/#the-fields-on-a-node-page
- [definition] The concept tree: nodes, frontier, and how to read a node page — What the tree is, why frontier is derived rather than stored, what every field on a node means, and how the browser at /tree/ filters it. — https://llms-explorer.com/reference/concept-tree/#the-concept-tree-nodes-frontier-and-how-to-read-a-node-page
- [definition] What a node is — A node is one researched concept. The tree is stored as a **flat list of nodes linked by name** — each node names its parent and its children as strings, not as pointers — so a rename is a one-place edit and a reader can hold the whole file in mind. — https://llms-explorer.com/reference/concept-tree/#what-a-node-is
- [definition] Frontier is derived, never stored — A **frontier** concept on this site is a name that appears in some node's `childConcepts` and has no node of its own. It is computed on every build from the two sides of that comparison, never stored as a status: a stored status can disagree with the tree, and a derived one cannot. — https://llms-explorer.com/reference/concept-tree/#frontier-is-derived-never-stored
- [definition] How the filter works — The filter box on `/tree/` matches a substring against each concept **and its aliases**, and a branch survives if it or any descendant matches — so filtering hides non-matching branches without ever hiding the path to a hit. — https://llms-explorer.com/reference/concept-tree/#how-the-filter-works
- [definition] What is not here yet — Queueing a frontier concept for research, forking the tree, and attaching your own files to a node are per-user actions, and this site has no accounts yet. — https://llms-explorer.com/reference/concept-tree/#what-is-not-here-yet

## Concept facts files
<https://llms-explorer.com/reference/context-files/>

- [definition] Concept facts files — Load the preserved concept tree as source-cited Markdown facts. — https://llms-explorer.com/reference/context-files/#concept-facts-files
- [definition] Read a concept — Fetch `/context.md` to choose a concept, then fetch its `/downloads/concepts/<slug>.md` file. Each file includes its summary, facets, facts and related concepts. — https://llms-explorer.com/reference/context-files/#read-a-concept

## Ethos: what an llms file owes its reader
<https://llms-explorer.com/reference/ethos/>

- [parameter] An index — links and extractive descriptions: yes; it is a map of someone's public pages — https://llms-explorer.com/reference/ethos/#5-rights-are-explicit
- [parameter] A facts file — short anchored claims, each traceable: yes; quotation with attribution, bounded in length — https://llms-explorer.com/reference/ethos/#5-rights-are-explicit
- [parameter] Your own words — hand pages, essays, this site: yes — https://llms-explorer.com/reference/ethos/#5-rights-are-explicit
- [parameter] Third-party full text — a mirrored `llms-full.txt` of a site you do not own: served only to its owner, or under the internal marker; never on a public route — https://llms-explorer.com/reference/ethos/#5-rights-are-explicit
- [definition] Ethos: what an llms file owes its reader — Files are promises; generate, do not hand-edit; never instruct the reader; evidence is external; rights are explicit. — https://llms-explorer.com/reference/ethos/#ethos-what-an-llms-file-owes-its-reader
- [definition] 1. Files are promises — Every link resolves. Every fact is anchored to a heading that exists. — https://llms-explorer.com/reference/ethos/#1-files-are-promises
- [definition] 2. Generate, don't hand-edit — An llms file is an output. Its inputs are a mirror, a page list, extracted units, a concept tree, and a small overrides file (`title`, `summary`, `section_order`, `note`). — https://llms-explorer.com/reference/ethos/#2-generate-dont-hand-edit
- [definition] 3. Never instruct the reader — A docs file has no business telling a model what to say. The spec repository's issue #152 found 42.3% of a sample of wild files attempting exactly that ([evidence](/reference/evidence/)). — https://llms-explorer.com/reference/ethos/#3-never-instruct-the-reader
- [definition] 4. Evidence is external — A finding about an llms file cites something outside the file: the link check, the mirror span behind a unit, the probe result, the HTTP response. A finding with no external evidence is Low at most. — https://llms-explorer.com/reference/ethos/#4-evidence-is-external
- [definition] 5. Rights are explicit — Three tiers, and the tooling knows which is which: — https://llms-explorer.com/reference/ethos/#5-rights-are-explicit
- [definition] The test — If a stranger's agent, handed only the index, can answer eight of ten reasonable questions in two hops — below six is a High — and can check any facts line it relies on in one fetch, the file kept its promises. Nothing else on this site is a stronger claim than that. — https://llms-explorer.com/reference/ethos/#the-test

## Ecosystem evidence
<https://llms-explorer.com/reference/evidence/>

- [parameter] Feb→May 2025: Source=Chris Green; Sample=Majestic Million; Finding=15 → 105 valid files (~0.01%); ~100k crawl errors caveat[^4] — https://llms-explorer.com/reference/evidence/#2-adoption-measurements-dated
- [parameter] Jun 2025: Source=Originality.ai; Sample=3M+ sites; Finding=4,088 llms.txt[^5] — https://llms-explorer.com/reference/evidence/#2-adoption-measurements-dated
- [parameter] Jun 2025: Source=Rankability; Sample=Tranco top 1,000; Finding=0.3%[^6] — https://llms-explorer.com/reference/evidence/#2-adoption-measurements-dated
- [parameter] Jul 2025: Source=HTTP Archive (Burridge); Sample=top 10k; Finding=1.04% valid[^7] — https://llms-explorer.com/reference/evidence/#2-adoption-measurements-dated
- [parameter] Nov 2025: Source=SE Ranking; Sample=~300k domains; Finding=10.13% overall (9.88% low-traffic / 10.54% mid / 8.27% 100k+ visits)[^3] — https://llms-explorer.com/reference/evidence/#2-adoption-measurements-dated
- [parameter] Mar 2026: Source=Originality.ai via ppc.land; Sample=Fortune 500; Finding=7.4% (37/500)[^8] — https://llms-explorer.com/reference/evidence/#2-adoption-measurements-dated
- [parameter] May 2026: Source=Originality.ai; Sample=3M+ sites; Finding=36,120 llms.txt (8.8× YoY); llms-full.txt 23 → 2,463 (107×); ai.txt 397[^5] — https://llms-explorer.com/reference/evidence/#2-adoption-measurements-dated
- [parameter] May 2026: Source=Ahrefs; Sample=137,210 Ahrefs-Web-Analytics domains; Finding=28% publish a valid file (self-selected sample)[^1] — https://llms-explorer.com/reference/evidence/#2-adoption-measurements-dated
- [parameter] Jun 2026: Source=HTTP Archive (Burridge); Sample=top 1k / 10k / 100k / 1M; Finding=6.28% / 5.61% / 5.17% / 5.07% (~5.4× in 12 months)[^7] — https://llms-explorer.com/reference/evidence/#2-adoption-measurements-dated
- [parameter] Jun 2026: Source=Rankability; Sample=Tranco top 1,000; Finding=8.7% (87 files; 15 with llms-full.txt)[^6] — https://llms-explorer.com/reference/evidence/#2-adoption-measurements-dated
- [parameter] Ahrefs (2026-06-15): Window / sample=May 2026 logs, 137,210 domains; Finding=**97% of valid files got zero requests**; of requests, 96% bots, 77% of those non-AI (SEO auditors 21.7%); named AI bots 19.5%; AI training crawlers 5.3% (GPTBot 4.51%, ClaudeBot 0.8%); AI retrieval 1.1% (OAI-SearchBot 0.74%); **0 AI requests to non-existent files** (nobody probes speculatively); the `Claude-Code` UA… — https://llms-explorer.com/reference/evidence/#4-who-reads-server-log-studies
- [parameter] OtterlyAI (2026-02-05): Window / sample=90 days, one site; Finding=84 of 62,100 AI-bot requests hit /llms.txt (0.1%)[^15] — https://llms-explorer.com/reference/evidence/#4-who-reads-server-log-studies
- [parameter] Wislr (Feb–Mar 2026): Window / sample=48 days, one site; Finding=12,099 bot requests; robots.txt fetched hundreds of times (OAI-SearchBot 180, ClaudeBot 175); sitemap.xml too; **llms.txt 0**[^16] — https://llms-explorer.com/reference/evidence/#4-who-reads-server-log-studies
- [parameter] EZY Research (Apr–Jul 2026): Window / sample=83 sites, 12 weeks; Finding=robots vs llms: GPTBot 3,990/7, ClaudeBot 3,120/9, PerplexityBot 775/0, Googlebot 5,125/67, **Meta-ExternalAgent 172/193** (the only bot fetching it more than robots.txt)[^17] — https://llms-explorer.com/reference/evidence/#4-who-reads-server-log-studies
- [parameter] Hacker News thread (Feb 2026): Window / sample=anecdotal logs; Finding=only OVH/GCP-hosted tools (WebPageTest, BuiltWith), no ChatGPT/Claude UAs[^18] — https://llms-explorer.com/reference/evidence/#4-who-reads-server-log-studies
- [parameter] Cloudflare `Accept: text/markdown` (Mar–Apr 2026): Window / sample=44 days, one Worker; Finding=1,421 requests: headless Chrome 639, "Claude" (Anthropic infra) 500, axios 211; no GPTBot/PerplexityBot/ClaudeBot[^19] — https://llms-explorer.com/reference/evidence/#4-who-reads-server-log-studies
- [parameter] directory.llmstxt.cloud: Size="4,000 websites listed" (49M llms.txt tokens / 325M llms-full tokens); Notes=named in spec v2 — https://llms-explorer.com/reference/evidence/#6-directories-and-registries
- [parameter] llmstxthub.com: Size=~2,650 entries, 15–16 categories (David Dias); Notes=named in spec v2 — https://llms-explorer.com/reference/evidence/#6-directories-and-registries
- [parameter] llmstxt.site: Size=~1,000+ (≈170 in May 2025); columns product / website / llms.txt / llms-full.txt / **token counts**; `/submit`; Notes=named in spec v2 — https://llms-explorer.com/reference/evidence/#6-directories-and-registries
- [parameter] SecretiveShell/Awesome-llms-txt: Size=784 link lines (counted 2026-08-30); Notes=GitHub — https://llms-explorer.com/reference/evidence/#6-directories-and-registries
- [parameter] llms-text.com: Size="780+ verified implementations"; Notes=vendor's own directory — https://llms-explorer.com/reference/evidence/#6-directories-and-registries
- [parameter] llms-text.com/blog/sites-using-llms-txt: Author / date=Michael Vereb, 2025-07-25; Claims="780+ verified"; names Anthropic, Cloudflare, Supabase, Vercel, ElevenLabs, Firecrawl, Mintlify, Cursor, Aptos, GitBook, Wix; "no e-commerce adoption"; Grade=adopters check out on live probe; count uncorroborated — low for numbers, fine for examples[^31] — https://llms-explorer.com/reference/evidence/#7-vendor-sources-graded
- [parameter] llms-text.com/blog/what-is-llms-txt: Author / date=same; Claims="foundational pillar of GEO"; ChatGPT/Perplexity/Cursor/Windsurf/Claude Code consume it; "up to 114% more tokens" (incoherent arithmetic), "10–15% accuracy" — unattributed; Grade=GEO and ChatGPT/Perplexity-consumption claims contradicted by every log study — low[^32] — https://llms-explorer.com/reference/evidence/#7-vendor-sources-graded
- [parameter] llms-text.com/blog/llms-txt, /how-to-create-llms-txt: Author / date=same; Claims=MIME/200/UTF-8 rules; `Link: …; rel="describedby"`; "under 10 KB"; framework snippets; funnels to its generator/validator; Grade=useful mechanics (the `describedby` relation is now in spec v2), vendor numbers — medium[^33][^34] — https://llms-explorer.com/reference/evidence/#7-vendor-sources-graded
- [parameter] gitdoc.ai/blog/llms-txt-ai-readable-documentation: Author / date=Yadian Llada / GitDoc, 2026-05-22; Claims=GitBook: 41% of docs page requests from AI agents (unverified); permission / inventory / navigation distinction; curate 10–20 pages (quickstart, auth, per-resource reference, errors, changelog); regenerate in the build; llms-full for priority pages; Grade=sound guidance, unverified headline… — https://llms-explorer.com/reference/evidence/#7-vendor-sources-graded
- [definition] 1. The one-line verdict — Adoption is real and growing (≈5–10% of the general web by mid-2026, 28% among SEO-savvy sites, 8.8× year on year); *unsolicited* consumption is near zero (97% of files never get an AI request); the demonstrated use is agents that are pointed at the file — the `Claude-Code` UA out-fetched every AI… — https://llms-explorer.com/reference/evidence/#1-the-one-line-verdict
- [definition] 6. Directories and registries — Self-submitted, overlapping, unverified — lower bounds, not measurements:[^27][^28][^29][^30] — https://llms-explorer.com/reference/evidence/#6-directories-and-registries

## Formatting: the grammars side by side
<https://llms-explorer.com/reference/formatting/>

- [snippet] 1. The index — `llms.txt`: > One paragraph saying what this is and who it is for. — `# Product` — https://llms-explorer.com/reference/formatting/#1-the-index-llmstxt
- [snippet] 4. The facts line — `llms-facts.txt`: https://example.com/docs/install.md — `## Install` — https://llms-explorer.com/reference/formatting/#4-the-facts-line-llms-factstxt
- [snippet] 5. The vocabulary line — `llms-vocabulary.txt`: - **anchor** [llms.anchor] (noun): the `#fragment` on a facts-line URL that names the heading a claim came from — https: — `- **anchor** [llms.anchor] (noun): the `#fragment` on a facts-line URL that names the heading a clai` — https://llms-explorer.com/reference/formatting/#5-the-vocabulary-line-llms-vocabularytxt
- [parameter] Mintlify: Page block=`# Title` / `Source: <url>` / blank / body; blank lines between pages; Who=Mintlify sites, Claude Code docs, **the hub** (`GRAMMAR_NOTE`) — https://llms-explorer.com/reference/formatting/#2-the-full-file-llms-fulltxt
- [parameter] Anthropic YAML: Page block=site H1, `---`, per page `## Heading` + YAML (`title:` / `url:` / `description:`) + raw MDX; Who=platform.claude.com — https://llms-explorer.com/reference/formatting/#2-the-full-file-llms-fulltxt
- [parameter] Cloudflare frontmatter: Page block=YAML frontmatter, a "Documentation Index" blockquote, `# Title`, `[View as Markdown](…/index.md)`, body; Who=developers.cloudflare.com — https://llms-explorer.com/reference/formatting/#2-the-full-file-llms-fulltxt
- [definition] Formatting: the grammars side by side — The index, the three full-file grammars, the facts line, the small file, the vocabulary line, the split root and the manifest — on one page. — https://llms-explorer.com/reference/formatting/#formatting-the-grammars-side-by-side
- [definition] 1. The index — `llms.txt` — The only file the spec defines. Structure, in order: an optional BOM; **one H1** naming the site or product (the only required element); a blockquote summary of one to three sentences; free-form prose (no headings) about how to read the file; then H2 sections, each a list of links. — https://llms-explorer.com/reference/formatting/#1-the-index-llmstxt
- [definition] 2. The full file — `llms-full.txt` — Not in the spec; three grammars are in the wild. The hub emits the first and names it in a header comment so a parser never has to guess. — https://llms-explorer.com/reference/formatting/#2-the-full-file-llms-fulltxt
- [definition] 3. The budgeted file — `llms-small.txt` — Same grammar as the full file, different selection: reference-class pages first, then guides, until `SMALL_MAX_CHARS = 200_000` characters (about 50k tokens at `CHARS_PER_TOKEN = 4`) — the ceiling at which indexed docs become unstable in consumers such as Cursor. — https://llms-explorer.com/reference/formatting/#3-the-budgeted-file-llms-smalltxt
- [definition] 4. The facts line — `llms-facts.txt` — A hub extension: the checkable claims, one per line, each anchored to the heading it came from. — https://llms-explorer.com/reference/formatting/#4-the-facts-line-llms-factstxt
- [definition] 5. The vocabulary line — `llms-vocabulary.txt` — The lexical layer, spec-v2-shaped so any llms reader can open it: an H1 `<Family> — vocabulary`, a blockquote with the term count, then `## Terms`, `## Homonyms` and `## Named, not yet defined`. One line per term per sense: — https://llms-explorer.com/reference/formatting/#5-the-vocabulary-line-llms-vocabularytxt
- [definition] 6. Split roots and families — When an index would exceed 10 KB the sections become subpath indexes: the root keeps the H1, blockquote and a `## Sections` list of `<slug>/llms.txt` links, each line carrying page and token counts; a section with no further path structure is cut into `part-N` files of `PART_PAGES = 60` pages. — https://llms-explorer.com/reference/formatting/#6-split-roots-and-families
- [definition] 7. The manifest — `manifest.json` — Beside the files, never linked from them: `files{name: {bytes, tokens}}`, `chars_per_token`, `pages`, `units`, `sections`, `dropped_empty_pages`, `acquired` (how the mirror was obtained), and `overrides` — the hand inputs (`title`, `summary`, `section_order`, `note`) that survive regeneration. — https://llms-explorer.com/reference/formatting/#7-the-manifest-manifestjson
- [definition] Reading order — Index first, always. Fall through to `llms-small.txt` when you need whole pages and have a budget, to `llms-full.txt` when you have none, to `llms-facts.txt` when you need a claim with a place to check it. — https://llms-explorer.com/reference/formatting/#reading-order

## Glossary
<https://llms-explorer.com/reference/glossary/>

- [definition] Glossary — The terms of the field, one line each, in the sense this site uses them — with the contrasts that matter. — https://llms-explorer.com/reference/glossary/#glossary

## The passes
<https://llms-explorer.com/reference/passes/>

- [parameter] B0: Passes=P0; Kind=deterministic; Runs as=inline, first — every other pass keys off the detected kind — https://llms-explorer.com/reference/passes/#bundle-map-and-dispatch-rules
- [parameter] B1: Passes=P1 P2 P3 P5 P14; Kind=deterministic; Runs as=one `llms_lint.py` invocation, JSON findings — https://llms-explorer.com/reference/passes/#bundle-map-and-dispatch-rules
- [parameter] B2: Passes=P4 P9; Kind=model; Runs as=one subagent reading the index (+ sample pages) — https://llms-explorer.com/reference/passes/#bundle-map-and-dispatch-rules
- [parameter] B3: Passes=P6 P7; Kind=deterministic; Runs as=`llms_lint.py --full` / `--facts` (same invocation as B1 when the kind is full/facts) — https://llms-explorer.com/reference/passes/#bundle-map-and-dispatch-rules
- [parameter] B4: Passes=P8; Kind=model, sampled; Runs as=one subagent, 20 units re-read against source spans — https://llms-explorer.com/reference/passes/#bundle-map-and-dispatch-rules
- [parameter] B5: Passes=P10; Kind=deterministic + model; Runs as=only when kind = family or `--family` — https://llms-explorer.com/reference/passes/#bundle-map-and-dispatch-rules
- [parameter] B6: Passes=P11; Kind=live; Runs as=`docset_indexer.py keyword` + `query --layer facts` probes — https://llms-explorer.com/reference/passes/#bundle-map-and-dispatch-rules
- [parameter] B7: Passes=P12; Kind=live agent; Runs as=one fresh-context subagent given ONLY the file; opt-in `--agent-test`, default on for new files — https://llms-explorer.com/reference/passes/#bundle-map-and-dispatch-rules
- [parameter] B8: Passes=P13; Kind=live HTTP; Runs as=only when a URL is given or `--serve-check` — https://llms-explorer.com/reference/passes/#bundle-map-and-dispatch-rules
- [parameter] B9: Passes=P15; Kind=deterministic; Runs as=only when the export directory has a source mirror — https://llms-explorer.com/reference/passes/#bundle-map-and-dispatch-rules
- [definition] The passes — What the optimizer runs, in order, and how each pass is judged and fixed. — https://llms-explorer.com/reference/passes/#the-passes
- [definition] Severity resolution across passes — Same span flagged by several passes: take the highest severity; tie → lower pass number wins (P0 > P1 > …); tie → the more conservative fix (report over rewrite). — https://llms-explorer.com/reference/passes/#severity-resolution-across-passes
- [definition] N/A rules — A pass reports `N/A (<reason>)` — never silently skips — when: the kind excludes it (P6 on an index), the layer is absent (P11 without an indexed docset), the input is missing (P13 without a URL, P15 without a mirror), or the flag is off (P12 without `--agent-test` on a refresh run). — https://llms-explorer.com/reference/passes/#na-rules

## Reasoning: why the rules are what they are
<https://llms-explorer.com/reference/reasoning/>

- [definition] Reasoning: why the rules are what they are — Extractive descriptions, the size ladder, anchors, facts as the trusted layer, and the two-hop bar — each rule traced to the evidence that produced it. — https://llms-explorer.com/reference/reasoning/#reasoning-why-the-rules-are-what-they-are
- [definition] 1. Extractive descriptions beat generated ones — An index description exists so that a routing model can decide, without fetching, whether the page answers its question. That decision is made on tokens: the flag name, the error string, the endpoint path. — https://llms-explorer.com/reference/reasoning/#1-extractive-descriptions-beat-generated-ones
- [definition] 2. Size is a producer-side problem — Consumers do not truncate gracefully. — https://llms-explorer.com/reference/reasoning/#2-size-is-a-producer-side-problem
- [definition] 3. Anchors make facts checkable — A claim without a place to verify it is a rumour with a URL. The facts line carries `url#anchor`, and the anchor must resolve to a heading that exists on the page (attribute C6). — https://llms-explorer.com/reference/reasoning/#3-anchors-make-facts-checkable
- [definition] 4. The facts file is the trusted layer — Raw page text is untrusted input — the spec repository's own issue #152 found that 42.3% of a 100-file sample tried to steer the reader ([evidence](/reference/evidence/)). — https://llms-explorer.com/reference/reasoning/#4-the-facts-file-is-the-trusted-layer
- [definition] 5. Two hops, from the index alone — The spec's own test is the bar: "test your file by asking an agent questions about your content, giving it only your llms.txt as a starting point." The rubric makes it numeric — attribute R5, pass P12: ten questions, an agent that starts from the index and may follow links, at least eight answered… — https://llms-explorer.com/reference/reasoning/#5-two-hops-from-the-index-alone
- [definition] 6. Publish for agents, not for search — The evidence page holds the numbers: adoption at roughly 5–10% of the general web by mid-2026 and rising 8.8× year on year, yet 97% of valid files received zero AI requests in a month of logs, Google says it does not read the file, and a 300k-domain model found no relationship between having one… — https://llms-explorer.com/reference/reasoning/#6-publish-for-agents-not-for-search
- [definition] 7. Why the rubric is deterministic first — Every attribute names its measure: deterministic, model judgment, or live. The lint implements the deterministic passes P0–P3, P5–P7, P9 and P14 with no model call and gates CI on them; the model, live and family passes (P4, P8, P10–P13, P15) run under `/ldo` when someone asks. — https://llms-explorer.com/reference/reasoning/#7-why-the-rubric-is-deterministic-first

## Recreating and aggregating
<https://llms-explorer.com/reference/recreation/>

- [snippet] 6. Scale to a family: nested indexes, hub-and-spoke: > One index per product below; each product's own llms.txt is the authoritative map of that product. — `# Acme Platform docs` — https://llms-explorer.com/reference/recreation/#6-scale-to-a-family-nested-indexes-hub-and-spoke
- [definition] Recreating and aggregating — The acquisition ladder, lenient parsing, families, rights. — https://llms-explorer.com/reference/recreation/#recreating-and-aggregating
- [definition] 2. Acquire clean markdown — the ladder — Try in this order; each step is cheaper and cleaner than the next: 1. — https://llms-explorer.com/reference/recreation/#2-acquire-clean-markdown-the-ladder
- [definition] 3. Build the index for ONE product — Structure (spec v2): H1 = product name; blockquote = one-paragraph summary; optional prose "how to interpret the files"; H2 sections, each a list of `- [name](url): description`.[^4] — https://llms-explorer.com/reference/recreation/#3-build-the-index-for-one-product
- [definition] 6. Scale to a family: nested indexes, hub-and-spoke — Spec v2 gives the mechanism: "The file can be placed at the site root, or at any path within it, covering the pages under that path … where more than one file applies, agents should use the most specific one."[^4] The live exemplar is **Cloudflare**: `developers.cloudflare.com/llms.txt` holds ~105… — https://llms-explorer.com/reference/recreation/#6-scale-to-a-family-nested-indexes-hub-and-spoke

## llms.txt: the spec and its grammars
<https://llms-explorer.com/reference/spec/>

- [snippet] 2. The spec, v2: > Optional description goes here — `# Title` — https://llms-explorer.com/reference/spec/#2-the-spec-v2
- [parameter] Spec-conformant: Example=code.claude.com/docs/llms.txt, FastHTML; Notes=H1, blockquote, H2 sections, `.md` links — https://llms-explorer.com/reference/spec/#31-llmstxt-three-real-shapes
- [parameter] API-first: Example=docs.github.com/llms.txt; Notes=first H2 "How to use" lists JSON/markdown APIs (Page List, Article Body → markdown, Search) and the MCP server before any content links[^6] — https://llms-explorer.com/reference/spec/#31-llmstxt-three-real-shapes
- [parameter] Non-conformant prose: Example=docs.anthropic.com/llms.txt; Notes=H1, then prose and `## Root URL` / language lists, no blockquote[^6] — https://llms-explorer.com/reference/spec/#31-llmstxt-three-real-shapes
- [parameter] Mintlify: Page block=`# Title` / `Source: <url>` / blank / description / body; pages separated by blank lines only; Verified sample=code.claude.com/docs/llms-full.txt (191 pages, 8.5 MB); mintlify.com/docs/llms-full.txt[^7] — https://llms-explorer.com/reference/spec/#32-llms-fulltxt-not-in-the-spec-and-three-grammars
- [parameter] Anthropic platform: Page block=site H1, `---`, then per-page `## Heading` + YAML block (`title:` / `url:` / `description:`) + raw MDX; Verified sample=platform.claude.com/docs/llms-full.txt[^7] — https://llms-explorer.com/reference/spec/#32-llms-fulltxt-not-in-the-spec-and-three-grammars
- [parameter] Cloudflare: Page block=YAML frontmatter (`description:` / `title:` / `image:`), a "Documentation Index" blockquote pointing at the covering `/<product>/llms.txt`, `# Title`, a `[View as Markdown](…/index.md)` line, body; Verified sample=developers.cloudflare.com/llms-full.txt (57 MB)[^6] — https://llms-explorer.com/reference/spec/#32-llms-fulltxt-not-in-the-spec-and-three-grammars
- [parameter] Firecrawl generators: Page block=pages delimited by `<\|firecrawl-page-N-lllmstxt\|>`; Verified sample=create-llmstxt-py[^10] — https://llms-explorer.com/reference/spec/#32-llms-fulltxt-not-in-the-spec-and-three-grammars
- [parameter] Reference `llms_txt2ctx`: Behaviour=regex-parse, fetch every link, emit XML `<project title summary><docs><doc …>`; `--optional True` includes the Optional section; removed from the proposal in v2; Evidence=[^24][^2] — https://llms-explorer.com/reference/spec/#5-how-consumers-actually-use-it
- [parameter] LangChain `mcpdoc` (MCP): Behaviour=`list_doc_sources` + `fetch_docs`; the *agent* decides which links to follow; allowlists only the llms.txt's domain; Evidence=[^25] — https://llms-explorer.com/reference/spec/#5-how-consumers-actually-use-it
- [parameter] Claude Code: Behaviour=Anthropic publishes its docs index and points the agent at it; Ahrefs' logs show the `Claude-Code` UA out-fetching every AI retrieval bot bar two (statespace-indexer, GPTBot); no documented *automatic* lookup — it is fetched when directed; Evidence=[^14][^26] — https://llms-explorer.com/reference/spec/#5-how-consumers-actually-use-it
- [parameter] Cursor `@Docs`: Behaviour=crawls URLs; "cannot recognise llms.txt" request acknowledged (Jun 2025), no documented support; >50–60k tokens unstable; its own llms.txt once redirected to an HTML app shell; Evidence=[^17][^27] — https://llms-explorer.com/reference/spec/#5-how-consumers-actually-use-it
- [parameter] Windsurf, Copilot: Behaviour=`@docs` is a curated list; Copilot feature request unanswered as of Jul 2026; Evidence=[^28][^29] — https://llms-explorer.com/reference/spec/#5-how-consumers-actually-use-it
- [parameter] ChatGPT, Perplexity, Google: Behaviour=no statements of use; logs ≈ 0 requests; Google: "You don't need to create new machine readable files"; Evidence=[^12][^13][^14] — https://llms-explorer.com/reference/spec/#5-how-consumers-actually-use-it
- [parameter] `robots.txt`: Job=access control; now also carries Cloudflare **Content Signals** (`Content-Signal: search=yes, ai-input=…, ai-train=no`, 2025-09-24); Do AI bots fetch it?=**full treatment: `references/robots-txt.md` (RFC 9309) and `references/robots-txt-content-signals.md`** — yes, thousands of times per site; Content Signals: Google says "no effects whatsoever"[^36][^37] — https://llms-explorer.com/reference/spec/#7-related-files
- [parameter] `sitemap.xml`: Job=exhaustive inventory; no `.md` versions, no external links; Do AI bots fetch it?=yes (ClaudeBot, GPTBot, Bingbot)[^38] — https://llms-explorer.com/reference/spec/#7-related-files
- [parameter] `llms.txt`: Job=curated navigation for agents pointed at it — **not an access-control or TDM opt-out mechanism**; see `eu-ai-act-tdm-opt-out` for why it does not count as an EU rights reservation; Do AI bots fetch it?=~0 speculative fetches; agents when directed[^14] — https://llms-explorer.com/reference/spec/#7-related-files
- [parameter] `ai.txt`: Job=opt-out preferences (IETF draft) — see `references/ai-txt.md` for the full disambiguation (5-way name collision, adoption evidence, authoring); Do AI bots fetch it?=397 instances found May 2026[^39] — https://llms-explorer.com/reference/spec/#7-related-files
- [parameter] `agents.md` / `/.well-known/ucp`: Job=Shopify's agent-commerce surface, auto-shipped to every Liquid storefront. Since 2026-05-28 `/agents.md` is **canonical** and `/llms.txt` + `/llms-full.txt` are alternate URLs that **mirror it** — so a Shopify `/llms.txt` is usually not a spec-shaped index. Full detail: `references/agents-md.md`, `references/ucp-protocol.md`; Do AI bots fetch it?=yes… — https://llms-explorer.com/reference/spec/#7-related-files
- [parameter] `robots.txt` + `License:` → RSL XML: Job=**licensing terms and price** (`ai-train`/`ai-input`/`search`, pay-per-crawl/-inference) — the layer llms.txt has no vocabulary for; see `rsl-really-simple-licensing.md`; Do AI bots fetch it?=no AI-company commitment; 3 of 130 sampled domains deploy it (2026-09-02) — https://llms-explorer.com/reference/spec/#7-related-files
- [definition] llms.txt: the spec and its grammars — Spec v2, llms-full grammars, discovery, consumers. — https://llms-explorer.com/reference/spec/#llmstxt-the-spec-and-its-grammars
- [definition] 1. What it is, in one paragraph — A markdown file — `/llms.txt` at a site root or **at any subpath** — that gives a language model a curated, priority-ordered map of a site's LLM-friendly content: an H1, a blockquote summary, optional prose, then H2 sections of `- [name](url): description` links.[^1] The links should point at… — https://llms-explorer.com/reference/spec/#1-what-it-is-in-one-paragraph
- [definition] 2. The spec, v2 — Structure, in order (verbatim from llmstxt.org):[^1] — https://llms-explorer.com/reference/spec/#2-the-spec-v2
- [definition] 3.2 llms-full.txt — not in the spec, and three grammars — `llms-full.txt` (the whole docset inlined into one markdown file) appears nowhere in the v1/v2 spec text or the repo README.[^7] Mintlify says it "was developed by Mintlify in collaboration with customer Anthropic";[^8] Lab451 dates its popularisation to early 2025.[^9] There is **no single… — https://llms-explorer.com/reference/spec/#32-llms-fulltxt-not-in-the-spec-and-three-grammars
- [definition] 3.3 `.md` twins — Mintlify, Fern, GitBook and ReadMe all serve a `.md` twin per page and link them from llms.txt "so AI tools can fetch the Markdown version of each page directly".[^4][^11] Mintlify's twins begin with a blockquote — `> ## Documentation Index` / `Fetch the complete documentation index at… — https://llms-explorer.com/reference/spec/#33-md-twins

## Generation tooling
<https://llms-explorer.com/reference/tooling/>

- [parameter] Docs on Mintlify / GitBook / ReadMe / Fern: Use=nothing — it is automatic; Emits=llms.txt (+ full on Mintlify/GitBook) + `.md` twins — https://llms-explorer.com/reference/tooling/#1-pick-by-situation
- [parameter] Docusaurus, MkDocs, VitePress, Starlight, Sphinx, Nuxt: Use=the framework plugin (table §3); Emits=llms.txt + llms-full.txt (+ `.md`, `llms-small.txt` on Starlight) — https://llms-explorer.com/reference/tooling/#1-pick-by-situation
- [parameter] A live site you do not own: Use=crawl-based generator (§4) — `create-llmstxt-py`, `dotenvx/llmstxt`, or your own sitemap→markdown pipeline; Emits=llms.txt (+ full) with **extracted or AI-written** descriptions — https://llms-explorer.com/reference/tooling/#1-pick-by-situation
- [parameter] WordPress: Use=Yoast ≥25.3 / Rank Math / AIOSEO (§5); Emits=llms.txt only (AIOSEO Pro adds full + markdown posts) — https://llms-explorer.com/reference/tooling/#1-pick-by-situation
- [parameter] Webflow / Framer: Use=host a hand-written file; Emits=whatever you upload — https://llms-explorer.com/reference/tooling/#1-pick-by-situation
- [parameter] Any Cloudflare-proxied HTML site: Use="Markdown for Agents" toggle (§6); Emits=on-the-fly markdown on `Accept: text/markdown`, no llms.txt — https://llms-explorer.com/reference/tooling/#1-pick-by-situation
- [parameter] **Mintlify**: Emits=llms.txt, llms-full.txt, `.md` per page, `/.well-known/` copies, `/_llms/` split indexes; Descriptions from=frontmatter `description` (truncated at 300 chars), nav order from `docs.json`; optional `markdown.instructions` agent text; Notes=index capped at 100,000 chars → recursive `/_llms/<group>.md`; default language/version only; hidden/noindex pages excluded; hand-written… — https://llms-explorer.com/reference/tooling/#2-docs-platforms
- [parameter] **Fern**: Emits=llms.txt (root **and per-subdirectory**), `.md` per page; **no llms-full.txt**; Descriptions from=frontmatter `description`, fallback `subtitle`; adds OpenAPI/AsyncAPI links; Notes=dropped llms-full because it "exceeded most model context windows, added heavy serving overhead, saw little use"[^2] — https://llms-explorer.com/reference/tooling/#2-docs-platforms
- [parameter] **GitBook**: Emits=llms.txt (Jan 2025), llms-full.txt + `.md` per page (Jun 2025), `/sitemap.md`, `Accept: text/markdown`; Descriptions from=auto from page structure; Notes=zero-config; no curation controls documented; full export "will be more expensive"[^3][^4] — https://llms-explorer.com/reference/tooling/#2-docs-platforms
- [parameter] **ReadMe**: Emits=llms.txt (default on, all plans), `.md` per page; **no llms-full**; Descriptions from=project title + guide/API hierarchy; Notes=a custom file from the repo root disables auto-updates; hidden pages excluded[^5] — https://llms-explorer.com/reference/tooling/#2-docs-platforms
- [parameter] **GitDoc** (vendor claim): Emits=llms.txt + llms-full.txt "for the pages you mark as priority", regenerated in the build; Descriptions from=sidebar/nav; Notes=vendor blog, 2026-05-22[^6] — https://llms-explorer.com/reference/tooling/#2-docs-platforms
- [parameter] `docusaurus-plugin-llms` (rachfop): Emits=llms.txt, llms-full.txt, optional per-page `.md`, versioned + `customLLMFiles`; Input=source tree at `postBuild`; Descriptions / ordering=frontmatter → first heading → site fallback; `includeOrder` globs; Maturity & limits=144★, MIT; not run in `docusaurus start`; image rewrite only for bundled assets[^7] — https://llms-explorer.com/reference/tooling/#3-static-site-generator-plugins
- [parameter] `@signalwire/docusaurus-plugin-llms-txt`: Emits=llms.txt, `.md`, optional full; Input=**built HTML** (rehype/remark); Descriptions / ordering=manual `sections[].description`, `autoSectionDepth`; Maturity & limits=v1.2.2, ~10 months stale; ENOENT / "processed 0 documents" bug[^8][^9] — https://llms-explorer.com/reference/tooling/#3-static-site-generator-plugins
- [parameter] Docusaurus core: Emits=none; Input=—; Descriptions / ordering=—; Maturity & limits=issue #10899 open since Feb 2025[^10] — https://llms-explorer.com/reference/tooling/#3-static-site-generator-plugins
- [parameter] `mkdocs-llmstxt` (pawamoy): Emits=llms.txt, `.md`, optional `full_output`; Input=built HTML → BeautifulSoup → Markdownify; Descriptions / ordering=`sections:` dict with per-file descriptions; Maturity & limits=130★, v0.5.x, **maintenance mode, seeking maintainer**; needs `site_url`; mkdocstrings `show_source` mangles tables/code in the full file[^11][^12] — https://llms-explorer.com/reference/tooling/#3-static-site-generator-plugins
- [parameter] `vitepress-plugin-llms` (okineadev): Emits=llms.txt, llms-full.txt, `.md`; Input=VitePress source; Descriptions / ordering=frontmatter `description`; `<llm-only>` / `<llm-exclude>` tags; Maturity & limits=394★; used by Vite, Vue, Vitest, Rolldown; relative URLs break under redirects/domain moves[^13] — https://llms-explorer.com/reference/tooling/#3-static-site-generator-plugins
- [parameter] `starlight-llms-txt` (delucis): Emits=llms.txt, llms-full.txt, **llms-small.txt**; Input=Astro Starlight; Descriptions / ordering=`projectName`, `description`, `details`, `optionalLinks`, `customSets`, `promote`/`demote`; `minify` strips asides; Maturity & limits=110★, docs updated Aug 2026; needs `site`[^14] — https://llms-explorer.com/reference/tooling/#3-static-site-generator-plugins
- [parameter] `sphinx-llms-txt` (jdillard): Emits=llms.txt (markdown), llms-full.txt (**reStructuredText**); Input=Sphinx build; Descriptions / ordering=toctree titles; `llms_txt_summary`, `llms_txt_exclude`, `llms_txt_full_max_size`; Maturity & limits=v0.7.1; full file is RST; points to NVIDIA `sphinx-llm`[^15] — https://llms-explorer.com/reference/tooling/#3-static-site-generator-plugins
- [parameter] `nuxt-llms` / Nuxt Content: Emits=llms.txt (~5K tokens), opt-in llms-full.txt (~1M+ tokens); Input=Nuxt Content, runtime hooks; Descriptions / ordering=`sections` in `nuxt.config`; Maturity & limits=first-party; full file explicitly for 200K+-context tools[^16] — https://llms-explorer.com/reference/tooling/#3-static-site-generator-plugins
- [parameter] Next.js / Nextra: Emits=hand-rolled `app/llms.txt/route.ts` (force-static or dynamic); `next-llms-txt` adds per-page `.md` endpoints; Input=components; Descriptions / ordering="reads and parses readable text"; Maturity & limits=discussion #80692 unresolved; no Nextra built-in found (tentative)[^17][^18] — https://llms-explorer.com/reference/tooling/#3-static-site-generator-plugins
- [parameter] `llms-txt-action` (demodrive-ai): Emits=llms.txt, llms-full.txt, `.md`; Input=built HTML dir + sitemap.xml; Descriptions / ordering=local/offline or cloud LLM summaries via LiteLLM (default GPT-4o); Maturity & limits=16★; needs `--dirty` with `mkdocs gh-deploy`[^19] — https://llms-explorer.com/reference/tooling/#3-static-site-generator-plugins
- [parameter] Firecrawl `/llmstxt` API + llmstxt.firecrawl.dev: What it does=URL → async job → llms.txt (+ full); `maxUrls` 1–100 (default 10), 1 credit/URL, public pages only, 5,000-URL alpha cap; Limits=**deprecated in favour of the main endpoints** (page carries no date; still up); users pointed to the Python repo[^20][^21] — https://llms-explorer.com/reference/tooling/#4-crawl-based-generators-sites-you-do-not-own
- [parameter] `create-llmstxt-py` (Firecrawl, 320★): What it does=`/map` → scrape each page to markdown (batches of 10; failures skipped, no retry) → GPT-4o-mini writes a 3–4-word title + 9–10-word description → flat llms.txt; llms-full.txt concatenates under `<\|firecrawl-page-N-lllmstxt\|>`; Limits=default 20 URLs; memory issues on large sites; **sections are not inferred**; descriptions are AI-written and… — https://llms-explorer.com/reference/tooling/#4-crawl-based-generators-sites-you-do-not-own
- [parameter] `dotenvx/llmstxt` (147★, BSD-3): What it does=sitemap.xml → `- [Title](url): description` bullets; `--include-path` / `--exclude-path` globs; `--replace-title` regex; Limits=llms.txt only; titles extracted from HTML; description derivation undocumented[^23] — https://llms-explorer.com/reference/tooling/#4-crawl-based-generators-sites-you-do-not-own
- [parameter] Jina Reader `r.jina.ai/<url>`: What it does=headless Chrome or curl engine → Readability → Turndown; headers `x-respond-with`, `x-target-selector`, `x-retain-links`, `x-max-tokens`, `x-markdown-chunking`; Limits=per-page cleaner, no site/llms.txt mode; anonymous traffic rate-limited[^24] — https://llms-explorer.com/reference/tooling/#4-crawl-based-generators-sites-you-do-not-own
- [parameter] Screaming Frog v24.3: What it does=per-page `.md` via a Readability.js + Turndown custom-JS snippet; llms.txt via n8n/CSV converters; Limits=no native llms.txt export; thin pages return nothing; JS rendering slow[^25][^26] — https://llms-explorer.com/reference/tooling/#4-crawl-based-generators-sites-you-do-not-own
- [parameter] `plainsignal/llmstxt` Chrome extension: What it does=llms.txt + one `.md` per page + zip from sitemap or rendered DOM; meta description as blockquote; Limits=10★, HTTPS only[^27] — https://llms-explorer.com/reference/tooling/#4-crawl-based-generators-sites-you-do-not-own
- [parameter] SEO-tool generators (SEOmator etc.): What it does=robots.txt → sitemap discovery, index-sitemap expansion, LLM-written title+description per URL; Limits=vendor-claimed mechanics only[^28] — https://llms-explorer.com/reference/tooling/#4-crawl-based-generators-sites-you-do-not-own
- [parameter] llms-text.com generator/validator: What it does=crawls a domain and exports llms.txt + llms-full.txt ("deep-crawls up to 50 subpages"); validator checks syntax, links, UTF-8, headers; Limits=vendor; its guidance: 10–20 evergreen URLs, 4–7 H2s, 10–20-word descriptions, index under 10 KB, `Content-Type: text/plain — https://llms-explorer.com/reference/tooling/#4-crawl-based-generators-sites-you-do-not-own
- [parameter] Yoast SEO ≥25.3 (2025-06-10): Emits=llms.txt only, regenerated weekly; Descriptions=custom excerpt only — **no description otherwise**; 5 latest posts/pages/CPT (≤12 months, cornerstone first) + top-5 taxonomies; Limits=5-item cap; markdown chars escaped; a static file wins over the dynamic one[^31][^32] — https://llms-explorer.com/reference/tooling/#5-cms-and-site-builders
- [parameter] Rank Math: Emits=llms.txt only; Descriptions="intro text"; post types/taxonomies, limit default 100; custom lines; Limits=no full[^33] — https://llms-explorer.com/reference/tooling/#5-cms-and-site-builders
- [parameter] AIOSEO: Emits=llms.txt (free); llms-full.txt + markdown post conversion (Pro); Descriptions=site title/tagline; per-post-type limits, exclusions; Limits=paywall[^34] — https://llms-explorer.com/reference/tooling/#5-cms-and-site-builders
- [parameter] `website-llms-txt`, `llms-full-txt-generator`: Emits=llms.txt (+ full); Descriptions=titles + SEO-plugin descriptions; honour noindex; Limits=one shipped a broken-access-control CVE fix[^35] — https://llms-explorer.com/reference/tooling/#5-cms-and-site-builders
- [parameter] Joost de Valk "Markdown Alternate": Emits=`<link rel="alternate" type="text/markdown">` + `.md` URLs per post; Descriptions=—; Limits=negotiation, not an index[^36] — https://llms-explorer.com/reference/tooling/#5-cms-and-site-builders
- [parameter] Webflow / Framer: Emits=host an uploaded file (Framer: Pro/Enterprise "Hosting → Files"); a Framer marketplace plugin scans the CMS; Descriptions=manual; Limits=no generation[^37][^38] — https://llms-explorer.com/reference/tooling/#5-cms-and-site-builders
- [parameter] Shopify (Apr–May 2026, silent): Emits=auto `/llms.txt`, `/llms-full.txt`, `/agents.md`, `/sitemap_agentic_discovery.xml`, `/.well-known/ucp` — **Liquid storefronts only** (headless Hydrogen/Oxygen get `/.well-known/ucp` alone); Descriptions=boilerplate: H1 store name, Shop-skill pitch, UCP + MCP endpoints, `/collections/all`, policies — **no contact details** (deliberately omitted; the file is… — https://llms-explorer.com/reference/tooling/#5-cms-and-site-builders
- [definition] Generation tooling — Generators compared; why extractive descriptions win. — https://llms-explorer.com/reference/tooling/#generation-tooling
- [definition] 6. Edge content negotiation — Cloudflare "Markdown for Agents" (2026-02-12; Pro/Business/Enterprise; zone toggle under AI Crawl Control): on `Accept: text/markdown` the edge converts HTML → markdown (body + meta-derived YAML frontmatter + JSON-LD, nav/header/footer/scripts dropped) and returns `Content-Type: text/markdown… — https://llms-explorer.com/reference/tooling/#6-edge-content-negotiation

## Usage: serving, discovering and reading llms files
<https://llms-explorer.com/reference/usage/>

- [parameter] `Content-Type`: Value=`text/markdown; charset=utf-8`; Why=attribute H2; `text/plain` is tolerated, HTML is a High — https://llms-explorer.com/reference/usage/#1-serving
- [parameter] `X-Markdown-Tokens`: Value=`bytes // 4` — the same estimator `manifest.json` uses; Why=H4: cost known before fetch — https://llms-explorer.com/reference/usage/#1-serving
- [parameter] `Link`: Value=`</llms.txt>; rel="describedby"` — the index that covers this file; Why=H3, spec v2 discovery — https://llms-explorer.com/reference/usage/#1-serving
- [parameter] `hub_docset_index(key)`: the docset's `llms.txt` (or `llms-small.txt`, `llms-facts.txt`, `manifest.json`, `<section>/llms.txt`), with served URLs — https://llms-explorer.com/reference/usage/#5-claude-code-and-mcp
- [parameter] `hub_query_docset(key, q, mode=semantic\|keyword\|hybrid, layer=auto\|facts\|raw)`: ranked units or chunks; `layer=auto` prefers the facts layer — https://llms-explorer.com/reference/usage/#5-claude-code-and-mcp
- [parameter] `hub_llms_full_read(key, page=…)` or `(offset, limit)`: one page or a slice of a mirrored `llms-full.txt` — https://llms-explorer.com/reference/usage/#5-claude-code-and-mcp
- [parameter] `hub_llms_full_list(query, category, status, min_pages)`: which sites publish a full file, with sizes — https://llms-explorer.com/reference/usage/#5-claude-code-and-mcp
- [definition] Usage: serving, discovering and reading llms files — The headers to send, the .md twins to publish, how a reader discovers the family, how an agent reads an index, and how Claude Code and the hub MCP tools consume one. — https://llms-explorer.com/reference/usage/#usage-serving-discovering-and-reading-llms-files
- [definition] 1. Serving — Every markdown file in the family is served with: — https://llms-explorer.com/reference/usage/#1-serving
- [definition] 2. Markdown twins — Every page in the content sections — reference, examples, blog — has a clean-markdown twin at the same route with `.md` appended: `/reference/usage/` → `/reference/usage.md`. — https://llms-explorer.com/reference/usage/#2-markdown-twins
- [definition] 4. Reading an index — The v2 consumption model: *view or search the index, then follow the relevant links; the detail lives behind the links and is fetched only when needed.* As a procedure: 1. Read the H1 and blockquote — is this the product you meant? — https://llms-explorer.com/reference/usage/#4-reading-an-index
- [definition] 5. Claude Code and MCP — Claude Code fetches an llms file when directed — Anthropic publishes its own docs index and points the agent at it, and the `Claude-Code` user agent shows up in server logs ahead of every AI retrieval bot but two. The pattern is a URL in a prompt or a `CLAUDE.md`, not automatic lookup. — https://llms-explorer.com/reference/usage/#5-claude-code-and-mcp

## Worked example: the Anthropic hiring concept pack
<https://llms-explorer.com/examples/anthropic-hiring-worked-example/>

- [definition] Worked example: the Anthropic hiring concept pack — How the Anthropic hiring concept pack in this repo was researched, structured, and source-rated — a worked example of the research-to-concept-pack workflow. — https://llms-explorer.com/examples/anthropic-hiring-worked-example/#worked-example-the-anthropic-hiring-concept-pack
- [definition] The question — Could this repo's own research-to-concept-pack workflow produce something worth trusting on a real subject, not just a demo subject? — https://llms-explorer.com/examples/anthropic-hiring-worked-example/#the-question
- [definition] Gathering the sources — The research step used `/dr` — firecrawl search first, with scrape as the fallback when a search snippet didn't carry enough of the page to cite confidently. — https://llms-explorer.com/examples/anthropic-hiring-worked-example/#gathering-the-sources
- [definition] Why the pack and the facts live in separate files — `llms-anthropic-hiring.txt` is meant to be read narratively: a 10-topic index (recruiter screen, technical assessment, system design, values interview, role variations, timeline, compensation, preparation, culture signals, best practices), then a section per topic with enough prose to orient a… — https://llms-explorer.com/examples/anthropic-hiring-worked-example/#why-the-pack-and-the-facts-live-in-separate-files
- [definition] Rating confidence — The pack-level rating stamped in `llms.txt` — "High confidence" — follows a specific rule: it holds when three or more independently produced sources agree on the same shape of the process and none contradicts it. — https://llms-explorer.com/examples/anthropic-hiring-worked-example/#rating-confidence
- [definition] How an agent uses it — Index, then topic, then facts. `llms.txt` carries one entry describing the pack's scope, audience, and confidence rating in a few lines — cheap enough to scan on every query. — https://llms-explorer.com/examples/anthropic-hiring-worked-example/#how-an-agent-uses-it
- [definition] What to copy for your own subject — Name the subject concretely enough to check. — https://llms-explorer.com/examples/anthropic-hiring-worked-example/#what-to-copy-for-your-own-subject

## Which layer answers which question
<https://llms-explorer.com/examples/decision-table/>

- [parameter] Orientation before any retrieval: what does this site cover, where do I start: layer=`llms.txt` (≤ 10 KB) then ≤ 2 hops to a `.md` twin; cost class=~3k tokens, 3 requests, 0 embeddings; recipe=recipe-01 — https://llms-explorer.com/examples/decision-table/#the-table
- [parameter] Orientation on a site whose index split into sections (`## Sections` present): layer=split root: root index → `<slug>/llms.txt` → page; cost class=~3–5k tokens, 3–4 requests; recipe=recipe-02 — https://llms-explorer.com/examples/decision-table/#the-table
- [parameter] An exact token: an env var, a flag, a header name, an error string: layer=keyword layer (`mode="keyword"`, FTS5/BM25) over `llms-facts.txt`; cost class=microseconds, 0 model tokens, 0 embeddings; recipe=recipe-03 — https://llms-explorer.com/examples/decision-table/#the-table
- [parameter] A paraphrased question, or mixed / unsure whether the words match the source: layer=hybrid (`mode="hybrid"`, RRF over keyword + vector), or vector alone (`layer="facts"`); cost class=1 embedding, 0 generation tokens; recipe=recipe-04 — https://llms-explorer.com/examples/decision-table/#the-table
- [parameter] An agent that must find the right page from an MCP client without a search index: layer=index-first via `hub_docset_index` → `sections` → section index → page; cost class=~2k tokens read per hop, 0 embeddings; recipe=recipe-05 — https://llms-explorer.com/examples/decision-table/#the-table
- [parameter] A scripted check or query from a shell or a CI step: layer=the `llmsx` CLI (today: the hub scripts it wraps); cost class=seconds; 0 model tokens for lint / keyword; recipe=recipe-06 — https://llms-explorer.com/examples/decision-table/#the-table
- [parameter] Citation-grade answers inside your own RAG store: layer=`llms-facts.txt` units, one document each, `url#anchor` as metadata; cost class=1 embedding per unit at ingest; ~845k tokens for a 191-page site; recipe=recipe-07 — https://llms-explorer.com/examples/decision-table/#the-table
- [parameter] Keeping a published file honest on every push: layer=the lint as a GitHub Action gate (exit 1 on High); cost class=~10 s per file; network only with `--check-links`; recipe=recipe-08 — https://llms-explorer.com/examples/decision-table/#the-table
- [parameter] Serving the files so agents and the lint can find them: layer=headers: `text/markdown`, `X-Markdown-Tokens`, `Link: rel="describedby"`, `rel="alternate"` on HTML; cost class=one config block; verify with `curl -I`; recipe=recipe-09 — https://llms-explorer.com/examples/decision-table/#the-table
- [parameter] Whole-corpus reasoning, offline and private, within a token budget: layer=a local hub: Ollama + indexer + keyword layer + `llms_serve.py`; `llms-small.txt` for budgeted reads; cost class=one machine; ~50k tokens per small read, 0 API spend; recipe=recipe-10 — https://llms-explorer.com/examples/decision-table/#the-table
- [parameter] One concept across many sources, disagreements visible: layer=a topical file (`/t/<slug>/`) built from a fact pool; cost class=minutes to build; `--no-embed` for 0 embeddings; recipe=recipe-11 — https://llms-explorer.com/examples/decision-table/#the-table
- [parameter] Disambiguation: which sense of a word this family means, and its aliases: layer=`llms-vocabulary.txt` senses and `aka:` expansion before FTS5; cost class=free: string match, 0 model tokens; recipe=recipe-12 — https://llms-explorer.com/examples/decision-table/#the-table
- [definition] Which layer answers which question — The decision table for the cookbook: match the shape of your question to the cheapest llms layer that answers it, then open the recipe. — https://llms-explorer.com/examples/decision-table/#which-layer-answers-which-question
- [definition] When the table is the wrong tool — If the question is "is this file any good", none of these rows apply — that is the [lint](/reference/passes/), not a retrieval. — https://llms-explorer.com/examples/decision-table/#when-the-table-is-the-wrong-tool

## Recipe 01 — Two hops with requests
<https://llms-explorer.com/examples/recipe-01/>

- [snippet] Steps: import re, requests — `import re, requests` — https://llms-explorer.com/examples/recipe-01/#steps
- [snippet] Expected output: https://llms-explorer.pages.dev/examples/recipe-09/ https://llms-explorer.pages.dev/examples/recipe-09.md — `https://llms-explorer.pages.dev/examples/recipe-09/ https://llms-explorer.pages.dev/examples/recipe-` — https://llms-explorer.com/examples/recipe-01/#expected-output
- [definition] Recipe 01 — Two hops with requests — Read a site's llms.txt, pick a page by its description, fetch the .md twin, answer. The baseline every other recipe is measured against. — https://llms-explorer.com/examples/recipe-01/#recipe-01-two-hops-with-requests

## Recipe 02 — Split root: follow a section index
<https://llms-explorer.com/examples/recipe-02/>

- [snippet] Steps: import re, requests — `import re, requests` — https://llms-explorer.com/examples/recipe-02/#steps
- [snippet] Expected output: ('Agent Sdk', 'agent-sdk/llms.txt') — `('Agent Sdk', 'agent-sdk/llms.txt')` — https://llms-explorer.com/examples/recipe-02/#expected-output
- [definition] Recipe 02 — Split root: follow a section index — When the root llms.txt has a ## Sections block, let the counts on each section line decide which section index to fetch before touching a page. — https://llms-explorer.com/examples/recipe-02/#recipe-02-split-root-follow-a-section-index

## Recipe 03 — Keyword layer from Claude Code
<https://llms-explorer.com/examples/recipe-03/>

- [snippet] Steps: hub_query_docset(docset="codeclaudecom__codeclaudecom", question="CLAUDE_CODE_SYNC_SKILLS", mode="keyword", top=3) — `hub_query_docset(docset="codeclaudecom__codeclaudecom", question="CLAUDE_CODE_SYNC_SKILLS", mode="ke` — https://llms-explorer.com/examples/recipe-03/#steps
- [snippet] Steps: { — `{` — https://llms-explorer.com/examples/recipe-03/#steps
- [snippet] Steps: hub_llms_full_read(key="code.claude.com__docs", page="https://code.claude.com/docs/en/env-vars") — `hub_llms_full_read(key="code.claude.com__docs", page="https://code.claude.com/docs/en/env-vars")` — https://llms-explorer.com/examples/recipe-03/#steps
- [snippet] Steps: { — `{` — https://llms-explorer.com/examples/recipe-03/#steps
- [snippet] Steps: .venv/bin/python scripts/docset_indexer.py keyword codeclaudecom__codeclaudecom "CLAUDE_CODE_SYNC_SKILLS" --layer facts — `.venv/bin/python scripts/docset_indexer.py keyword codeclaudecom__codeclaudecom "CLAUDE_CODE_SYNC_SK` — https://llms-explorer.com/examples/recipe-03/#steps
- [definition] Recipe 03 — Keyword layer from Claude Code — Find an exact token — an env var, a flag, an error string — with hub_query_docset(mode=\"keyword\"), then open the page it came from. Zero model tokens. — https://llms-explorer.com/examples/recipe-03/#recipe-03-keyword-layer-from-claude-code

## Recipe 04 — Hybrid: keyword and vector fused
<https://llms-explorer.com/examples/recipe-04/>

- [snippet] Steps: hub_query_docset( — `hub_query_docset(` — https://llms-explorer.com/examples/recipe-04/#steps
- [snippet] Steps: { — `{` — https://llms-explorer.com/examples/recipe-04/#steps
- [snippet] Steps: .venv/bin/python scripts/docset_indexer.py query   codeclaudecom__codeclaudecom "which environment variable downloads my — `.venv/bin/python scripts/docset_indexer.py query   codeclaudecom__codeclaudecom "which environment v` — https://llms-explorer.com/examples/recipe-04/#steps
- [definition] Recipe 04 — Hybrid: keyword and vector fused — For a paraphrased or uncertain question, mode=\"hybrid\" runs the keyword and vector legs and fuses them with reciprocal-rank fusion; legs == 2 tells you both agreed on a hit. — https://llms-explorer.com/examples/recipe-04/#recipe-04-hybrid-keyword-and-vector-fused

## Recipe 05 — Index-first agent over MCP
<https://llms-explorer.com/examples/recipe-05/>

- [snippet] Steps: hub_docset_index(docset="codeclaudecom__codeclaudecom") — `hub_docset_index(docset="codeclaudecom__codeclaudecom")` — https://llms-explorer.com/examples/recipe-05/#steps
- [snippet] Steps: { — `{` — https://llms-explorer.com/examples/recipe-05/#steps
- [snippet] Steps: hub_docset_index(docset="codeclaudecom__codeclaudecom", file="agent-sdk/llms.txt") — `hub_docset_index(docset="codeclaudecom__codeclaudecom", file="agent-sdk/llms.txt")` — https://llms-explorer.com/examples/recipe-05/#steps
- [snippet] Steps: { — `{` — https://llms-explorer.com/examples/recipe-05/#steps
- [definition] Recipe 05 — Index-first agent over MCP — hub_docset_index → read sections → the section's llms.txt → the page. The pattern a concept-tree node page uses to find a source without any search index. — https://llms-explorer.com/examples/recipe-05/#recipe-05-index-first-agent-over-mcp

## Recipe 06 — The llmsx CLI
<https://llms-explorer.com/examples/recipe-06/>

- [snippet] Steps: llmsx lint ./docs/llms.txt --json — `llmsx lint ./docs/llms.txt --json` — https://llms-explorer.com/examples/recipe-06/#steps
- [snippet] Steps: llmsx query code.claude.com "CLAUDE_CODE_SYNC_SKILLS" --mode keyword — `llmsx query code.claude.com "CLAUDE_CODE_SYNC_SKILLS" --mode keyword` — https://llms-explorer.com/examples/recipe-06/#steps
- [snippet] Steps: llmsx export mirrors/code.claude.com.md — `llmsx export mirrors/code.claude.com.md` — https://llms-explorer.com/examples/recipe-06/#steps
- [snippet] Steps: llmsx tree show "llms.txt" — `llmsx tree show "llms.txt"` — https://llms-explorer.com/examples/recipe-06/#steps
- [snippet] Expected output: $ llmsx lint site/dist/llms.txt site/dist/llms-facts.txt --json | jq -c '.[] | {file, high: .counts.high}' — `$ llmsx lint site/dist/llms.txt site/dist/llms-facts.txt --json | jq -c '.[] | {file, high: .counts.` — https://llms-explorer.com/examples/recipe-06/#expected-output
- [definition] Recipe 06 — The llmsx CLI — Lint, query, export and inspect the tree from a shell: the llmsx commands and the hub scripts each one wraps today. — https://llms-explorer.com/examples/recipe-06/#recipe-06-the-llmsx-cli

## Recipe 07 — Facts into a RAG store
<https://llms-explorer.com/examples/recipe-07/>

- [snippet] Steps: import hashlib, re — `import hashlib, re` — https://llms-explorer.com/examples/recipe-07/#steps
- [snippet] Steps: import chromadb, requests — `import chromadb, requests` — https://llms-explorer.com/examples/recipe-07/#steps
- [snippet] Expected output: {'type': 'parameter', 'url': 'https://code.claude.com/docs/en/admin-setup', 'anchor': 'set-up-claude-code-for-your-organ — `{'type': 'parameter', 'url': 'https://code.claude.com/docs/en/admin-setup', 'anchor': 'set-up-claude` — https://llms-explorer.com/examples/recipe-07/#expected-output
- [definition] Recipe 07 — Facts into a RAG store — Parse llms-facts.txt with UNIT_RE, one document per unit with its url#anchor as metadata, embed with mxbai-embed-large — and never mix it with a 768-dimension model. — https://llms-explorer.com/examples/recipe-07/#recipe-07-facts-into-a-rag-store

## Recipe 08 — GitHub Action lint gate
<https://llms-explorer.com/examples/recipe-08/>

- [snippet] Steps: name: llms lint — `# .github/workflows/llms-lint.yml` — https://llms-explorer.com/examples/recipe-08/#steps
- [snippet] Expected output: [ — `[` — https://llms-explorer.com/examples/recipe-08/#expected-output
- [snippet] Expected output: {"pass": "P0", "attr": "I6", "severity": "high", "line": 0, — `{"pass": "P0", "attr": "I6", "severity": "high", "line": 0,` — https://llms-explorer.com/examples/recipe-08/#expected-output
- [definition] Recipe 08 — GitHub Action lint gate — Fail a pull request on any High finding in your llms files, and annotate the offending lines from the lint's JSON. — https://llms-explorer.com/examples/recipe-08/#recipe-08-github-action-lint-gate

## Recipe 09 — Serving with the right headers
<https://llms-explorer.com/examples/recipe-09/>

- [snippet] Steps: types { text/markdown md; } — `# inside the server {} block` — https://llms-explorer.com/examples/recipe-09/#steps
- [snippet] Steps: /*.md — `/*.md` — https://llms-explorer.com/examples/recipe-09/#steps
- [snippet] Steps: curl -sI https://docs.example.com/reference/attributes.md | grep -iE '^(content-type|x-markdown-tokens|link):' — `curl -sI https://docs.example.com/reference/attributes.md | grep -iE '^(content-type|x-markdown-toke` — https://llms-explorer.com/examples/recipe-09/#steps
- [snippet] Expected output: content-type: text/markdown; charset=utf-8 — `content-type: text/markdown; charset=utf-8` — https://llms-explorer.com/examples/recipe-09/#expected-output
- [snippet] Expected output: link: </reference/attributes.md>; rel="alternate"; type="text/markdown" — `link: </reference/attributes.md>; rel="alternate"; type="text/markdown"` — https://llms-explorer.com/examples/recipe-09/#expected-output
- [definition] Recipe 09 — Serving with the right headers — nginx and Cloudflare _headers blocks that serve .md twins as text/markdown with X-Markdown-Tokens and the two Link relations, verified with curl -I. — https://llms-explorer.com/examples/recipe-09/#recipe-09-serving-with-the-right-headers

## Recipe 10 — A local hub in miniature
<https://llms-explorer.com/examples/recipe-10/>

- [snippet] Steps: ollama pull mxbai-embed-large — `ollama pull mxbai-embed-large` — https://llms-explorer.com/examples/recipe-10/#steps
- [snippet] Steps: python3 scripts/llms_acquire.py https://code.claude.com/docs mirrors/code.claude.com.md — `python3 scripts/llms_acquire.py https://code.claude.com/docs mirrors/code.claude.com.md` — https://llms-explorer.com/examples/recipe-10/#steps
- [snippet] Steps: PYTHONPATH=scripts .venv/bin/python -m docset_refine all --no-units mirrors/code.claude.com.md — `PYTHONPATH=scripts .venv/bin/python -m docset_refine all --no-units mirrors/code.claude.com.md` — https://llms-explorer.com/examples/recipe-10/#steps
- [snippet] Steps: .venv/bin/python scripts/docset_indexer.py index mirrors/code.claude.com.md --name code.claude.com — `.venv/bin/python scripts/docset_indexer.py index mirrors/code.claude.com.md --name code.claude.com` — https://llms-explorer.com/examples/recipe-10/#steps
- [snippet] Steps: .venv/bin/python scripts/llms_serve.py --host 127.0.0.1 --port 8788 — `.venv/bin/python scripts/llms_serve.py --host 127.0.0.1 --port 8788` — https://llms-explorer.com/examples/recipe-10/#steps
- [snippet] Steps: .venv/bin/python scripts/docset_indexer.py keyword code.claude.com "CLAUDE_CODE_SYNC_SKILLS" --layer facts --mode phrase — `.venv/bin/python scripts/docset_indexer.py keyword code.claude.com "CLAUDE_CODE_SYNC_SKILLS" --layer` — https://llms-explorer.com/examples/recipe-10/#steps
- [snippet] Expected output: HTTP/1.0 200 OK — `HTTP/1.0 200 OK` — https://llms-explorer.com/examples/recipe-10/#expected-output
- [definition] Recipe 10 — A local hub in miniature — Ollama, the docset indexer, a keyword layer and llms_serve.py on one machine: the whole retrieval stack for one family, offline and private. — https://llms-explorer.com/examples/recipe-10/#recipe-10-a-local-hub-in-miniature

## Recipe 11 — Building a topical file
<https://llms-explorer.com/examples/recipe-11/>

- [snippet] Steps: PYTHONPATH=scripts .venv/bin/python -m docset_refine topical \ — `PYTHONPATH=scripts .venv/bin/python -m docset_refine topical \` — https://llms-explorer.com/examples/recipe-11/#steps
- [snippet] Steps: .venv/bin/python scripts/llms_lint.py check llms-topical/prompt-caching.llms/ --json — `.venv/bin/python scripts/llms_lint.py check llms-topical/prompt-caching.llms/ --json` — https://llms-explorer.com/examples/recipe-11/#steps
- [definition] Recipe 11 — Building a topical file — docset_refine topical turns a fact pool into a concept-axis llms.txt + llms-facts.txt with the subject's child concepts as sections; then /ldo --agent-test checks an agent can actually use it. — https://llms-explorer.com/examples/recipe-11/#recipe-11-building-a-topical-file

## Recipe 12 — Reading a vocabulary
<https://llms-explorer.com/examples/recipe-12/>

- [snippet] Steps: import re, requests — `import re, requests` — https://llms-explorer.com/examples/recipe-12/#steps
- [snippet] Expected output: ("/llms.txt" OR "/llmstxt" OR "llms.txt") discovery — `("/llms.txt" OR "/llmstxt" OR "llms.txt") discovery` — https://llms-explorer.com/examples/recipe-12/#expected-output
- [snippet] Expected output: - **cookie** [web.cookie] · [folklore.cookie-monster] · [food.cookie]: … — `- **cookie** [web.cookie] · [folklore.cookie-monster] · [food.cookie]: …` — https://llms-explorer.com/examples/recipe-12/#expected-output
- [definition] Recipe 12 — Reading a vocabulary — Expand a query through a family's aka: list before the FTS5 lookup, and pin the sense the family means. Free: string matching, no model. — https://llms-explorer.com/examples/recipe-12/#recipe-12-reading-a-vocabulary

## A Closed-Loop System for Autonomous Skill-Knowledge Acquisition
<https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/>

- [snippet] 2. System architecture: ┌──────────────────────────────────────────────────────────┐ — `                ┌──────────────────────────────────────────────────────────┐` — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#2-system-architecture
- [snippet] 3.1 Node schema: { — `{` — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#31-node-schema
- [parameter] `concept-family-explorer`: Job=decide *what to build*; Scope per invocation=a whole family; Reads=the tree (coverage); Writes=nodes + parent/child links — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#2-system-architecture
- [parameter] `/dr`: Job=*build one thing* well; Scope per invocation=a single concept; Reads=the web; Writes=one node + one skill — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#2-system-architecture
- [parameter] concept tree: Job=*remember everything*; Scope per invocation=the whole hub; Reads=—; Writes=— (it is the store) — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#2-system-architecture
- [parameter] Node.js Concurrency Internals: researchedAt=2026-06-01; sources=11 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#62-the-nodejs-core-family-10-20-spokes
- [parameter] JS/TS Runtimes (Deno, Bun, Edge) & WinterTC: researchedAt=2026-06-01; sources=17 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#62-the-nodejs-core-family-10-20-spokes
- [parameter] Node.js Native TypeScript, Permission Model & SEA: researchedAt=2026-06-01; sources=9 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#62-the-nodejs-core-family-10-20-spokes
- [parameter] Node.js Module Resolution & ESM/CJS Interop: researchedAt=2026-06-02; sources=7 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#62-the-nodejs-core-family-10-20-spokes
- [parameter] Node.js HTTP & Networking: researchedAt=2026-06-02; sources=10 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#62-the-nodejs-core-family-10-20-spokes
- [parameter] Node.js Modern Batteries-Included Built-ins: researchedAt=2026-06-02; sources=19 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#62-the-nodejs-core-family-10-20-spokes
- [parameter] Node.js Async Control-Flow, Errors & Context: researchedAt=2026-06-02; sources=8 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#62-the-nodejs-core-family-10-20-spokes
- [parameter] Node.js Built-in Test Runner (node:test): researchedAt=2026-06-02; sources=6 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#62-the-nodejs-core-family-10-20-spokes
- [parameter] Node.js Package Management & Supply-Chain: researchedAt=2026-06-02; sources=13 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#62-the-nodejs-core-family-10-20-spokes
- [parameter] Node.js Production Diagnostics & Profiling: researchedAt=2026-06-02; sources=7 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#62-the-nodejs-core-family-10-20-spokes
- [parameter] 15:09:51: Concept / skill=`mongodb-backup-restore`; child concepts=9; sources=20 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:11:05: Concept / skill=`mongodb-upgrade-paths`; child concepts=**33**; sources=20 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:12:34: Concept / skill=`mongodb-aggregation-pipeline`; child concepts=10; sources=11 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:16:04: Concept / skill=`mongodb-migration-patterns`; child concepts=10; sources=10 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:22:05: Concept / skill=`mongodb-cost-optimization`; child concepts=12; sources=— — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:23:05: Concept / skill=`mongodb-atlas-multicloud`; child concepts=12; sources=10 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:25:53: Concept / skill=`mongodb-indexes-deep`; child concepts=**17**; sources=19 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:30:15: Concept / skill=`mongodb-monitoring-observability`; child concepts=—; sources=— — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:31:25: Concept / skill=`mongodb-geospatial`; child concepts=10; sources=6 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:31:37: Concept / skill=`mongodb-atlas-stream-processing`; child concepts=12; sources=4 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:31:42: Concept / skill=`mongodb-realm-mobile-sync`; child concepts=11; sources=— — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:32:08: Concept / skill=`mongodb-atlas-triggers-functions`; child concepts=12; sources=7 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:33:10: Concept / skill=`mongodb-compliance`; child concepts=12; sources=1 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:34:27: Concept / skill=`mongodb-transactions`; child concepts=10; sources=6 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:34:29: Concept / skill=`mongodb-atlas-charts`; child concepts=11; sources=1 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 15:41:33: Concept / skill=`mongodb-capacity-planning`; child concepts=12; sources=6 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] 16:41:35: Concept / skill=`mongodb-kafka-connector`; child concepts=15; sources=18 — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [parameter] Total concept-tree nodes: Value=431; Source=`tam_concept_tree_list` (`total`) — live — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] Total registry skills: Value=477; Source=`tam_recommend_skills` (`total`) — live — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] `TypeScript Expert` child concepts / sources / refresh: Value=13 / 105 / 2026-06-04; Source=`tam_concept_tree_list` — live — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] TypeScript run sequence (1→10 spokes, 4→13, two runs): Value=—; Source=run-history — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] `JavaScript and Node.js` sources: Value=131; Source=`tam_concept_tree_list` — live — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] Node.js new spokes + timestamps + per-node sources: Value=per §6.2 table; Source=`tam_concept_tree_search` — live — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] Node.js 10→20 spokes, 2026-06-02 saturation: Value=—; Source=run-history — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] MongoDB cascade concepts, timestamps, child/source counts: Value=per §6.3 table; Source=`tam_concept_tree_list` — live — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] `mongodb-upgrade-paths` 33 children / `mongodb-indexes-deep` 17: Value=33 / 17; Source=`tam_concept_tree_list` — live — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] Markdown family: 8 children, all `skillId: document-formats`, 2026-06-03: Value=8; Source=`tam_concept_tree_search` — live — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] LLM concepts with `parentConcept` llm-models but `skillId` ai-agent-engineering: Value=—; Source=`tam_concept_tree_search` — live — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] Hub-index reduction 413→187: Value=—; Source=run-history — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] Coverage-saturation threshold ≈3.2: Value=—; Source=run-history — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] Parallel-author / serial-write RMW lesson: Value=—; Source=run-history — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] Auto-builder vs manual-run collision & unpinned-build pruning: Value=—; Source=run-history — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers
- [parameter] Breadth loop: Skill / tool id=`concept-family-explorer`; One-line role=Map a family, score gaps, loop `/dr` to saturation — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-b-component-reference
- [parameter] Depth worker: Skill / tool id=`/dr` (deep-research-build); One-line role=Research → author skill → install → cross-link → write back — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-b-component-reference
- [parameter] Research engine: Skill / tool id=`deep-research`; One-line role=Multi-source cited research (firecrawl/exa, web fallback) — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-b-component-reference
- [parameter] Shared ledger: Skill / tool id=concept tree via `tam_concept_tree_{list,get,search,upsert,link,delete}`; One-line role=Persistent graph of researched concepts — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-b-component-reference
- [parameter] Tree↔skill join: Skill / tool id=`skillId` field; One-line role=Many concept nodes → one hub skill — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-b-component-reference
- [parameter] Catalog shape: Skill / tool id=`skill-tree-architect`; One-line role=Fold saturated families into hubs; keep the scan surface flat — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-b-component-reference
- [parameter] Terminal quality gate: Skill / tool id=`skill-optimizer` + `prompt-deep-optimizer`; One-line role=Audit/verify/tighten new skills after saturation — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-b-component-reference
- [definition] A Closed-Loop System for Autonomous Skill-Knowledge Acquisition — A June 2026 report traces concept-family-explorer, the concept tree, and /dr through recorded TypeScript, Node.js, and MongoDB skill builds. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#a-closed-loop-system-for-autonomous-skill-knowledge-acquisition
- [definition] Abstract (BLUF) — An LLM agent that researches one topic at a time gets *deeper*; it does not get *broader*. Depth alone leaves blind spots — the agent never learns what it does not know to ask. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#abstract-bluf
- [definition] 1. The problem: breadth is not the same as depth — Consider the ordinary way an agent acquires expertise. A user asks about TypeScript declaration files; the agent researches declaration files; the agent is now better at declaration files. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#1-the-problem-breadth-is-not-the-same-as-depth
- [definition] 2. System architecture — The three components form a loop. CFE runs the outer cycle (breadth), `/dr` runs the inner unit of work (depth), and the concept tree is the state both read from and write to. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#2-system-architecture
- [definition] 3. The concept tree: the shared-state ledger — The concept tree is the component that makes the other two work, and it is the easiest to overlook because it does no "thinking." It is a persistent graph stored in the mdb-context-hub and reached through six MCP tools: `tam_concept_tree_list`, `_get`, `_search`, `_upsert`, `_link`, and `_delete`. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#3-the-concept-tree-the-shared-state-ledger
- [definition] 3.1 Node schema — Every node is one researched concept: — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#31-node-schema
- [definition] 3.2 The tree is not the skill registry — It is tempting to assume one concept \= one skill. It is not. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#32-the-tree-is-not-the-skill-registry
- [definition] 3.3 What the tree is *for* — The ledger plays two roles that the breadth loop depends on completely: 1. **The saturation oracle.** "Is this family done?" is answerable only against a record of what is already covered. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#33-what-the-tree-is-for
- [definition] 4. `/dr`: the depth worker — `/dr` is the unit of production. Its contract is narrow on purpose: take one named topic, return one durable skill, and leave the tree richer than it found it. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#4-dr-the-depth-worker
- [definition] 5. `concept-family-explorer`: the breadth loop — CFE sits one level *above* `/dr`. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#5-concept-family-explorer-the-breadth-loop
- [definition] 5.1 The algorithm — **(1) Map the family.** Given a subject, CFE enumerates five neighborhoods around it: - the **parent** domain it belongs to, - its **siblings** (peers under the same parent), - its **sub-concepts** (children — the decomposition), - **adjacent / cross-over** fields (neighbors in other families that… — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#51-the-algorithm
- [definition] 5.2 Why the separation matters — Because CFE never does research itself, it can reason about a whole family cheaply — a tree diff plus a scoring pass — and spend the expensive web-research budget only where the score justifies it. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#52-why-the-separation-matters
- [definition] 6. Worked examples (from the live tree) — The four expansions below are real. Counts and timestamps were read from the tree while drafting this paper; see Appendix A. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#6-worked-examples-from-the-live-tree
- [definition] 6.1 The TypeScript language subtree — saturating over two runs — At the 2026-06-17 snapshot, `TypeScript Expert` (`skillId: typescript-expert`) held **13 child concepts** and carries 105 sources, last refreshed **2026-06-04**. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#61-the-typescript-language-subtree-saturating-over-two-runs
- [definition] 6.2 The Node.js core family — 10 → 20 spokes — `JavaScript and Node.js` (`skillId: javascript-nodejs`, 131 sources) anchors a family that CFE drove to core-family saturation on **2026-06-02**, *adding ten new spokes and taking the family from 10 to 20 references* *(run-history)*. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#62-the-nodejs-core-family-10-20-spokes
- [definition] 6.3 The MongoDB build cascade — a saturation run you can timestamp — The single most legible example is the MongoDB expansion of **2026-05-28**, because the `researchedAt` stamps show when the ledger recorded each skill. They do not establish worker start times, total build duration, or independent skill quality. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#63-the-mongodb-build-cascade-a-saturation-run-you-can-timestamp
- [definition] 6.4 Saturate, then fold: markdown → `document-formats` — §3.2 introduced the markdown family as proof that concepts ≠ skills. As a CFE outcome it shows the *terminal* move of a saturation run. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#64-saturate-then-fold-markdown-document-formats
- [definition] 6.5 Cross-hub placement: the LLM model layer — A last nuance the tree exposes: a concept's *conceptual* parent and its *owning* skill can differ. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#65-cross-hub-placement-the-llm-model-layer
- [definition] 7. Results — and what "meaningful" means here — The headline figures, read live while drafting: **431 concept nodes** in the tree and **477 skills** in the registry. But raw counts are the least interesting measure. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#7-results-and-what-meaningful-means-here
- [definition] 8. Limitations and failure modes — This system is not magic, and its sharp edges are worth stating plainly. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#8-limitations-and-failure-modes
- [definition] 8.1 Concurrency: the scheduled builder vs. the manual run — The most consequential failure mode: an **active scheduled CFE/auto-hub run and a manual run on the same subject collide** *(run-history)*. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#81-concurrency-the-scheduled-builder-vs-the-manual-run
- [definition] 8.2 The write-back is an unlocked read-modify-write — As noted in §4, the manifest edit during `/dr` write-back is an RMW with no lock. Parallelizing the *write* (as opposed to the research) corrupts it. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#82-the-write-back-is-an-unlocked-read-modify-write
- [definition] 8.3 Saturation is a judgment call — The stop condition is a score threshold, and the threshold (≈3.2 in one recorded run) *(run-history)* is tuned, not derived. Set it too high and families are abandoned with real gaps; too low and the loop chases diminishing concepts. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#83-saturation-is-a-judgment-call
- [definition] 8.4 Source-count is a proxy, not a guarantee — `sourcesCount` measures how many citations `/dr` gathered, not whether the synthesis is correct. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#84-source-count-is-a-proxy-not-a-guarantee
- [definition] 8.5 Provenance honesty — Several figures in this paper (the 1→10 and 10→20 spoke counts, the 413→187 index reduction, the 3.2 threshold, the parallel-author/serial-write lesson) come from **run-history, not a live tree query**, and are flagged as such. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#85-provenance-honesty
- [definition] 9. Conclusion — The design idea worth taking away is the **three-way separation of breadth, depth, and memory**, with the concept tree serving as the coverage ledger while installed skills and manifests remain durable too. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#9-conclusion
- [definition] Appendix A — Provenance of cited numbers — All figures labeled live were read via the mdb-context-hub `tam_concept_tree_*` MCP tools while drafting (2026-06-17). These records describe pipeline activity and stored metadata; they are not an independent performance or skill-quality benchmark. — https://llms-explorer.com/blog/a-closed-loop-system-for-autonomous-skill-knowledge-acquisition/#appendix-a-provenance-of-cited-numbers

## Abstracting one concept out of many docsets
<https://llms-explorer.com/blog/abstracting-one-concept/>

- [snippet] Commands: S=~/.claude/skills/llms-concept-abstractor/scripts/concept_abstract.py — `# cwd: ~/.global-ai-hub  (the skill's script; /lca wraps these steps for an agent)` — https://llms-explorer.com/blog/abstracting-one-concept/#commands
- [parameter] eval-1 with skill: Model tokens=336,335; Wall time=718 s; Grade=7/7 — https://llms-explorer.com/blog/abstracting-one-concept/#outputs
- [parameter] eval-1 baseline (ordinary tools): Model tokens=376,182; Wall time=571 s; Grade=3/7 — https://llms-explorer.com/blog/abstracting-one-concept/#outputs
- [parameter] eval-2 with skill (scope discovery): Model tokens=496,462; Wall time=2,281 s; Grade=6/6 — https://llms-explorer.com/blog/abstracting-one-concept/#outputs
- [definition] Abstracting one concept out of many docsets — Two August 2026 /lca evaluations build indexing and prompt-caching packs with lexicons and local embeddings, reporting task grades, runtime tradeoffs, and later cleanup. — https://llms-explorer.com/blog/abstracting-one-concept/#abstracting-one-concept-out-of-many-docsets

## Anchors that point nowhere
<https://llms-explorer.com/blog/anchors-that-point-nowhere/>

- [snippet] Commands: .venv/bin/python scripts/llms_lint.py check text-mirror/code.claude.com.llms/ \ — `# cwd: ~/.global-ai-hub` — https://llms-explorer.com/blog/anchors-that-point-nowhere/#commands
- [definition] Anchors that point nowhere — How raw-mirror heading checks corrected recorded anchor failures, and why those checks do not prove that every link works on the live rendered site. — https://llms-explorer.com/blog/anchors-that-point-nowhere/#anchors-that-point-nowhere

## Automated Auditing and Security-First Software Design
<https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/>

- [parameter] **SCA** (Software Composition Analysis): Question it answers=Do my dependencies have known CVEs?; Typical stage=PR + scheduled; Representative tools=Dependabot, `npm audit`, OWASP Dependency-Check, Snyk — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#4-automated-auditing-the-pipeline-half
- [parameter] **SAST** (Static Application Security Testing): Question it answers=Does my source contain a vulnerable pattern?; Typical stage=PR; Representative tools=CodeQL, Semgrep, SonarQube — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#4-automated-auditing-the-pipeline-half
- [parameter] **Secret scanning**: Question it answers=Did someone commit a credential?; Typical stage=Pre-commit + PR + history; Representative tools=gitleaks, trufflehog, GitHub secret scanning — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#4-automated-auditing-the-pipeline-half
- [parameter] **IaC scanning**: Question it answers=Is my Terraform/K8s config insecure?; Typical stage=PR; Representative tools=Checkov, tfsec, Trivy — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#4-automated-auditing-the-pipeline-half
- [parameter] **Container/image scanning**: Question it answers=Does my base image carry known CVEs?; Typical stage=Build; Representative tools=Trivy, Grype, Clair — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#4-automated-auditing-the-pipeline-half
- [parameter] **DAST** (Dynamic): Question it answers=Is the *running* app exploitable?; Typical stage=Staging; Representative tools=OWASP ZAP, Burp — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#4-automated-auditing-the-pipeline-half
- [parameter] **Policy as code**: Question it answers=Does this change violate an org rule?; Typical stage=PR + admission; Representative tools=OPA/Conftest, custom checks — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#4-automated-auditing-the-pipeline-half
- [parameter] **False positives**: Why it is real=SAST especially; erodes trust and trains bypass behavior; Mitigation=Advisory-first; curate rules; promote to blocking only when trusted — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#7-costs-and-honest-limits
- [parameter] **Gate friction**: Why it is real=Every blocking check is latency on the critical path of shipping; Mitigation=Fast checks on PR, slow checks scheduled; parallelize; cache — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#7-costs-and-honest-limits
- [parameter] **Tool sprawl**: Why it is real=Each scanner is config, findings, and a dashboard to maintain; Mitigation=Consolidate where possible; not every category needs a tool on day one — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#7-costs-and-honest-limits
- [parameter] **Automation's ceiling**: Why it is real=Scanners find *known* patterns and *known* CVEs — coverage of novel design flaws and business-logic abuse is incomplete; Mitigation=Keep human threat modeling and periodic pentests; automation augments, never replaces — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#7-costs-and-honest-limits
- [parameter] **Provenance is young**: Why it is real=SBOM/SLSA tooling and norms are still settling in 2026; Mitigation=Adopt incrementally; treat as a maturing capability, not a finished one — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#7-costs-and-honest-limits
- [definition] Automated Auditing and Security-First Software Design — Security design and CI auditing through a June mdb-context-hub case study, distinguishing documented controls from enforcement and coverage. — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#automated-auditing-and-security-first-software-design
- [definition] 1. The problem: security bolted on is security that fails — Security was historically the last gate before release: a penetration test in the final sprint, a manual audit against a standard, a sign-off from a team that did not write the code. Three forces have broken that model. — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#1-the-problem-security-bolted-on-is-security-that-fails
- [definition] 2. Why the usual approaches fall short — Before proposing a model, an honest review of the approaches teams actually use, and where each runs out. — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#2-why-the-usual-approaches-fall-short
- [definition] 3. Security-first design: the architectural half — "Secure by design" is older than DevSecOps. — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#3-security-first-design-the-architectural-half
- [definition] 4. Automated auditing: the pipeline half — Automated auditing moves the checklist into CI/CD and runs it on every change. The toolchain has well-defined categories, each answering a different question and fitting a different stage: — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#4-automated-auditing-the-pipeline-half
- [definition] 6. Implementation: a staged adoption path — Security-first practice fails most often from being adopted all at once. A workable sequence: 1. — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#6-implementation-a-staged-adoption-path
- [definition] 8. Conclusion and next steps — Security stops being a periodic event and becomes a property of the system when two things are true at once: the architecture is designed to be secure (least privilege, secure defaults, a known trust boundary, threat-modeled at design time), and the pipeline audits every change automatically… — https://llms-explorer.com/blog/automated-auditing-and-security-first-software-design/#8-conclusion-and-next-steps

## Building Codebases for Machine Collaborators
<https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/>

- [parameter] Automated documentation: What it buys the agent=Docs that cannot silently lie; mdb-tam implementation=`scripts/generate-ops-registry-doc.mjs` → `docs/operations-registry.json` (18 ops, from `server/src/lib/operations-registry.js`), `--check` CI drift gate; `generate_llm_repo_index.py`; `rotate-workflow-logs.mjs`; Status=Active — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#8-the-practices-as-implemented
- [parameter] Documentation as architecture: What it buys the agent=A control surface the agent acts through; mdb-tam implementation=`CLAUDE.md` (authoritative, loaded every session), `AGENTS.md` (13-agent catalog over `.claude/agents/`), `GEMINI.md` (defers to `CLAUDE.md`), per-dir `README.md`; Status=Active — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#8-the-practices-as-implemented
- [parameter] Retrieval index (curated): What it buys the agent=Judgment about which files matter and how to run them; mdb-tam implementation=`docs/high_signal_file_index.json` — 491 entries w/ `how_to_run`, `inputs/outputs`, `risk_notes`; Status=Active — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#8-the-practices-as-implemented
- [parameter] Retrieval index (generated): What it buys the agent=Complete, regenerable coverage map; mdb-tam implementation=`docs/llm-repo-index.json` (758 files / 96 dirs) + `llm-repo-index.md`; Status=Active — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#8-the-practices-as-implemented
- [parameter] Index integrity gate: What it buys the agent=An index that cannot rot into a trap; mdb-tam implementation=`scripts/check-doc-indexes.mjs` — validates 491 + 758 paths, CI-fails on dead paths, `--prune`; Status=Active — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#8-the-practices-as-implemented
- [parameter] Structured server logging: What it buys the agent=Observability of runtime the agent can't watch; mdb-tam implementation=`server/src/telemetry/logger.js` — `pino` + scoped `logger.child({ scope })`; Status=Active — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#8-the-practices-as-implemented
- [parameter] Structured client logging: What it buys the agent=Bounded, schema'd, multi-sink error record; mdb-tam implementation=`src/background/error-log.js` (v1 schema, 1000-entry ring buffer, Sentry-lite + file sinks); Status=Active — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#8-the-practices-as-implemented
- [parameter] Log-triggered remediation: What it buys the agent=A log that closes the loop; mdb-tam implementation=`error-log.js` Copilot-CLI auto-remediation path (internal repo, 180 s); Status=Active (opt-in) — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#8-the-practices-as-implemented
- [parameter] Test suite: What it buys the agent=Converts agent output from plausible to verified; mdb-tam implementation=707 tests / 4 suites (294 / 346 / 30 / 37), 3 CI workflows; Status=Active — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#8-the-practices-as-implemented
- [parameter] Substrate-aware harness: What it buys the agent=Extension/server logic testable headlessly; mdb-tam implementation=`test/setup.js` chrome shims; `mongodb-memory-server` graceful-skip; Status=Active — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#8-the-practices-as-implemented
- [parameter] Dual-mode capability (CLI+API+MCP): What it buys the agent=One tested core, reachable by test and agent alike; mdb-tam implementation=CallCard `cli/call.js` + `routes/call.js` + `mcp/call-mcp-server.js`; corpus/reports API + thin `mcp-server/client.js`; Live Hub Toolkit `src/core` + `cli/` + native bridge; Status=Active — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#8-the-practices-as-implemented
- [parameter] `scripts/generate-ops-registry-doc.mjs`: Practice=Automated docs; Role=Sole writer of `docs/operations-registry.json`; `--check` CI drift gate — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `server/src/lib/operations-registry.js`: Practice=Automated docs; Role=Source of truth (18 operations) for the generated doc — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `scripts/generate_llm_repo_index.py`: Practice=Automated docs; Role=Regenerates the machine-readable repo index — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `scripts/rotate-workflow-logs.mjs`: Practice=Automated docs; Role=Bounds append-only journals (keeps the latest version sections in the root; archives older sections to `docs/archive/`) — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `CLAUDE.md` (root + `~/.claude/CLAUDE.md`): Practice=Docs as architecture; Role=Authoritative rules, loaded in full every session — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `AGENTS.md` + `.claude/agents/`: Practice=Docs as architecture; Role=Catalog + definitions of the 13 repo-local agents — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `GEMINI.md`: Practice=Docs as architecture; Role=Harness-specific deltas; defers to `CLAUDE.md` — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `docs/high_signal_file_index.json`: Practice=Retrieval index; Role=491 curated entries with `how_to_run` / `risk_notes` — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `docs/llm-repo-index.json` + `.md`: Practice=Retrieval index; Role=758-file generated coverage map + human entrypoint — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `scripts/check-doc-indexes.mjs`: Practice=Retrieval index; Role=Validates 491 + 758 paths; CI-fails on dead paths — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] tam-MCP registries: Practice=Retrieval index; Role=Searchable skills / prompts / agents / URLs (capability findable) — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `server/src/telemetry/logger.js`: Practice=Logging; Role=`pino` structured JSON + scoped `logger.child({ scope })` — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `src/background/error-log.js`: Practice=Logging; Role=v1-schema, 1000-entry ring buffer; Sentry-lite + file sinks; Copilot remediation path — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `src/shared/error-log-client.js`, `src/content/shared/error-log-adapter.js`: Practice=Logging; Role=Shared client + content-script adapter — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `test/setup.js`: Practice=Testing; Role=`chrome.*` shims so extension logic runs under Node — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `mongodb-memory-server` (`MONGOMS_SKIP_IF_UNAVAILABLE`): Practice=Testing; Role=Server integration tests with air-gapped graceful skip — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `.github/workflows/{syntax-check,unit-tests,extension-smoke}.yml`: Practice=Testing; Role=Three CI gates over 707 tests — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `server/cli/call.js` · `server/src/routes/call.js` · `server/mcp/call-mcp-server.js`: Practice=Dual-mode; Role=Same six CallCard ops as CLI + HTTP + MCP over one core — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `127.0.0.1:8787` API + `packages/mcp-server/src/client.js`: Practice=Dual-mode; Role=One tested API core; extension and 13-tool MCP server as thin clients — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [parameter] `live-hub-toolkit/src/core` + `cli/*` + `local_fs_host` bridge: Practice=Dual-mode; Role=One engine, CLI + application surfaces; `node --test` exercises it — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#appendix-a-practice-artifact-inventory
- [definition] Building Codebases for Machine Collaborators — A June 2026 mdb-tam review shows how generated docs, retrieval indexes, logs, tests, and shared API surfaces help agents inspect and verify a codebase. — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#building-codebases-for-machine-collaborators
- [definition] 1. The collaborator changed; the codebase must answer for it — A human engineer onboards once and accrues a mental model that survives across months. An LLM agent depends on the context its harness supplies on each call. — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#1-the-collaborator-changed-the-codebase-must-answer-for-it
- [definition] 7. Test-centric design: dual-mode the capability across CLI, API, and application — This is the hinge, and it is where verifiability and legibility meet. — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#7-test-centric-design-dual-mode-the-capability-across-cli-api-and-application
- [definition] 8. The practices as implemented — The six practices are wired into the running system, not aspirational. Each row maps a practice to what it buys a machine collaborator and to the mdb-tam mechanism that implements it; paths are repo-relative unless marked harness-level, and every path was confirmed to exist at the time of writing. — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#8-the-practices-as-implemented
- [definition] 9. Implementation considerations — Six points, drawn from how this system is built. — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#9-implementation-considerations
- [definition] 10. Conclusion — The collaborator changed. It depends on harness-supplied context, it reads the codebase a slice at a time, and its output is probabilistic — frequently right, occasionally confidently wrong, with no tonal tell between the two. — https://llms-explorer.com/blog/building-codebases-for-machine-collaborators/#10-conclusion

## TSE Strategy Backtest Scoreboard — Project Briefing
<https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/>

- [snippet] End-to-end run flow: datasets/<id>/cases.json        (blind input: title + first message only) — `datasets/<id>/cases.json        (blind input: title + first message only)` — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#end-to-end-run-flow
- [snippet] Install (core): pip install -r requirements.txt      # jsonschema>=4.26.0 — the only core dependency — `pip install -r requirements.txt      # jsonschema>=4.26.0 — the only core dependency` — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#install-core
- [snippet] Reproduce the seed scoreboard from a local Customer A export: <CUSTOMER>_SRC=/path/to/customer-a-export python harness/seed_<customer>.py — `<CUSTOMER>_SRC=/path/to/customer-a-export python harness/seed_<customer>.py` — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#reproduce-the-seed-scoreboard-from-a-local-customer-a-export
- [snippet] Add your own strategy and score it: python harness/new_strategy.py my-method-v1 --title "My method" --kind hybrid — `python harness/new_strategy.py my-method-v1 --title "My method" --kind hybrid` — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#add-your-own-strategy-and-score-it
- [snippet] Add your own strategy and score it: python harness/freeze.py strategies/my-method-v1 — `python harness/freeze.py strategies/my-method-v1` — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#add-your-own-strategy-and-score-it
- [parameter] 1: Strategy=Pure MongoDB skill knowledge; n=244; Defensibility=100%; Acc / gradable=90.3%; Raw acc=72.5% — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#standings-on-2026-05-29-all
- [parameter] 2: Strategy=Documented flowchart corpus; n=244; Defensibility=86%; Acc / gradable=63.5%; Raw acc=51.0% — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#standings-on-2026-05-29-all
- [parameter] 3: Strategy=A colleague's Customer A flowchart bundle; n=244; Defensibility=37%; Acc / gradable=26.3%; Raw acc=21.1% — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#standings-on-2026-05-29-all
- [parameter] **"Which diagnosis method is best?" was anecdotal**: Frozen panels + deterministic scorecards + a ranked leaderboard make it measurable — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **A methodology grading its own exam**: The judge is a separate, versioned, methodology-blind artifact; predictor ≠ judge — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Ground-truth leakage into a "blind" test**: Strategies see only `initial_prompt`; resolutions live in a separate file the predictor never opens — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Post-hoc tampering to inflate a score**: Content-hash pinning plus a `validate.py` immutability pass reject edits to tested artifacts — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Stale or hand-edited scoreboards**: Every scorecard and the leaderboard are generated; CI fails if validation regenerates a tracked file — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Non-comparable scores**: Each run pins strategy + panel + judge + ground truth by hash; only same-panel, same-ground-truth runs are ranked together — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Accuracy hiding cost**: An efficiency block scores compute, navigation cost, size, and human-follow time — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Weak ground truth read as "accuracy"**: A `ground_truth_caveat` is stamped on every scorecard; scores are framed as plausibility until `r2` — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Improving a method corrupting old results**: A new version is a new immutable folder; lineage tracked via `forked_from` — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Adding a contributor's method touching others' files**: Contribution is purely additive — new folders only; the scaffolder refuses to overwrite — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] Core harness (11 Python scripts): Path=`harness/*.py`; Approx. lines=~1,610 — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] `/dr` deep-research runner (8 scripts): Path=`dr-harness/*.py`; Approx. lines=~650 — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Artifact contracts: Path=`schemas/*.json` (9 files); Approx. lines=~360 — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Scorer tests: Path=`tests/test_score.py`; Approx. lines=~110 — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Documentation suite: Path=`docs/*.md` (17 files); Approx. lines=~1,440 — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Post-run analyses: Path=`evaluations/*.md` (6 files: 5 analyses and an index); Approx. lines=~590 — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#4-scope-of-work-leadership-reviewers
- [definition] TSE Strategy Backtest Scoreboard — Project Briefing — A first-person briefing on a git-backed scoreboard that backtests case-diagnosis strategies blind against resolved support cases, with how to read its scores and add a strategy. — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#tse-strategy-backtest-scoreboard-project-briefing
- [definition] Standings on 2026-05-29 *(all)* — Full corpus, panel `blind-244-v1` (calibrated rubric), ground truth `r1-autoclose-fallback`: — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#standings-on-2026-05-29-all
- [definition] Customer-data handling — The cases are real customer support cases (a Customer A export taken through TS Tools). The rule is to treat every case as customer-confidential and to store only the blind inputs and the resolutions grading requires — no fuller exports, PII, or internal URLs beyond that (`docs/SECURITY.md`). — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#customer-data-handling
- [definition] Blinding — Two-axis separation is built into the data model: blind inputs (`cases.json`) and ground truth (`resolutions-r1.json`) live in different files. — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#blinding
- [definition] Secrets and network — The codebase reads no secrets — the only environment variable is `<CUSTOMER>_SRC`, a local filesystem path used solely by the seeder. The scored ledger makes **zero in-process external calls**: no network, no database, no Model Context Protocol (MCP) calls. — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#secrets-and-network
- [definition] Integrity model — The repo *is* the database. There is no server and no external state; integrity comes from canonical content hashes plus the `validate.py` CI gate, which is the read-back equivalent. — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#integrity-model
- [definition] Run identity — `run_id = <strategy_id>__<sample_set_id>__<judge_id>__<UTC timestamp>`. Every input is pinned by content hash, so a run is reproducible — and comparable to another run *only if* both share the same sample set **and** the same resolution version. — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#run-identity
- [definition] Key modules — `common.py` (canonical hashing + JSON I/O), `new_strategy.py` (scaffold), `freeze.py` (write content hashes), `pin_runs.py` (stamp a run with its input hashes), `score.py` (grades → scorecard), `leaderboard.py` (runs → leaderboard), `validate.py` (the CI gate), and `seed_<customer>.py` (provenance… — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#key-modules
- [definition] Add your own strategy and score it — Contributing is additive: a new strategy is a new folder, and nobody edits another contributor's files (`CONTRIBUTING.md`). — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#add-your-own-strategy-and-score-it
- [definition] 9. Reading the Scores *(all)* — The standings rank strategies by plausibility, not verified accuracy. Two things explain why. — https://llms-explorer.com/blog/case-diagnosis-backtest-scoreboard-project-briefing/#9-reading-the-scores-all

## Case Study — Gamifying Incident-Response Training with a Rate-Limiting Fire Drill
<https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/>

- [parameter] Severity called correctly: What it measures=The IR role names severity 2; Target=within 10 min; Weight=blocking — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#23-the-rubric-what-the-drill-rewards
- [parameter] Rate-limiting diagnosed: What it measures=The IR role confirms a rate limit, not an outage; Target=within 20 min; Weight=major — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#23-the-rubric-what-the-drill-rewards
- [parameter] Mitigation suggested: What it measures=The IR role suggests a mitigation (backoff or a separate key); Target=within 30 min; Weight=major — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#23-the-rubric-what-the-drill-rewards
- [parameter] No unilateral quota promise: What it measures=Nobody promises a quota change; Target=none; Weight=blocking — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#23-the-rubric-what-the-drill-rewards
- [parameter] Fire-drill engine: Path=`src/background/firedrill-engine.js`; Role in this study=Lifecycle, drip, persona and complication injection, abort — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#appendix-a-real-artifacts-referenced
- [parameter] Drill state module: Path=`src/background/firedrill-state.js`; Role in this study=One of the two modules the engine imports — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#appendix-a-real-artifacts-referenced
- [parameter] Isolation safety test: Path=`tests/unit/firedrill-safety.test.js`; Role in this study=Checks drill modules and scenario files for forbidden imports and production hostnames — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#appendix-a-real-artifacts-referenced
- [parameter] Scorecard: Path=`src/background/firedrill-scorecard.js`; Role in this study=Observable types, weights, retro markdown — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#appendix-a-real-artifacts-referenced
- [parameter] Rate-limiting scenario: Path=`mcp-server/data/firedrill/scenarios/scenario-4.json`; Role in this study=Knowledge graph, drips, rubric, complications, persona — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#appendix-a-real-artifacts-referenced
- [parameter] Operator cards: Path=`docs/firedrill-ir-card.md`, `docs/firedrill-tam-ic-card.md`, `docs/firedrill-moderator-card.md`; Role in this study=JIMP roles under pressure — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#appendix-a-real-artifacts-referenced
- [parameter] Program pitch: Path=`docs/firedrill-pitch.md`; Role in this study=Training framing and support-plan milestone — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#appendix-a-real-artifacts-referenced
- [definition] Case Study — Gamifying Incident-Response Training with a Rate-Limiting Fire Drill — A training case study of an Atlas API rate-limiting fire drill: how its scorecard rewards restraint, and why team support multiplies, but cannot replace, individual expertise. — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#case-study-gamifying-incident-response-training-with-a-rate-limiting-fire-drill
- [definition] §1 The challenge: readiness you cannot prove, and expertise you cannot clone — Before the fire-drill program, IR readiness was asserted, not demonstrated. The team had the JIMP, an escalation matrix and capable engineers. — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#1-the-challenge-readiness-you-cannot-prove-and-expertise-you-cannot-clone
- [definition] §2 The solution: a gamified, isolated fire drill — The IR program built fire drills into the MDB Case Assistant extension (see the [project pitch](/blog/mdb-case-assistant-project-pitch/)). — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#2-the-solution-a-gamified-isolated-fire-drill
- [definition] §2.1 The engine and its safety model — The fire-drill engine (`src/background/firedrill-engine.js`) creates a simulated case (`DRILL-NNNN`) and drives it through a strict lifecycle: PREFLIGHT, RUNNING, CONCLUDED, with an ABORTED path always available. — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#21-the-engine-and-its-safety-model
- [definition] §2.2 The rate-limiting scenario — Scenario 4 (`scenario-4.json`) is an Atlas API throttle rated severity 2 (S2) in the IR playbook. It is realistic, multi-step and ambiguous. — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#22-the-rate-limiting-scenario
- [definition] §2.3 The rubric: what the drill rewards — The scorecard (`firedrill-scorecard.js`) is the heart of the design. It does not quiz individuals on encyclopedic Atlas knowledge. — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#23-the-rubric-what-the-drill-rewards
- [definition] §2.4 The pedagogy underneath the game — I read the drill through established learning-science ideas: - **Productive failure** (Kapur): the scenario is hard enough that teams struggle before the retro consolidates the lesson, and the struggle helps the lesson stick. — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#24-the-pedagogy-underneath-the-game
- [definition] §4 The result: what the drills taught — These observations are my summary of the drills (see Appendix B), not measured data, and the same pattern is visible in the rubric design itself. — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#4-the-result-what-the-drills-taught
- [definition] §5 The conclusion — The fire drills converge on a two-part finding. — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#5-the-conclusion
- [definition] Appendix A: Real artifacts referenced — Paths are relative to the root of the MDB Case Assistant repository, which is internal to MongoDB. — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#appendix-a-real-artifacts-referenced
- [definition] Appendix B: Method and honesty note — This is a training case study, not a customer marketing asset. The mechanics described in §2 are real and cited above. — https://llms-explorer.com/blog/case-study-gamifying-incident-response-training/#appendix-b-method-and-honesty-note

## Conceptual vs proprietary llms files
<https://llms-explorer.com/blog/cllms-vs-proprietary/>

- [parameter] file: source axis=`llms.txt`, `llms-full.txt`, `llms-facts.txt`; concept axis=`llms-concepts.txt`, `/t/<slug>/llms-facts.txt`, concept packs — https://llms-explorer.com/blog/cllms-vs-proprietary/#two-axes
- [parameter] the authority: source axis=the publisher; concept axis=the concept — https://llms-explorer.com/blog/cllms-vs-proprietary/#two-axes
- [parameter] the unit of truth: source axis=a page; concept axis=a claim about the concept — https://llms-explorer.com/blog/cllms-vs-proprietary/#two-axes
- [parameter] what "correct" means: source axis=the link resolves and says what the description said; concept axis=the claim survives comparison with every other source's claim — https://llms-explorer.com/blog/cllms-vs-proprietary/#two-axes
- [parameter] what a disagreement is: source axis=possible between pages, versions, or claims from one publisher; concept axis=routine across sources under one concept — https://llms-explorer.com/blog/cllms-vs-proprietary/#two-axes
- [parameter] anyone (no account): may=read every file, every conflict record, the ladder; may not=submit — https://llms-explorer.com/blog/cllms-vs-proprietary/#governance
- [parameter] contributor (account): may=submit a unit with a source URL and anchor; it runs through `resolve`; may not=write a unit without a source; skip the ladder — https://llms-explorer.com/blog/cllms-vs-proprietary/#governance
- [parameter] maintainer: may=settle ties in the moderation queue with a note; reject a submission; may not=overwrite a ladder verdict without a note in the record — https://llms-explorer.com/blog/cllms-vs-proprietary/#governance
- [parameter] fork owner: may=keep a private tree with its own `precedence.json`; propose merges back as diffs of units; may not=push to the public tree directly — https://llms-explorer.com/blog/cllms-vs-proprietary/#governance
- [parameter] the lint: may=block any file with a High finding from being served; may not=be bypassed — https://llms-explorer.com/blog/cllms-vs-proprietary/#governance
- [definition] Conceptual vs proprietary llms files — A proposed governance design for conceptual llms files compares scoped claims, retains disagreements, and distinguishes source provenance from proof of correctness. — https://llms-explorer.com/blog/cllms-vs-proprietary/#conceptual-vs-proprietary-llms-files
- [definition] Two axes — This site organizes llms files along two axes. — https://llms-explorer.com/blog/cllms-vs-proprietary/#two-axes
- [definition] The most correct idea overwrites — On the concept axis, units can compete. The proposed `resolve` job first checks whether they answer the same question at the same scope: subject, version, date, platform, and population. — https://llms-explorer.com/blog/cllms-vs-proprietary/#the-most-correct-idea-overwrites
- [definition] The precedence ladder — After the scope and subject-matter fit checks, compare the rungs in order; the first difference decides, and a tie falls to the next. Source grade is a policy preference, not a guarantee of truth, so a standard’s definition cannot substitute for a measurement of adoption. — https://llms-explorer.com/blog/cllms-vs-proprietary/#the-precedence-ladder
- [definition] Disagreements stay visible — A conflict that the ladder settles produces a winner in `llms-facts.txt` and a loser in a `## Disagreements` section of the pack's `llms-full.txt`. A conflict it cannot settle puts both there. — https://llms-explorer.com/blog/cllms-vs-proprietary/#disagreements-stay-visible
- [definition] Governance — Who can overwrite what, on the public tree: — https://llms-explorer.com/blog/cllms-vs-proprietary/#governance
- [definition] Rights — What a conceptual file may contain is narrower than what a proprietary one may: - **Links** — the default way this design points readers to a publisher’s material. - **Facts in our words, with anchors** — yes. — https://llms-explorer.com/blog/cllms-vs-proprietary/#rights
- [definition] Honesty note — Three things the reader should know before trusting any of the above. — https://llms-explorer.com/blog/cllms-vs-proprietary/#honesty-note

## Comparing Output Quality Across Claude Model Tiers and Effort Levels
<https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/>

- [snippet] Appendix A — Reproducibility: T1: A water tank holds 240 liters and starts empty. Pipe A fills it at 8 liters — `T1: A water tank holds 240 liters and starts empty. Pipe A fills it at 8 liters` — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#appendix-a-reproducibility
- [parameter] Small: Model=Haiku 4.5; Model ID=`claude-haiku-4-5-20251001`; Role=Fastest / lowest-cost tier — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#21-models-under-test
- [parameter] Mid: Model=Sonnet 4.6; Model ID=`claude-sonnet-4-6`; Role=Balanced quality/cost — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#21-models-under-test
- [parameter] Large: Model=Opus 4.8; Model ID=`claude-opus-4-8`; Role=Most capable tier — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#21-models-under-test
- [parameter] Frontier: Model=Fable 5; Model ID=`claude-fable-5`; Role=**Not tested — returned "currently unavailable" this run** — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#21-models-under-test
- [parameter] Haiku 4.5: T1 quant=10; T2 logic=10; T3 code=9¹; T4 writing=9²; Total / 40=**38** — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#31-experiment-a-model-tier-neutral-prompting
- [parameter] Sonnet 4.6: T1 quant=10; T2 logic=10; T3 code=10; T4 writing=10; Total / 40=**40** — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#31-experiment-a-model-tier-neutral-prompting
- [parameter] Opus 4.8: T1 quant=10; T2 logic=10; T3 code=10; T4 writing=10; Total / 40=**40** — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#31-experiment-a-model-tier-neutral-prompting
- [parameter] Fable 5: T1 quant=—; T2 logic=—; T3 code=—; T4 writing=—; Total / 40=**n/a (unavailable)** — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#31-experiment-a-model-tier-neutral-prompting
- [parameter] Haiku — low effort: T1 quant=**0**³; T2 logic=10; T3 code=10; T4 writing=10; Total / 40=**30** — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#32-experiment-b-effort-level-haiku-opus
- [parameter] Haiku — high effort: T1 quant=10; T2 logic=10; T3 code=10; T4 writing=10; Total / 40=**40** — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#32-experiment-b-effort-level-haiku-opus
- [parameter] Opus — low effort: T1 quant=**0**⁴; T2 logic=10; T3 code=10; T4 writing=10; Total / 40=**30** — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#32-experiment-b-effort-level-haiku-opus
- [parameter] Opus — high effort: T1 quant=10; T2 logic=10; T3 code=10; T4 writing=10; Total / 40=**40** — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#32-experiment-b-effort-level-haiku-opus
- [parameter] Haiku: Low=30; High=40; Effort Δ=**+10** — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#33-interaction-rq3
- [parameter] Opus: Low=30; High=40; Effort Δ=**+10** — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#33-interaction-rq3
- [definition] Comparing Output Quality Across Claude Model Tiers and Effort Levels — A reported June Claude comparison with one response per condition; raw outputs are missing, and its score differences do not establish causal effects. — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#comparing-output-quality-across-claude-model-tiers-and-effort-levels
- [definition] 2.2 The "effort level" lever — what it is and is not — There is no public per-request "reasoning effort" dial exposed through the subagent interface I used, so **effort here is a prompt-induced proxy**, operationalized as two prompt regimes applied to the *same* benchmark: — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#22-the-effort-level-lever-what-it-is-and-is-not
- [definition] 3.4 Cross-experiment note — Neutral-prompt Haiku and Opus both scored T1 correctly (they were free to show work): Haiku's total (38) landed *between* the low- and high-effort conditions, while Opus's (40) matched the high-effort condition outright. — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#34-cross-experiment-note
- [definition] 6. Conclusion — The preserved tables report neutral scores of 38, 40, and 40 and a 10-point prompt-regime difference for Haiku and Opus, entirely in one arithmetic item. They do not establish a causal prompting advantage, the absence of an interaction, or a cheaper model-selection strategy. — https://llms-explorer.com/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels/#6-conclusion

## Two thousand artifacts, three taxonomies: crawling a customer engagement
<https://llms-explorer.com/blog/crawling-a-customer-engagement/>

- [snippet] Commands: /crawl-cust2llms "<account>" --depth standard — `# one run per account; the pack is written into that account's own folder` — https://llms-explorer.com/blog/crawling-a-customer-engagement/#commands
- [snippet] Reproduce: xattr "<engagement-folder>/<some-file>.gdoc" — `# 1. resolve one stub by hand first — if this prints nothing, nothing else will work` — https://llms-explorer.com/blog/crawling-a-customer-engagement/#reproduce
- [parameter] Artifacts enumerated: Account A=945; Account B=326; Account C=740 — https://llms-explorer.com/blog/crawling-a-customer-engagement/#inputs
- [parameter] Google-native stubs: Account A=119; Account B=202; Account C=106 — https://llms-explorer.com/blog/crawling-a-customer-engagement/#inputs
- [parameter] Taxonomy: Account A=`NN Name` (numbered, spaces); Account B=freeform; Account C=`NN_Name` (numbered, underscores) — https://llms-explorer.com/blog/crawling-a-customer-engagement/#inputs
- [parameter] Has a `_meta/` self-map: Account A=yes; Account B=no; Account C=no — https://llms-explorer.com/blog/crawling-a-customer-engagement/#inputs
- [parameter] Stubs resolved: A=116 / 119; B=201 / 202; C=99 / 106 — https://llms-explorer.com/blog/crawling-a-customer-engagement/#outputs
- [parameter] Deep-read: A=47; B=18; C=16 — https://llms-explorer.com/blog/crawling-a-customer-engagement/#outputs
- [parameter] Index documents examined: A=23; B=14; C=12 — https://llms-explorer.com/blog/crawling-a-customer-engagement/#outputs
- [parameter] Atomic tagged facts: A=61; B=45; C=51 — https://llms-explorer.com/blog/crawling-a-customer-engagement/#outputs
- [parameter] Claims tagged stale: A=9; B=3; C=2 — https://llms-explorer.com/blog/crawling-a-customer-engagement/#outputs
- [parameter] Conflicts recorded: A=6; B=5; C=4 — https://llms-explorer.com/blog/crawling-a-customer-engagement/#outputs
- [parameter] Redactions: A=1; B=0; C=0 — https://llms-explorer.com/blog/crawling-a-customer-engagement/#outputs
- [parameter] critical: A=23; B=16; C=9 — https://llms-explorer.com/blog/crawling-a-customer-engagement/#outputs
- [parameter] high: A=48; B=54; C=67 — https://llms-explorer.com/blog/crawling-a-customer-engagement/#outputs
- [parameter] normal: A=152; B=220; C=160 — https://llms-explorer.com/blog/crawling-a-customer-engagement/#outputs
- [parameter] peripheral: A=722; B=36; C=504 — https://llms-explorer.com/blog/crawling-a-customer-engagement/#outputs
- [definition] Two thousand artifacts, three taxonomies: crawling a customer engagement — Three anonymized engagement crawls report 2,011 artifacts and 416 resolved Drive stubs, while exposing context-selection and confidentiality-check limits. — https://llms-explorer.com/blog/crawling-a-customer-engagement/#two-thousand-artifacts-three-taxonomies-crawling-a-customer-engagement

## Customer Dashboard — Project Briefing
<https://llms-explorer.com/blog/customer-dashboard-project-briefing/>

- [snippet] C4 Level 1 — System context: Operator — `Operator` — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#c4-level-1-system-context
- [parameter] **Context fragmentation** — preparing for a customer call means opening 6–10 tabs across Hub, Salesforce, Slack, monday.com, Jira, Aha!, Drive, and Glean: Aggregates all sources into a single indexed corpus; generates a pre-call context report in under a minute — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Account context lives in two systems** — the technical story is in Hub, but ownership, annual recurring revenue (ARR), and roadmap status live in Salesforce and Aha!: Content scripts extract Salesforce Account fields and Aha! item status directly into the same corpus, so a brief reflects both — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Case status blind spots** — severity escalations are only visible if you happen to be looking at Hub: Polls open cases in the background and surfaces Chrome notifications on severity or status changes — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **monday.com maintenance overhead** — board items go stale; reconciling them against Hub cases is manual: Automated monday.com reconciliation: creates new items, archives resolved cases, updates rows via LLM-assisted diffing — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Meeting context loss** — notes from Granola, Plaud recordings, and Slack threads are siloed: Ingests meeting transcripts and recordings through native host bridges and content scripts, and indexes them into the local corpus — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Report generation time** — writing a pre-call summary or case analysis by hand takes 30–60 minutes: LLM report generation with configurable prompts produces structured reports from the indexed corpus in under a minute — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Atlas diagnostics access** — diagnostics snapshots require navigating to each project separately: Per-cluster diagnostics snapshot refresh and storage directly from the extension dashboard — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **No unified to-do surface** — action items from calls, Slack, and cases live in different places: Floating always-on-top to-do window with keyboard shortcut — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Slow onboarding** — new TAMs rebuild account history from scratch: A new TAM's own dashboard rebuilds account history from the sources automatically instead of starting from scratch — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Slow escalation response** — priority changes surface only if someone is watching: Case-status notifications can arrive before the customer sends a follow-up — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#3-problems-solved-leadership-team
- [parameter] Chrome extension (background, content, UI): Approx. lines=~102,000; Tests=294 (Vitest) — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Local backend server (`server/`): Approx. lines=~18,000; Tests=346 (Vitest) — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Live Hub Toolkit (`live-hub-toolkit/`, which generates customer hub documents): Approx. lines=~3,900; Tests=30 (`node --test`) — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Native host bridges (`native-host/`): Approx. lines=~6,900; Tests=Python AST + integration — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Account Context MCP server: Approx. lines=~800; Tests=37 (`node --test`) — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Documentation suite: Approx. lines=78 markdown files; Tests=— — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] **Total**: Approx. lines=**~131,600**; Tests=**707** — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Local backend isolation: Server binds to `127.0.0.1:8787` by default, so it is not reachable from outside the machine — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#network-and-backend-security
- [parameter] Origin allow-list: All state-changing backend requests checked against an explicit origin allow-list in `server/src/middleware/origin-check.js`; cross-origin requests are rejected — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#network-and-backend-security
- [parameter] Timing-safe token verification: Backend bearer token comparison uses `crypto.timingSafeEqual`; not `===` (`server/src/middleware/auth.js`) — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#network-and-backend-security
- [parameter] No query-string tokens: Auth sent as `Authorization: Bearer` — never embedded in URLs — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#network-and-backend-security
- [parameter] Service worker: Path=`src/background/service-worker.js`; Owns=message routing, alarms, sync engines, corpus writes; Talks via=`chrome.runtime.sendMessage`, `chrome.alarms`, IndexedDB, native messaging, loopback HTTP — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#c4-level-2-chrome-side-containers
- [parameter] Options page: Path=`src/options/`; Owns=settings and credentials UX; Talks via=runtime messages + `chrome.storage.*` — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#c4-level-2-chrome-side-containers
- [parameter] Popup: Path=`src/popup/`; Owns=quick actions and dashboard launch; Talks via=runtime messages + `chrome.storage.*` — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#c4-level-2-chrome-side-containers
- [parameter] Dashboard pages: Path=`src/dashboard/`; Owns=main operator workspace, overlays, to-do tooling; Talks via=runtime messages + `chrome.storage.*` — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#c4-level-2-chrome-side-containers
- [parameter] Offscreen document: Path=`src/offscreen/`; Owns=SSE client, LLM streaming (kept alive by silent `<audio>`); Talks via=runtime messages — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#c4-level-2-chrome-side-containers
- [parameter] Content scripts: Path=`src/content/`; Owns=Hub extraction, Slack relay/export, Plaud hook, Drive scraper, Salesforce/Aha!/Atlas scrapers; Talks via=`chrome.runtime.sendMessage` → service worker — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#c4-level-2-chrome-side-containers
- [parameter] `chrome.storage.local`: Settings, accounts, OAuth refresh tokens, vault envelope — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#storage-surfaces
- [parameter] `chrome.storage.session`: Vault DEK cache, OAuth access tokens, sync locks (memory-only) — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#storage-surfaces
- [parameter] IndexedDB (`src/background/db.js`): Full corpus (cases, Slack, meetings, reports) — primary store — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#storage-surfaces
- [parameter] Local mongod, plus Atlas when configured, via `server/`: Dual-write mirror; durable backend for SSE pipeline — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#storage-surfaces
- [definition] Customer Dashboard — Project Briefing — A briefing on the Customer Dashboard, a local-first Chrome extension that gathers a TAM's account context: its features, scope, security model and architecture. — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#customer-dashboard-project-briefing
- [definition] Secret storage — Once the operator sets up the vault, the Glean token, the Atlas private key, the monday.com token, the backend token and OAuth refresh tokens are stored in a **passphrase-encrypted AES-GCM vault** in `chrome.storage.local` (`src/common/secret-vault.js`). — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#secret-storage
- [definition] Prompt injection defense — On the live recommender path, case text, transcripts and Slack messages are: 1. Wrapped in named `<untrusted_*>` XML tags. — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#prompt-injection-defense
- [definition] Data flow — Content scripts extract from web pages → Service worker indexes in IndexedDB → Backend mirrors to the local MongoDB and, when configured, Atlas → Reports generated by LLM on demand → Dashboard renders results. Live updates flow the reverse direction via SSE from the server's `/api/live` endpoint. — https://llms-explorer.com/blog/customer-dashboard-project-briefing/#data-flow

## Turning a customer's docs into an llms family
<https://llms-explorer.com/blog/customer-docs-to-llms-family/>

- [snippet] Commands: .venv/bin/python scripts/docset_rollout.py probe — `# cwd: ~/.global-ai-hub` — https://llms-explorer.com/blog/customer-docs-to-llms-family/#commands
- [parameter] developers.cloudflare.com: Pages=1,943; Acquired via=`llms-full.txt` (57 MB upstream, 2,000-page cap); Deterministic units=25,142 — https://llms-explorer.com/blog/customer-docs-to-llms-family/#inputs
- [parameter] developer.paypal.com: Pages=1,507; Acquired via=structured crawl (its `llms-full.txt` redirects to a 1.5 KB `llms.txt`); Deterministic units=38,710 — https://llms-explorer.com/blog/customer-docs-to-llms-family/#inputs
- [parameter] docs.claude.com (served from platform.claude.com): Pages=666; Acquired via=`llms.txt` + page `.md` twins; Deterministic units=13,432 — https://llms-explorer.com/blog/customer-docs-to-llms-family/#inputs
- [parameter] docs.langchain.com: Pages=529; Acquired via=`llms-full.txt`; Deterministic units=12,933 — https://llms-explorer.com/blog/customer-docs-to-llms-family/#inputs
- [parameter] developers.cloudflare.com: Root index (bytes)=9,241; Spoke indexes=243; Full (tokens)=4,162,267; Facts (tokens)=1,889,300 — https://llms-explorer.com/blog/customer-docs-to-llms-family/#outputs
- [parameter] developer.paypal.com: Root index (bytes)=4,104; Spoke indexes=193; Full (tokens)=2,921,259; Facts (tokens)=1,680,485 — https://llms-explorer.com/blog/customer-docs-to-llms-family/#outputs
- [parameter] docs.claude.com: Root index (bytes)=1,977; Spoke indexes=73; Full (tokens)=7,493,540; Facts (tokens)=768,209 — https://llms-explorer.com/blog/customer-docs-to-llms-family/#outputs
- [parameter] docs.langchain.com: Root index (bytes)=1,508; Spoke indexes=15; Full (tokens)=1,552,458; Facts (tokens)=738,488 — https://llms-explorer.com/blog/customer-docs-to-llms-family/#outputs
- [definition] Turning a customer's docs into an llms family — An August docset acquisition and export case study, with stored llms.txt families, dated figure snapshots, and the limits of their verification. — https://llms-explorer.com/blog/customer-docs-to-llms-family/#turning-a-customers-docs-into-an-llms-family

## Fallen Off the Bus: the Resets That Failed, the Manuals, and the Concept Tree
<https://llms-explorer.com/blog/egpu-fallen-off-the-bus/>

- [snippet] The symptom, in one register: NVRM: The NVIDIA GPU 0000:04:00.0 (PCI ID: 10de:2c02) installed in this system has — `NVRM: The NVIDIA GPU 0000:04:00.0 (PCI ID: 10de:2c02) installed in this system has` — https://llms-explorer.com/blog/egpu-fallen-off-the-bus/#the-symptom-in-one-register
- [snippet] The measurement that lied: for d in $(readlink -f /sys/bus/pci/devices/0000:04:00.0 | tr '/' '\n' | grep -E '^0000:'); do — `for d in $(readlink -f /sys/bus/pci/devices/0000:04:00.0 | tr '/' '\n' | grep -E '^0000:'); do` — https://llms-explorer.com/blog/egpu-fallen-off-the-bus/#the-measurement-that-lied
- [parameter] Function-level reset (`echo flr > reset_method; echo 1 > reset`): still `0xffffffff` — https://llms-explorer.com/blog/egpu-fallen-off-the-bus/#the-resets-that-changed-nothing
- [parameter] Secondary bus reset through the downstream bridge `03:00.0`: kernel logged "resetting / reset done"; still all-ones — https://llms-explorer.com/blog/egpu-fallen-off-the-bus/#the-resets-that-changed-nothing
- [parameter] Thunderbolt deauthorize and re-authorize via `bolt` sysfs: the flag flipped; the PCI devices under it never went away; no change — https://llms-explorer.com/blog/egpu-fallen-off-the-bus/#the-resets-that-changed-nothing
- [parameter] PCI `remove` + `rescan`: re-enumerated with the same BARs; no change — https://llms-explorer.com/blog/egpu-fallen-off-the-bus/#the-resets-that-changed-nothing
- [definition] Fallen Off the Bus: the Resets That Failed, the Manuals, and the Concept Tree — A second investigator’s RTX 5080 eGPU recovery account: failed resets, bridge memory decoding, ASUS specifications, and unresolved incident evidence. — https://llms-explorer.com/blog/egpu-fallen-off-the-bus/#fallen-off-the-bus-the-resets-that-failed-the-manuals-and-the-concept-tree
- [definition] The symptom, in one register — `setpci -s 04:00.0 VENDOR_ID DEVICE_ID COMMAND` answered `10de 2c02 0007`. The GeForce RTX 5080 in the Razer Core X V2 was enumerated and responding to configuration reads. — https://llms-explorer.com/blog/egpu-fallen-off-the-bus/#the-symptom-in-one-register
- [definition] The resets that changed nothing — With the owner's permission, every live recovery short of a reboot went in, with the chip ID re-read after each: — https://llms-explorer.com/blog/egpu-fallen-off-the-bus/#the-resets-that-changed-nothing
- [definition] The measurement that lied — The read-only capture script written that afternoon mmaps `resource0` and prints the BAR0 word so the next boot produces evidence rather than a re-run of the guesswork. — https://llms-explorer.com/blog/egpu-fallen-off-the-bus/#the-measurement-that-lied
- [definition] Why the BAR stayed at 256 MB — The incident reports a smaller BAR after hot-add than after cold-plug boot. That does not establish that Linux never exercises Resizable BAR: the kernel exposes resource-resize paths, including [`resourceN_resize`](https://github.com/torvalds/linux/blob/master/drivers/pci/pci-sysfs.c). — https://llms-explorer.com/blog/egpu-fallen-off-the-bus/#why-the-bar-stayed-at-256-mb
- [definition] What the ASUS manuals say — The author reports reading five NUC 15 Pro documents: the service manual, user manual, technical product specification, embedded manual and regulatory insert. — https://llms-explorer.com/blog/egpu-fallen-off-the-bus/#what-the-asus-manuals-say
- [definition] What the incident became — The failure was used as the seed for a `concept-family-explorer` run: map the conceptual neighbourhood, score every gap on relevance, usefulness, novelty, interest and viability, and research the ones above the bar. — https://llms-explorer.com/blog/egpu-fallen-off-the-bus/#what-the-incident-became

## Every Token-Saving Strategy in My Stack, With Sources and Numbers
<https://llms-explorer.com/blog/every-token-saving-strategy/>

- [parameter] llm-cache-proxy: 838 / 81,287 (97×) — https://llms-explorer.com/blog/every-token-saving-strategy/#54-the-four-file-llms-family
- [parameter] distillers: 794 / 36,576 (46×) — https://llms-explorer.com/blog/every-token-saving-strategy/#54-the-four-file-llms-family
- [parameter] web-text-mirror: 750 / 28,730 (38×) — https://llms-explorer.com/blog/every-token-saving-strategy/#54-the-four-file-llms-family
- [parameter] llm-memory-pyramid: 813 / 29,351 (36×) — https://llms-explorer.com/blog/every-token-saving-strategy/#54-the-four-file-llms-family
- [parameter] youtube-transcript-to-pdf: 1,199 / 41,733 (35×) — https://llms-explorer.com/blog/every-token-saving-strategy/#54-the-four-file-llms-family
- [parameter] codex-local-ai-setup: 1,066 / 16,210 (15×) — https://llms-explorer.com/blog/every-token-saving-strategy/#54-the-four-file-llms-family
- [parameter] localllm: 655 / 8,468 (13×) — https://llms-explorer.com/blog/every-token-saving-strategy/#54-the-four-file-llms-family
- [parameter] `llms-small` ceiling ("Cursor-stability ceiling"): Where=`export_llms.py` `SMALL_MAX_CHARS`; Value=200,000 chars (~50k tokens) — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] Index section split: Where=`INDEX_SPLIT_BYTES` / `PART_PAGES`; Value=10,000 B, 60 pages per part — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] Related-concept links: Where=`/lca` (concept abstractor) `--max-related`; Value=20 — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] Per-skill context pulled by `/sync-skills`: Where=`commands/sync-skills.md:25`; Value=50,000 chars — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] Oversized `memory.md`: Where=`distill_context.py` tail read; Value=last 20,000 B — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] Per-file text before hashing or embedding: Where=`hub_lib.max_content_chars`; Value=4,000 chars — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] SDK output: Where=`llmsx-js` `DEFAULT_MAX_TOKENS`; Value=4,096 — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] Hub answer context: Where=`ask.py` `CONTEXT_CHARS` / `PER_HIT_CHARS`; Value=6,000 chars total, 700 per hit, top 8 of 50 reranked — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] Codebase search results: Where=`hub_search_codebase` `n_results`; Value=5 by default — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] Keyword index vs embedding, per file: Where=`keyword_max_chars` / `max_content_chars`; Value=200,000 vs 4,000 chars — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] Log evidence sent to a model: Where=`net-dns-monitor` `MAX_OUTBOUND_LOG_LINES`; Value=last 200 lines × 300 chars — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] Output per incident diagnosis: Where=`net-dns-monitor` `max_tokens`; Value=512 — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] Output per `mdb-tam` call type: Where=`maxTokens`; Value=120 (one sentence), 512 (dedup JSON), 1,024 (live recommender), 4,096 (reports) — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] Prompt attachments: Where=`mdb-tam` `normalizePromptAttachmentText`; Value=30,000 chars each, 8 max, 120,000 total — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] MCP result counts: Where=`mdb-tam` / `mdb-case-assistant` `limit` clamps; Value=100, 50, 500, 1,000 by tool — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] Diff under review: Where=`prompt-deep-optimizer` worked example; Value=most recent 1,500 lines — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] External fact checks: Where=story-context skill; Value=5 per run — https://llms-explorer.com/blog/every-token-saving-strategy/#55-hard-byte-caps
- [parameter] With the skill: Tokens=336,335; Time=718 s; Grade=7/7 — https://llms-explorer.com/blog/every-token-saving-strategy/#57-retrieval-prefiltering-in-lca
- [parameter] Without the skill: Tokens=376,182; Time=571 s; Grade=3/7 — https://llms-explorer.com/blog/every-token-saving-strategy/#57-retrieval-prefiltering-in-lca
- [parameter] Response-cache proxy for interactive Claude Code: What happened=≤0.31% of tokens saveable; would also switch Max-plan OAuth to API billing; Source=replay simulation; `proxy-a.mjs:273-274` — https://llms-explorer.com/blog/every-token-saving-strategy/#what-measured-out-as-not-worth-it-or-backfired
- [parameter] `skillListingBudgetFraction: 0.04`: What happened=~66k fewer listing tokens than at 0.12 (mostly cached), but hid 321 of 480 skills, cut alphabetically; Source=`reference_skill_listing_budget_fraction.md` — https://llms-explorer.com/blog/every-token-saving-strategy/#what-measured-out-as-not-worth-it-or-backfired
- [parameter] `name-only` on router hubs: What happened=Questions for skills behind those hubs were misrouted (probe failed twice); Source=token-trim, 2026-09-27 — https://llms-explorer.com/blog/every-token-saving-strategy/#what-measured-out-as-not-worth-it-or-backfired
- [parameter] Trigger words appended at the end of a description: What happened=Invisible past the ~250-character listing prefix; Source=token-trim, 2026-09-27 — https://llms-explorer.com/blog/every-token-saving-strategy/#what-measured-out-as-not-worth-it-or-backfired
- [parameter] Routing probes on a tiered tree: What happened=Two test reads promoted a spoke to hot, adding it back to the listing; Source=`project-token-trim-2026-09-27.md` — https://llms-explorer.com/blog/every-token-saving-strategy/#what-measured-out-as-not-worth-it-or-backfired
- [parameter] Explanatory output style plus caveman: What happened=One added output that the other tried to remove; Source=token-trim, 2026-09-27 — https://llms-explorer.com/blog/every-token-saving-strategy/#what-measured-out-as-not-worth-it-or-backfired
- [parameter] Delegating everything: What happened=6 of 10 subagents died mid-task; switched to inline; Source=`work-inline-not-subagents.md` — https://llms-explorer.com/blog/every-token-saving-strategy/#what-measured-out-as-not-worth-it-or-backfired
- [parameter] 0-byte `prompt_cost_hook.py`: What happened=Still spawns a process every prompt; Source=`settings.json:786-793` — https://llms-explorer.com/blog/every-token-saving-strategy/#what-measured-out-as-not-worth-it-or-backfired
- [definition] Every Token-Saving Strategy in My Stack, With Sources and Numbers — A dated inventory of token-saving techniques in my stack, with implementation sources, recorded savings and limits on the private benchmarks. — https://llms-explorer.com/blog/every-token-saving-strategy/#every-token-saving-strategy-in-my-stack-with-sources-and-numbers
- [definition] Part 1 — Always-on harness overhead — Everything in this part is overhead the harness adds to every session, every request or every reply. Prompt caching makes a stable prefix cheap after the first turn. — https://llms-explorer.com/blog/every-token-saving-strategy/#part-1-always-on-harness-overhead
- [definition] 1.2 What the listing actually shows: about 250 characters — With `skillListingMaxDescChars: 300` set, the listing the model receives ends each description at about **250 characters** with an ellipsis; I read that directly from the listing text on 2026-09-27. — https://llms-explorer.com/blog/every-token-saving-strategy/#12-what-the-listing-actually-shows-about-250-characters
- [definition] 2.4 Untangling the config repo from the skills repo — This is the least obvious item on the list. — https://llms-explorer.com/blog/every-token-saving-strategy/#24-untangling-the-config-repo-from-the-skills-repo
- [definition] 2.6 Routing probes as the test — Link checks do not prove routing. Each fold is verified by spawning a fresh Haiku subagent with a plain-language question and no hints, and checking which `references/*.md` it actually opens. — https://llms-explorer.com/blog/every-token-saving-strategy/#26-routing-probes-as-the-test
- [definition] 2.8 A ceiling on SKILL.md bodies — `skill-optimizer` Pass J flags any `SKILL.md` body over **10,000 tokens** and moves a section to `references/<name>.md`, leaving a one-paragraph pointer. Nothing is deleted; it loads only when routing sends the agent there. — https://llms-explorer.com/blog/every-token-saving-strategy/#28-a-ceiling-on-skillmd-bodies
- [definition] 2.9 Deterministic checks before LLM audits — `skill_optimizer_offline.py` runs regex, YAML and character-count checks across the whole library at zero token cost and reserves the LLM `/sko` loop for skills that need content judgment. — https://llms-explorer.com/blog/every-token-saving-strategy/#29-deterministic-checks-before-llm-audits
- [definition] 3.3 Request coalescing — Identical requests that are in flight at the same time share one upstream fetch, and the extra responses carry `x-cache: HIT-COALESCED`. The live fidelity test confirms that N concurrent identical calls make exactly 1 upstream call (`README.md:316-325`). — https://llms-explorer.com/blog/every-token-saving-strategy/#33-request-coalescing
- [definition] 3.6 Gate the paid call — `net-dns-monitor` diagnoses network incidents offline first and calls a model only when that fails: - `should_escalate()` returns true only after the offline ladder ran, a repair was attempted, and a recheck still shows the problem. — https://llms-explorer.com/blog/every-token-saving-strategy/#36-gate-the-paid-call
- [definition] 4.1 Batches API for bulk extraction — `llm_extractor.py` sends one Haiku extraction per session through `client.messages.batches.create` ("50% cost, async"): - It polls every 15 s and requests cancellation at 3,600 s. The source comment says this stops billing, but cancellation is asynchronous and can leave completed partial results. — https://llms-explorer.com/blog/every-token-saving-strategy/#41-batches-api-for-bulk-extraction
- [definition] 4.3 Local embeddings everywhere — No repo in the infrastructure set calls a paid embedding API: - **NapMem** (the memory-pyramid store from `llm-memory-pyramid`, section 5.9) uses Ollama. It falls back to `HashedTfBackend`, a 512-dimension, md5-bucketed, l2-normalized bag of words that needs no network. — https://llms-explorer.com/blog/every-token-saving-strategy/#43-local-embeddings-everywhere
- [definition] 4.7 The hub answers with a local model — `hub_ask` federates search across the global hub and answers with a weighted pool of local Ollama hosts (default `qwen3:8b`), never a paid API. It sets `think=False` because the reasoning trace otherwise dominates latency and output length. — https://llms-explorer.com/blog/every-token-saving-strategy/#47-the-hub-answers-with-a-local-model
- [definition] 5.3 Distill a source only after it earns it — `/dr` counts touches per host. On the 3rd or 4th touch it runs `/distill-offline` in corpus mode, and from then on it reads the distilled list. — https://llms-explorer.com/blog/every-token-saving-strategy/#53-distill-a-source-only-after-it-earns-it
- [definition] 5.10 A token-count header so agents can budget before fetching — The llms-explorer site sends `X-Markdown-Tokens` on every Markdown twin, computed with the same `len//4` estimator the manifests use. The header had to move from Cloudflare `_headers` into a Pages Function: it needed 103 rules, and `_headers` allows 100 (`site/functions/_middleware.ts`). — https://llms-explorer.com/blog/every-token-saving-strategy/#510-a-token-count-header-so-agents-can-budget-before-fetching
- [definition] 5.12 An overflow fixed by stripping and batching — About 3,000 roadmap items in one ranking prompt produced a **1.78M-token** JSON envelope against a 1M-token window. The fix removed each item's ~600-character signed preview URL, which "adds zero ranking signal", kept it in a local id-to-url map, and reattached it after scoring. — https://llms-explorer.com/blog/every-token-saving-strategy/#512-an-overflow-fixed-by-stripping-and-batching
- [definition] 6.2 Workers write files, not replies — In COG-second-brain, a worker whose output would be 2K tokens or more writes it to `/tmp/{task-slug}-{context}.md` and returns only a status and the path. Parallel workers never see each other's raw output, only digested context (`COG-second-brain/CLAUDE.md:79-100`). — https://llms-explorer.com/blog/every-token-saving-strategy/#62-workers-write-files-not-replies
- [definition] 6.4 When not to fan out — In mdb-case-assistant, **6 of 10** delegated subagents failed (connection closed or a 600 s stall), mostly after finishing analysis but before writing output. — https://llms-explorer.com/blog/every-token-saving-strategy/#64-when-not-to-fan-out
- [definition] 6.6 Model effort and prompting — [A benchmark earlier on this blog](/blog/comparing-output-quality-across-claude-model-tiers-and-effort-levels) reported a larger score difference between visible-working prompt regimes than between neutral model tiers. The prompt-regime difference came from one multi-step arithmetic task. — https://llms-explorer.com/blog/every-token-saving-strategy/#66-model-effort-and-prompting
- [definition] 6.8 Count real tokens — `skills-tui` reads the cost and token counts that `claude --output-format json` reports and falls back to a `chars/4` estimate only when the CLI reports nothing (`skills_tui/core/cost.py:1-39`). — https://llms-explorer.com/blog/every-token-saving-strategy/#68-count-real-tokens

## A third axis for repo dossiers: every command, statically read
<https://llms-explorer.com/blog/executable-inventory-for-repo-dossiers/>

- [snippet] Commands: <INDEX_ROOT_VAR>=<per-target-index-dir> python3 <indexer-script>.py status --target <id> — `# the skill's own status-probe pattern, used verbatim as one of its own Guard-3 exceptions` — https://llms-explorer.com/blog/executable-inventory-for-repo-dossiers/#commands
- [snippet] Outputs: start the server        → <API_TOKEN_VAR>=$(openssl rand -hex 16) python3 api/server.py — `start the server        → <API_TOKEN_VAR>=$(openssl rand -hex 16) python3 api/server.py` — https://llms-explorer.com/blog/executable-inventory-for-repo-dossiers/#outputs
- [parameter] Entrypoints found: 6 (a CLI, an HTTP server, a standalone script, a Makefile, a shell script, a browser-UI popup) — https://llms-explorer.com/blog/executable-inventory-for-repo-dossiers/#outputs
- [parameter] CLI subcommands: 8, on the one console script — https://llms-explorer.com/blog/executable-inventory-for-repo-dossiers/#outputs
- [parameter] CLI flags (true options, excluding positional args): 4 — https://llms-explorer.com/blog/executable-inventory-for-repo-dossiers/#outputs
- [parameter] Distinct environment variables read across every entrypoint: 19 — https://llms-explorer.com/blog/executable-inventory-for-repo-dossiers/#outputs
- [parameter] HTTP routes: 9 — https://llms-explorer.com/blog/executable-inventory-for-repo-dossiers/#outputs
- [parameter] Makefile targets: 12 — https://llms-explorer.com/blog/executable-inventory-for-repo-dossiers/#outputs
- [parameter] Quick-answer entries built: 13 — https://llms-explorer.com/blog/executable-inventory-for-repo-dossiers/#outputs
- [parameter] Quick-answer intents with no matching command (omitted, not invented): 4 — `build`, `deploy`, `migrate`, `seed` (this repo has none of these operations: nothing to compile, no deploy target, no database) — https://llms-explorer.com/blog/executable-inventory-for-repo-dossiers/#outputs
- [definition] A third axis for repo dossiers: every command, statically read — How a static executable inventory extends a repo dossier, illustrated by recorded private-run counts and three reported documentation discrepancies. — https://llms-explorer.com/blog/executable-inventory-for-repo-dossiers/#a-third-axis-for-repo-dossiers-every-command-statically-read
- [definition] What the audit found — The same crawl that built the executable inventory also re-confirmed three findings from the first pass, because Phase 4e's static reads cross the same source files the earlier per-file cards did: - One entrypoint's own module docstring stated it "never calls" a third-party API directly — untrue… — https://llms-explorer.com/blog/executable-inventory-for-repo-dossiers/#what-the-audit-found

## Getting Gemma 4 MLX to do real research on a Mac
<https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/>

- [snippet] A chat model needed an agent runtime: LLMS Explorer — `LLMS Explorer` — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#a-chat-model-needed-an-agent-runtime
- [snippet] Getting the setup running: ollama pull gemma4:31b-mlx — `ollama pull gemma4:31b-mlx` — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#getting-the-setup-running
- [snippet] Getting the setup running: python3 benchmark_local_research_model.py llmsx-research-gemma31-mlx \ — `python3 benchmark_local_research_model.py llmsx-research-gemma31-mlx \` — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#getting-the-setup-running
- [parameter] Computer: Apple M5 Max, 64 GB unified memory — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#the-measured-result
- [parameter] Inference runtime: Ollama 0.34.4, native MLX — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#the-measured-result
- [parameter] Model: Official `gemma4:31b-mlx` — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#the-measured-result
- [parameter] Research alias: `llmsx-research-gemma31-mlx` — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#the-measured-result
- [parameter] Requested research context: 65,536 tokens — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#the-measured-result
- [parameter] Model download: 19,424,434,468 bytes, about 19.42 GB — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#the-measured-result
- [parameter] Coordinator and workers: One local endpoint, serial workers — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#the-measured-result
- [parameter] Fresh one-concept research worker: Recorded time=243 s; What the saved result established=Six structured claims; an archival-age error still needed correction — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#recorded-workflow-phases
- [parameter] Evidence-directed correction: Recorded time=293.349 s; What the saved result established=All six corrected facts agreed with the reviewed sources — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#recorded-workflow-phases
- [parameter] Fresh verification gate: Recorded time=315 s; What the saved result established=Ten SUPPORTED verdicts, two per concept, eight scrapes — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#recorded-workflow-phases
- [parameter] Explorer completion: Recorded time=41.445 s; What the saved result established=Canonical finish executed; manifest finalized; Explorer returned `ok` — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#recorded-workflow-phases
- [parameter] Gemma 4 12B MLX: Generated tokens=88; Decode tokens/s=100.62 — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#short-tool-call-probes
- [parameter] Gemma 4 26B MLX: Generated tokens=81; Decode tokens/s=54.68 — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#short-tool-call-probes
- [parameter] Official Qwen 3.6 35B MLX: Generated tokens=111; Decode tokens/s=79.91 — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#short-tool-call-probes
- [parameter] User Qwen MLX alias: Generated tokens=112; Decode tokens/s=113.04 — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#short-tool-call-probes
- [parameter] Selected Gemma 31B MLX alias: Generated tokens=102; Decode tokens/s=54.76 — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#short-tool-call-probes
- [parameter] Cold model-load duration: Gemma 12B MLX=1.424 s; Gemma 26B MLX=2.633 s; Gemma 31B research alias=4.635 s — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#follow-up-inference-trials
- [parameter] Warm model-load duration: Gemma 12B MLX=0.017–0.064 s; Gemma 26B MLX=0.010–0.019 s; Gemma 31B research alias=0.020–0.064 s — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#follow-up-inference-trials
- [parameter] Prompt evaluation, 114 tokens: Gemma 12B MLX=390.58 tokens/s; Gemma 26B MLX=78.86–83.87 tokens/s; Gemma 31B research alias=123.59 tokens/s — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#follow-up-inference-trials
- [parameter] Warm early-response estimate, reported as TTFT: Gemma 12B MLX=0.309 s; Gemma 26B MLX=1.465 s; Gemma 31B research alias=0.944 s — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#follow-up-inference-trials
- [parameter] Short generation, 35-token prompt: Gemma 12B MLX=67.42–96.50 tokens/s; Gemma 26B MLX=126.97–130.27 tokens/s; Gemma 31B research alias=25.37–29.07 tokens/s — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#follow-up-inference-trials
- [parameter] Sustained generation, 2,600+ output tokens: Gemma 12B MLX=63.75 tokens/s; Gemma 26B MLX=89.42 tokens/s; Gemma 31B research alias=27.39 tokens/s — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#follow-up-inference-trials
- [parameter] Reported weight footprint: Gemma 12B MLX=About 7.7 GB; Gemma 26B MLX=About 18.0 GB; Gemma 31B research alias=About 19.0 GB — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#follow-up-inference-trials
- [parameter] Estimated footprint including 16K KV cache: Gemma 12B MLX=About 8.9 GB; Gemma 26B MLX=About 20.8 GB; Gemma 31B research alias=About 22.0 GB — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#follow-up-inference-trials
- [parameter] GGUF Qwen 27B: A verification attempt omitted one concept and confused archival age with deletion retention — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#why-we-passed-on-the-faster-candidates
- [parameter] Community Qwen MLX: An early gate exceeded the intended retrieval budget; a later structured gate missed a heading and had incorrect citations — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#why-we-passed-on-the-faster-candidates
- [parameter] Gemma 4 26B MLX: A gate produced ten records with empty evidence fields — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#why-we-passed-on-the-faster-candidates
- [parameter] Gemma 4 12B MLX: Passed a repaired gate and completion, then produced false format names/counts and partition restrictions in a fresh worker — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#why-we-passed-on-the-faster-candidates
- [parameter] Gemma 4 31B MLX: Initially confused the age fields too; corrected them after the extraction fix and passed the reviewed gate and completion — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#why-we-passed-on-the-faster-candidates
- [definition] Getting Gemma 4 MLX to do real research on a Mac — A measured local-agent case study: failed candidates, real tool calls, a corrected research worker, a ten-claim verification gate, and the limits of the Gemma 31B result. — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#getting-gemma-4-mlx-to-do-real-research-on-a-mac
- [definition] What counted as completed work — The test topic was MongoDB Atlas Online Archive **DATE Criteria**. It makes a useful fixture because the documentation contains exact format names, numerical limits and two fields with the same leaf name but different purposes. — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#what-counted-as-completed-work
- [definition] A chat model needed an agent runtime — The noisy terminal output came from interactive `ollama run`: cursor controls and progress animation had entered the job log. The substantive failure was that the process supplied a chat model without an agent tool loop. — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#a-chat-model-needed-an-agent-runtime
- [definition] The measured result — The recorded setup was: — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#the-measured-result
- [definition] Short tool-call probes — The native probe asked the model to read an evidence excerpt and record whether it supported a claim about the correct API field. It used an 8,192-token requested context, temperature zero, thinking disabled and a 512-token output limit per response. — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#short-tool-call-probes
- [definition] Follow-up inference trials — A subsequent performance rerun compared Gemma 12B, 26B and the selected 31B alias on the same 64 GB M5 Max. The table below preserves the supplied results. — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#follow-up-inference-trials
- [definition] Why we passed on the faster candidates — Passing a tiny tool probe was an entry check. Longer tasks exposed different failures. — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#why-we-passed-on-the-faster-candidates
- [definition] The evidence bug that changed the answer — The Atlas API has both `criteria.expireAfterDays` and `dataExpirationRule.expireAfterDays`. The first controls archival eligibility. — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#the-evidence-bug-that-changed-the-answer
- [definition] Getting the setup running — Use the canonical model tag to download the weights, then create the alias used in these tests: — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#getting-the-setup-running
- [definition] A strategy for the attached RTX 5080 — The eGPU harness supplies a second inference path: a tinygrad NV server on port 8000 and an Ollama-shaped bridge on 11440. Read-only checks found the RTX device and TinyGPU registry entry; both metadata endpoints responded, and the backend listed `Qwen2-beta-14B-Chat`. — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#a-strategy-for-the-attached-rtx-5080
- [definition] What these tests establish — Gemma 31B MLX performed file and command work through an agent harness, retrieved real sources, corrected technical claims and completed the recorded workflow stages. The runtime repair passed 309 tests, and Explorer's completion checker accepted the finalized artifact. — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#what-these-tests-establish
- [definition] Inspect the evidence — The public records contain measured counters, phase outcomes and reviewed claims. They exclude private paths, credential configuration, session identifiers and raw model reasoning. — https://llms-explorer.com/blog/getting-gemma-mlx-to-do-real-research/#inspect-the-evidence

## Hub-and-spoke indexes
<https://llms-explorer.com/blog/hub-and-spoke-indexes/>

- [snippet] Commands: PYTHONPATH=scripts .venv/bin/python -m docset_refine export text-mirror/developers.cloudflare.com.md — `# cwd: ~/.global-ai-hub` — https://llms-explorer.com/blog/hub-and-spoke-indexes/#commands
- [parameter] developers.cloudflare.com: Pages=1,943; Root index (bytes)=9,241; Spokes=243 — https://llms-explorer.com/blog/hub-and-spoke-indexes/#inputs
- [parameter] developer.paypal.com: Pages=1,507; Root index (bytes)=4,104; Spokes=193 — https://llms-explorer.com/blog/hub-and-spoke-indexes/#inputs
- [parameter] docs.claude.com: Pages=666; Root index (bytes)=1,977; Spokes=73 — https://llms-explorer.com/blog/hub-and-spoke-indexes/#inputs
- [parameter] docs.langchain.com: Pages=529; Root index (bytes)=1,508; Spokes=15 — https://llms-explorer.com/blog/hub-and-spoke-indexes/#inputs
- [parameter] code.claude.com: Pages=191; Root index (bytes)=1,136; Spokes=6 — https://llms-explorer.com/blog/hub-and-spoke-indexes/#inputs
- [parameter] mongodb.com: Pages=82; Root index (bytes)=3,624; Spokes=30 — https://llms-explorer.com/blog/hub-and-spoke-indexes/#inputs
- [definition] Hub-and-spoke indexes — How saved llms.txt exports split into nested indexes, what the generator preserves, and which historical lint results remain unverified. — https://llms-explorer.com/blog/hub-and-spoke-indexes/#hub-and-spoke-indexes

## Implementing a Native macOS Meeting-Intelligence System
<https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/>

- [snippet] 0\. The shape of the system: ┌─ Capture (Swift, native) ──────────────┐ — `┌─ Capture (Swift, native) ──────────────┐` — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#0-the-shape-of-the-system
- [snippet] 1a. The microphone: import AVFoundation — `import AVFoundation` — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#1a-the-microphone
- [snippet] 1b. The far end — Core Audio process taps: import CoreAudio — `import CoreAudio` — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#1b-the-far-end-core-audio-process-taps
- [snippet] 2a. Confirm the model assets exist: import Speech — `import Speech` — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#2a-confirm-the-model-assets-exist
- [snippet] 2b. The streaming pipeline (live meeting): let transcriber = SpeechTranscriber( — `let transcriber = SpeechTranscriber(` — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#2b-the-streaming-pipeline-live-meeting
- [snippet] 2c. Post-hoc / file mode: let file = try AVAudioFile(forReading: url) — `let file = try AVAudioFile(forReading: url)` — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#2c-post-hoc-file-mode
- [snippet] 3a. Record schema: { "account_id": "acme-corp", — `{ "account_id": "acme-corp",` — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#3a-record-schema
- [snippet] 3a. Record schema: --- — `---` — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#3a-record-schema
- [snippet] 4a. Structured extraction (sentiment, risks, action items): import FoundationModels — `import FoundationModels` — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#4a-structured-extraction-sentiment-risks-action-items
- [snippet] 4b. Surfacing projects that were not explicitly mentioned: @Generable struct LatentOpportunity { — `@Generable struct LatentOpportunity {` — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#4b-surfacing-projects-that-were-not-explicitly-mentioned
- [parameter] You: What it is=your microphone; API=`AVAudioEngine` input node tap — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#1-audio-capture-and-why-it-is-two-streams
- [parameter] Far end: What it is=output from the selected meeting process or processes; API=Core Audio process tap (Apple sample: macOS 14.2+) — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#1-audio-capture-and-why-it-is-two-streams
- [definition] Implementing a Native macOS Meeting-Intelligence System — A proposed macOS meeting pipeline using Core Audio taps and on-device transcription, with capture permissions, lifecycle handling, and reviewed analysis. — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#implementing-a-native-macos-meeting-intelligence-system
- [definition] 1\. Audio capture — and why it is two streams — A meeting has two audio sources that live in different places on macOS: — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#1-audio-capture-and-why-it-is-two-streams
- [definition] 1b. The far end — Core Audio process taps — Apple's Core Audio sample supports process taps on macOS 14.2 or later. Describe a tap, create it, include it in an aggregate device, and read buffers from that device. — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#1b-the-far-end-core-audio-process-taps
- [definition] 1c. Mixing — You now have two ring buffers at possibly different formats. Two strategies: - **Mix to one stream** (`AVAudioMixerNode` or sum the PCM). — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#1c-mixing
- [definition] 2\. Transcription with SpeechAnalyzer — `SpeechAnalyzer` is the macOS 26 coordinator; modules attach to it. `SpeechTranscriber` does speech-to-text; `SpeechDetector` flags voice activity. — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#2-transcription-with-speechanalyzer
- [definition] 2a. Confirm the model assets exist — On-device, but the language model packs may need downloading. Gate on availability and locale, then install: — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#2a-confirm-the-model-assets-exist
- [definition] 2c. Post-hoc / file mode — For a saved recording (or to re-process), skip the live stream: — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#2c-post-hoc-file-mode
- [definition] 2d. The honest gap: diarization — `SpeechAnalyzer` does not provide speaker diarization ("Speaker 1 / Speaker 2"). This is the biggest limitation for meeting use. — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#2d-the-honest-gap-diarization
- [definition] 3\. Transcript to the customer context file — This layer turns transcription into a TAM asset. Two decisions matter: the record schema and where it lives. — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#3-transcript-to-the-customer-context-file
- [definition] 3a. Record schema — Store utterances, not a blob. JSONL appended per meeting: — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#3a-record-schema
- [definition] 3b. Wire into the existing corpus — The `mdb_tam_account_context` corpus already exists, with `corpus_search`/`corpus_query`/`corpus_get` and `report_run`. The native app's job ends at producing a clean utterance record; ingestion pushes into that corpus as a new collection (for example `meeting_transcripts`) keyed by account. — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#3b-wire-into-the-existing-corpus
- [definition] 4\. Sentiment and surfacing latent projects — Two analytical jobs. Both can use the macOS 26 Foundation Models framework when its model is available on the device, or route to the existing LLM stack. — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#4-sentiment-and-surfacing-latent-projects
- [definition] 4b. Surfacing projects that were not explicitly mentioned — This is inference, and it concentrates both the value and the risk. A customer says "the EU cluster failover makes us nervous." Nobody said "disaster recovery project" or "multi-region architecture review," but those are the latent initiatives implied. — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#4b-surfacing-projects-that-were-not-explicitly-mentioned
- [definition] 4c. Closing the loop into action — The analysis becomes TAM motion: create monday items for latent opportunities (gated, human-approved), attach risks to the account's health score, drop action items into the task MCP, and let `tam-weekly-update-builder` fold the sentiment trend into the next update. — https://llms-explorer.com/blog/implementing-a-native-macos-meeting-intelligence-system/#4c-closing-the-loop-into-action

## Keyword plus vector: the cheap path
<https://llms-explorer.com/blog/keyword-plus-vector/>

- [snippet] Commands: .venv/bin/python scripts/docset_indexer.py keyword-index codeclaudecom__codeclaudecom --layer facts — `# cwd: ~/.global-ai-hub` — https://llms-explorer.com/blog/keyword-plus-vector/#commands
- [definition] Keyword plus vector: the cheap path — FTS5 adds token-phrase search without new embedding calls, while reciprocal-rank fusion combines keyword and vector rankings without independently verifying facts. — https://llms-explorer.com/blog/keyword-plus-vector/#keyword-plus-vector-the-cheap-path

## Legible by Construction — Automated Docs, Indexes, Logging, and Test-Centric Design
<https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/>

- [snippet] Principle: ┌─────────────────────────┐ — `                 ┌─────────────────────────┐` — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#principle
- [definition] Legible by Construction — Automated Docs, Indexes, Logging, and Test-Centric Design — A June mdb-context-hub case study of generated docs, retrieval indexes, logging, tests, and shared services, with verified limits of its gates. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#legible-by-construction-automated-docs-indexes-logging-and-test-centric-design
- [definition] 0\. Thesis — For most of software's history, four classes of artifact were treated as secondary to "the real code": documentation, indexes, logs, and tests. You shipped the feature; you wrote the docs if there was time, added logging when something broke, and backfilled tests under duress. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#0-thesis
- [definition] Principle — Treat documentation as a **build artifact**, not a hand-maintained sibling of the code. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#principle
- [definition] The failure mode that matters: staleness — Automated docs can be wrong on day one if their generator is wrong, and they can later drift from their source. The single most valuable thing you can build is not the generator; it is the **staleness gate**: a CI check that fails the build when a generated doc no longer matches its source. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#the-failure-mode-that-matters-staleness
- [definition] In practice — `mdb-context-hub` — The repo runs a deterministic sync pipeline (`scripts/sync-skill-pack.mjs`, invoked as `npm run sync:skills`) that pulls upstream docs plus repo-local sources, normalizes them, and writes JSON registries and generated Markdown. Generated Markdown carries the literal banner: — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#in-practice-mdb-context-hub
- [definition] Principle — The previous section made docs *track* the code. This section inverts the arrow: the best documentation **constrains** the code. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#principle
- [definition] In practice — `mdb-context-hub` — `CLAUDE.md` records the project's conventions and intended invariants. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#in-practice-mdb-context-hub
- [definition] Principle — This is the section where the agent's constraint becomes the architecture's problem. An LLM coding agent is bounded by its context window and degrades as that window fills; this is the "context rot" effect where relevant facts get buried in irrelevant ones. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#principle
- [definition] In practice — `mdb-context-hub` — The repo is, end to end, **an index built so that LLMs can do more than their raw context allows**. That is its purpose. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#in-practice-mdb-context-hub
- [definition] Principle — Logging earns the word "automated" only when it is a **structural property of the system**, not a habit you rely on developers to remember. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#principle
- [definition] In practice — `mdb-context-hub` — This is the repo's strongest pattern. The inspected server registers tools through `instrumentedRegisterTool` (from `telemetry.ts`), and `CLAUDE.md` requires that convention. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#in-practice-mdb-context-hub
- [definition] Principle — The reflexive image of testing is the **test pyramid** (Mike Cohn): many unit tests, fewer integration tests, fewest end-to-end. The more useful modern framing is Kent C. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#principle
- [definition] In practice — `mdb-context-hub` — The suite (eight files under `tests/`) is split exactly along the "test the core, not the transport" line. `tests/mcp-server.test.ts` exercises the service layer directly, and it can, because `service.ts` contains no MCP types (more on why in §6). — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#in-practice-mdb-context-hub
- [definition] 6\. Test-centric design via dual-moding (CLI, API, application) — This is the keystone. Everything above gets cheaper — or stays expensive, depending on one structural decision. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#6-test-centric-design-via-dual-moding-cli-api-application
- [definition] Principle — Build the system as a **single pure core surrounded by thin adapters**. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#principle
- [definition] In practice — `mdb-context-hub` and the TAM tooling — The hub illustrates transport separation, but not a zero-I/O pure core. `service.ts` implements operations without MCP transport types, so tests can call it directly. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#in-practice-mdb-context-hub-and-the-tam-tooling
- [definition] 7\. Costs and anti-patterns — A practitioner review that only sells the upside is marketing. The honest bill: - **Generated docs add build surface.** A generator is code: it has bugs, it needs its own tests, and a broken generator blocks the build. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#7-costs-and-anti-patterns
- [definition] 8\. Synthesis — The six topics are not six best practices. They are one architecture seen from six angles. — https://llms-explorer.com/blog/legible-by-construction-automated-docs-indexes-logging-and-test-centric-design/#8-synthesis

## 54 tokens/sec and real coding tools: what a local eGPU agent can do
<https://llms-explorer.com/blog/local-egpu-real-work/>

- [snippet] The first 9B checkpoint: libtinynv: boot stage failed: level 0 entry 0 is a page where a table was needed — `libtinynv: boot stage failed: level 0 entry 0 is a page where a table was needed` — https://llms-explorer.com/blog/local-egpu-real-work/#the-first-9b-checkpoint
- [parameter] Guarded native startup: Actual result=14.465 seconds; Scope=One successful startup after physical cold recovery — https://llms-explorer.com/blog/local-egpu-real-work/#current-27b-measurements
- [parameter] First arithmetic request: Actual result=0.552 seconds; Scope=HTTP wall time; 64 prompt and 21 generated tokens — https://llms-explorer.com/blog/local-egpu-real-work/#current-27b-measurements
- [parameter] First-request prompt evaluation: Actual result=305.19 tokens/s; Scope=This short, uncached prompt only — https://llms-explorer.com/blog/local-egpu-real-work/#current-27b-measurements
- [parameter] First-request generation: Actual result=59.54 tokens/s; Scope=This 21-token response only — https://llms-explorer.com/blog/local-egpu-real-work/#current-27b-measurements
- [parameter] Complete coding session 1: Actual result=94.963 seconds; Scope=SDK wall time, including actual tools and tests — https://llms-explorer.com/blog/local-egpu-real-work/#current-27b-measurements
- [parameter] Complete coding session 2: Actual result=107.845 seconds; Scope=A fresh fixture and SDK session — https://llms-explorer.com/blog/local-egpu-real-work/#current-27b-measurements
- [parameter] Coding generation throughput: Actual result=53.95 tokens/s; Scope=2,468 native decode tokens across 45.745 seconds — https://llms-explorer.com/blog/local-egpu-real-work/#current-27b-measurements
- [parameter] Original coding verification: Actual result=2/2 passed; Scope=All 21 checks; all 23 builtin schemas advertised — https://llms-explorer.com/blog/local-egpu-real-work/#current-27b-measurements
- [parameter] Strict CPU/GPU numerical reference: Actual result=Failed; Scope=Maximum logprob difference 0.07846 against the declared 0.05 limit — https://llms-explorer.com/blog/local-egpu-real-work/#current-27b-measurements
- [parameter] Standard research acceptance: Actual result=0 concepts; Scope=No successful standard `/dr` at this checkpoint — https://llms-explorer.com/blog/local-egpu-real-work/#current-27b-measurements
- [parameter] Sustained stream decode: Actual result=196.291–196.332 tokens/s; Scope=Three responses of 1,565 tokens each — https://llms-explorer.com/blog/local-egpu-real-work/#what-we-measured
- [parameter] Time for those responses: Actual result=7.976–8.032 seconds; Scope=Client wall time — https://llms-explorer.com/blog/local-egpu-real-work/#what-we-measured
- [parameter] First content on those responses: Actual result=10.1–64.1 ms; Scope=Warm, with 43 of 44 prompt tokens reported cached — https://llms-explorer.com/blog/local-egpu-real-work/#what-we-measured
- [parameter] Short stream decode: Actual result=202.420–202.872 tokens/s; Scope=Three 256-token responses, each stopped at the output limit — https://llms-explorer.com/blog/local-egpu-real-work/#what-we-measured
- [parameter] First short response: Actual result=1.338 seconds to first content; Scope=Only one prompt token reported cached; this was not a cold model-load measurement — https://llms-explorer.com/blog/local-egpu-real-work/#what-we-measured
- [parameter] Completed matched coding pilot: Actual result=3/4 after contract calibration; Scope=Four actual tasks, taking 29.171–36.499 seconds — https://llms-explorer.com/blog/local-egpu-real-work/#what-we-measured
- [parameter] Standard research attempts 7 and 8: Actual result=0/5 concepts independently accepted in each; Scope=650.867 and 539.785 seconds of helper wall time respectively — https://llms-explorer.com/blog/local-egpu-real-work/#what-we-measured
- [parameter] First guarded 9B physical startup: Actual result=Failed during device boot; Scope=One attempt; no model inference or GPU performance measurement — https://llms-explorer.com/blog/local-egpu-real-work/#what-we-measured
- [parameter] Control, pair 1: Temperature=0.7; Seconds=31.505; Raw result=Fail; Calibrated result=Fail: summary written to the wrong path — https://llms-explorer.com/blog/local-egpu-real-work/#a-small-temperature-pilot-with-the-failures-included
- [parameter] Low temperature, pair 1: Temperature=0.15; Seconds=30.450; Raw result=Pass; Calibrated result=Pass — https://llms-explorer.com/blog/local-egpu-real-work/#a-small-temperature-pilot-with-the-failures-included
- [parameter] Low temperature, pair 2: Temperature=0.15; Seconds=36.499; Raw result=Fail; Calibrated result=Pass: model fixed its test import and reran successfully — https://llms-explorer.com/blog/local-egpu-real-work/#a-small-temperature-pilot-with-the-failures-included
- [parameter] Control, pair 2: Temperature=0.7; Seconds=29.171; Raw result=Pass; Calibrated result=Pass — https://llms-explorer.com/blog/local-egpu-real-work/#a-small-temperature-pilot-with-the-failures-included
- [definition] 54 tokens/sec and real coding tools: what a local eGPU agent can do — Two complete Qwen3.5-27B coding sessions on an RTX 5080, the failures that preceded them, and why standard research still needs more work. — https://llms-explorer.com/blog/local-egpu-real-work/#54-tokenssec-and-real-coding-tools-what-a-local-egpu-agent-can-do
- [definition] Current 27B measurements — The experimental llama.cpp/MACUDA/TinyGPU route uses an RTX 5080 with 16 GB VRAM and LiteLLM to translate Claude's Anthropic requests. The complete GGUF file is 9,605,378,528 bytes, with SHA256 `5ccd27a1ab2c909b1c0c3ccaeefde21d0c5c5f277eca2b607b813c18ad4a687e`. — https://llms-explorer.com/blog/local-egpu-real-work/#current-27b-measurements
- [definition] Numerical and memory limits — A CPU-only server using the same file produced the same 21 tokens and arithmetic answer. All logprobs were finite. — https://llms-explorer.com/blog/local-egpu-real-work/#numerical-and-memory-limits
- [definition] What 27B research exposed — The original source, negative-evidence and quality floors described below remain in force. The first actual 27B variant hit 60 turns on Cache freshness after 828.349 seconds: ten searches, twelve fetches, thirty-seven reads and no publication. — https://llms-explorer.com/blog/local-egpu-real-work/#what-27b-research-exposed
- [definition] Earlier 4B measurements and failures — Our experimental Qwen3-4B route sustained about **196 generated tokens per second** on an Apple Silicon Mac with an RTX 5080 eGPU. It could also drive Claude Code’s actual coding tools. — https://llms-explorer.com/blog/local-egpu-real-work/#earlier-4b-measurements-and-failures
- [definition] What we measured — The tested route used Qwen3-4B-Instruct-2507 Q4_K_M, a 32,768-token native context, llama.cpp through the experimental MACUDA/TinyGPU path, and LiteLLM to translate Claude’s Anthropic requests. This was a separate runtime from the earlier MLX trials. — https://llms-explorer.com/blog/local-egpu-real-work/#what-we-measured
- [definition] Making the tools usable — A model that emits plausible tool-call JSON has passed only an interface check. — https://llms-explorer.com/blog/local-egpu-real-work/#making-the-tools-usable
- [definition] A small temperature pilot, with the failures included — We used two matched fixtures and a predetermined **control, low-temperature, low-temperature, control** order. Each pair shared its initial fixture and task, with a fresh directory and marker. — https://llms-explorer.com/blog/local-egpu-real-work/#a-small-temperature-pilot-with-the-failures-included
- [definition] Research exposed a different limit — The research task covered five concepts in HTTP cache validation and conditional revalidation. — https://llms-explorer.com/blog/local-egpu-real-work/#research-exposed-a-different-limit
- [definition] What the hardware evidence proves — The experiment retained model, binary, boot and owner identities alongside completed mathematical kernel stamps from the same physical runtime. The benchmark comparison recorded a lower bound of **2,292,920 new mathematical stamps** between native publications. — https://llms-explorer.com/blog/local-egpu-real-work/#what-the-hardware-evidence-proves
- [definition] The first 9B checkpoint — The next candidate at that checkpoint was a language GGUF from a separately pinned publisher revision. Its complete 6,169,341,984-byte file has SHA256 `d784ce9eda1a5a7b51e8f705a9e6310844bf4f173654d115823c775fdea56d43`. — https://llms-explorer.com/blog/local-egpu-real-work/#the-first-9b-checkpoint

## Local Model Performance: An Unverified Reported MLX, RTX 5080 eGPU and Ollama Comparison
<https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/>

- [snippet] 1. The Core Bottleneck: The Memory Bandwidth Ceiling: +-----------------------------------------------------------------------------------+ — `+-----------------------------------------------------------------------------------+` — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#1-the-core-bottleneck-the-memory-bandwidth-ceiling
- [snippet] 3. Runtime Engine Comparison: MLX vs Ollama vs Tinygrad: +----------------------------------------------------------------------------------------+ — `+----------------------------------------------------------------------------------------+` — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#3-runtime-engine-comparison-mlx-vs-ollama-vs-tinygrad
- [snippet] 1. Running the Benchmark Suite: $ python3 scripts/benchmark_suite.py --host http://127.0.0.1:11440 --model "Qwen2-beta-14B-Chat" --runs 3 — `$ python3 scripts/benchmark_suite.py --host http://127.0.0.1:11440 --model "Qwen2-beta-14B-Chat" --r` — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#1-running-the-benchmark-suite
- [snippet] 2. Profiling Memory Residency: $ python3 scripts/memory_profiler.py — `$ python3 scripts/memory_profiler.py` — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#2-profiling-memory-residency
- [definition] Local Model Performance: An Unverified Reported MLX, RTX 5080 eGPU and Ollama Comparison — An unverified MLX, RTX 5080 eGPU and Ollama comparison with withdrawn conclusions, preserved transcripts, and documented benchmark-script limits. — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#local-model-performance-an-unverified-reported-mlx-rtx-5080-egpu-and-ollama-comparison
- [definition] 1. The Core Bottleneck: The Memory Bandwidth Ceiling — During auto-regressive decoding, a language model evaluates tokens sequentially. A rough bandwidth estimate for batch-one dense-model decoding assumes that weight reads dominate and approximates the bytes read per generated token by the resident weight footprint: — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#1-the-core-bottleneck-the-memory-bandwidth-ceiling
- [definition] Why Bus Streaming Across Thunderbolt 5 Fails — The original example assumes that all 21.9 GB cross the link for every generated token and that payload throughput is 7.0 GB/s. Under exactly those assumptions, the arithmetic is: $$\text{Streaming TPS} = \frac{7.0 \text{ GB/s}}{21.9 \text{ GB}} \approx 0.32 \text{ tokens/sec}$$ — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#why-bus-streaming-across-thunderbolt-5-fails
- [definition] 2. In-Depth Model Profiling — The following footprints, aliases, KV-cache sizes, and throughput ranges are retained original claims. No matched model revision, quantization metadata, context/batch configuration, or public run artifacts were identified. — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#2-in-depth-model-profiling
- [definition] 3. Runtime Engine Comparison: MLX vs Ollama vs Tinygrad — The ASCII table preserves the original taxonomy. Its overhead percentages, optimal model-size ranges, and Tinygrad PTX/NVFP4 row have no retained versioned measurement or configuration receipt; they should not be used as runtime-selection facts. — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#3-runtime-engine-comparison-mlx-vs-ollama-vs-tinygrad
- [definition] 1. Apple MLX — [MLX](https://ml-explore.github.io/mlx/build/html/index.html) uses shared CPU/GPU memory on Apple Silicon and lazy evaluation. Sharing array storage can avoid explicit CPU-to-GPU buffer copies; it does not eliminate all file I/O, conversion, temporary allocations, or synchronization. — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#1-apple-mlx
- [definition] 2. Ollama / llama.cpp — Ollama packages models as GGUF files. GGUF maps tensors from disk into virtual address space via `mmap()`. — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#2-ollama-llamacpp
- [definition] 3. Tinygrad eGPU Accelerator — [Tinygrad documents multiple runtimes](https://docs.tinygrad.org/runtime/), including an NV backend. The selected renderer, supported model kernels, quantization, allocation, and residency require version-specific confirmation. — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#3-tinygrad-egpu-accelerator
- [definition] 4. The Evaluation Metrics Framework — A useful evaluation separates latency, throughput, timing variation, and memory pressure. These measurements can interact: 1. — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#4-the-evaluation-metrics-framework
- [definition] 5. Benchmarking with the Harness Tools — The downloadable scripts are inspection aids with limitations. The commands below are preserved historical examples, not a verified reproduction of the cross-platform comparison. — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#5-benchmarking-with-the-harness-tools
- [definition] 1. Running the Benchmark Suite — The September 30 source at `/downloads/benchmarks/benchmark_suite.py` sends non-streaming requests to Ollama's `/api/generate`. Its `ttft_sec` adds server load and prompt-evaluation durations; it does not observe first-token arrival or inter-token jitter. — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#1-running-the-benchmark-suite
- [definition] 2. Profiling Memory Residency — The September 30 `memory_profiler.py` reads `vm_stat` system counters and `system_profiler` hardware descriptions. It does not sample process RSS or discrete-GPU allocations. — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#2-profiling-memory-residency
- [definition] 6. Downloadable Assets — The benchmark scripts created during this evaluation are available for download: - **[benchmark_suite.py](/downloads/benchmarks/benchmark_suite.py)**: Ollama `/api/generate` harness reporting server timing fields and client wall time. — https://llms-explorer.com/blog/local-model-performance-evaluation-mlx-egpu/#6-downloadable-assets

## Getting local models to do real work: MLX, eGPU coding, and research failures
<https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/>

- [snippet] The task was larger than chat: Apple route: — `Apple route:` — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-task-was-larger-than-chat
- [snippet] Correct output still failed numerical comparison: {"sum": 42, "product": 56, "gcd": 6} — `{"sum": 42, "product": 56, "gcd": 6}` — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#correct-output-still-failed-numerical-comparison
- [parameter] Fresh one-concept worker: Time=243 s; Result=Six claims; an archival-age error still needed correction — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#gemma-mlx-produced-inspectable-research
- [parameter] Evidence-directed correction: Time=293.349 s; Result=Six corrected facts agreed with reviewed sources — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#gemma-mlx-produced-inspectable-research
- [parameter] Fresh ten-claim gate: Time=315 s; Result=Ten supported judgments; eight scrape attempts — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#gemma-mlx-produced-inspectable-research
- [parameter] Explorer completion: Time=41.445 s; Result=Canonical finish and manifest completion returned `ok` — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#gemma-mlx-produced-inspectable-research
- [parameter] Cold model load: Gemma12 MLX=1.424 s; Gemma26 MLX=2.633 s; Gemma31 research alias=4.635 s — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-reported-mlx-throughput-rerun
- [parameter] Warm model load: Gemma12 MLX=0.017–0.064 s; Gemma26 MLX=0.010–0.019 s; Gemma31 research alias=0.020–0.064 s — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-reported-mlx-throughput-rerun
- [parameter] Prompt ingestion, 114 tokens: Gemma12 MLX=390.58 tokens/s; Gemma26 MLX=78.86–83.87 tokens/s; Gemma31 research alias=123.59 tokens/s — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-reported-mlx-throughput-rerun
- [parameter] Reported early-response estimate: Gemma12 MLX=0.309 s; Gemma26 MLX=1.465 s; Gemma31 research alias=0.944 s — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-reported-mlx-throughput-rerun
- [parameter] Short generation, 35-token prompt: Gemma12 MLX=67.42–96.50 tokens/s; Gemma26 MLX=126.97–130.27 tokens/s; Gemma31 research alias=25.37–29.07 tokens/s — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-reported-mlx-throughput-rerun
- [parameter] Sustained generation, 2,600+ output tokens: Gemma12 MLX=63.75 tokens/s; Gemma26 MLX=89.42 tokens/s; Gemma31 research alias=27.39 tokens/s — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-reported-mlx-throughput-rerun
- [parameter] Reported weight footprint: Gemma12 MLX=About 7.7 GB; Gemma26 MLX=About 18.0 GB; Gemma31 research alias=About 19.0 GB — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-reported-mlx-throughput-rerun
- [parameter] Estimated weights plus 16k KV: Gemma12 MLX=About 8.9 GB; Gemma26 MLX=About 20.8 GB; Gemma31 research alias=About 22.0 GB — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-reported-mlx-throughput-rerun
- [parameter] 4B matched temperature pilot: Recorded outcome=3/4 after contract calibration; originally 2/4; Boundary=Small pilot; no established causal temperature winner — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-physical-egpu-could-code
- [parameter] 9B fresh accepted coding pair: Recorded outcome=2/2; 48.701 and 51.992 s; Boundary=Cold recovery and client fixes preceded acceptance — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-physical-egpu-could-code
- [parameter] Qwen3.5-27B IQ2_XXS fresh coding pair: Recorded outcome=2/2; 94.963 and 107.845 s; Boundary=Original 21 checks; about 53.95 native decode tokens/s — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-physical-egpu-could-code
- [parameter] Current Qwen3.6-27B IQ2_XXS: Recorded outcome=Full coding not run; Boundary=Correct arithmetic does not inherit earlier coding acceptance — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-physical-egpu-could-code
- [parameter] 4B attempts 7 and 8: Each independently accepted 0/5 concepts; helper times 650.867 and 539.785 s — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#standard-research-remained-unaccepted
- [parameter] Later 9B standard research: Ended without accepted standard research — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#standard-research-remained-unaccepted
- [parameter] Earlier 27B original 150-minute trial: Ended with zero accepted concepts; some variants left workers unattempted — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#standard-research-remained-unaccepted
- [parameter] Later Qwen3.5 27B terminal trial: All five attempted; zero accepted; final helper result `BLOCKED` — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#standard-research-remained-unaccepted
- [parameter] Current Qwen3.6 candidate: Standard research not run — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#standard-research-remained-unaccepted
- [parameter] Claude Code 2.1.286: Original description text=20,093 tokens; Existing compact description text=7,862 tokens — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#measure-the-actual-agent-input
- [parameter] Claude Code 2.1.289: Original description text=20,130 tokens; Existing compact description text=7,899 tokens — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#measure-the-actual-agent-input
- [parameter] Server prompt evaluation: Eight-thread CPU reference=7.47 tokens/s; Quantized-prefill eGPU=289.93 tokens/s; F32-prefill eGPU=16.09 tokens/s — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#correct-output-still-failed-numerical-comparison
- [parameter] Server generation: Eight-thread CPU reference=6.12 tokens/s; Quantized-prefill eGPU=59.10 tokens/s; F32-prefill eGPU=59.80 tokens/s — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#correct-output-still-failed-numerical-comparison
- [parameter] Client request wall time: Eight-thread CPU reference=11.8356 s; Quantized-prefill eGPU=0.5619 s; F32-prefill eGPU=4.3174 s — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#correct-output-still-failed-numerical-comparison
- [parameter] Maximum selected-token logprob difference: Eight-thread CPU reference=Reference; Quantized-prefill eGPU=0.063163; F32-prefill eGPU=0.087565 — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#correct-output-still-failed-numerical-comparison
- [parameter] Original numerical requirement: Eight-thread CPU reference=Reference; Quantized-prefill eGPU=Failed; F32-prefill eGPU=Failed — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#correct-output-still-failed-numerical-comparison
- [definition] Getting local models to do real work: MLX, eGPU coding, and research failures — The complete investigation so far: useful Gemma MLX research phases, RTX 5080 coding sessions, failed standard research, context measurements, and the Qwen3.6 numerical discrepancy. — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#getting-local-models-to-do-real-work-mlx-egpu-coding-and-research-failures
- [definition] The task was larger than chat — The starting problem looked like a model-selection issue. Selecting Gemma in Explorer and asking for `/dr` produced cursor-control sequences in the job log and a response explaining that the model could not execute the command. — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-task-was-larger-than-chat
- [definition] Gemma MLX produced inspectable research — On the 64 GB M5 Max, the selected Apple research model was `llmsx-research-gemma31-mlx`, based on official `gemma4:31b-mlx`. The recorded setup used Ollama 0.34.4 and requested 65,536 tokens of context. — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#gemma-mlx-produced-inspectable-research
- [definition] The reported MLX throughput rerun — A subsequent user-supplied rerun reported these figures on the same 64 GB M5 Max. They are preserved as reported data. — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-reported-mlx-throughput-rerun
- [definition] The physical eGPU could code — The early tinygrad launcher path failed before it qualified the intended workflow. Later work moved to the experimental llama.cpp/MACUDA/TinyGPU route, retaining exact model and binary identities and completed mathematical kernel records from the physical runtime. — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#the-physical-egpu-could-code
- [definition] Standard research remained unaccepted — The physical research fixture covered five HTTP concepts: cache freshness, 304 responses, ETag validators, Last-Modified validators and conditional request precedence. — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#standard-research-remained-unaccepted
- [definition] Measure the actual agent input — Context became a separate engineering problem. One early request reached 33,496 tokens against a 32,768-token backend. — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#measure-the-actual-agent-input
- [definition] Correct output still failed numerical comparison — The current physical candidate is a complete **9,605,378,560-byte Qwen3.6-27B IQ2_XXS GGUF**, with 32,768 context, f16 KV and no MTP. The first matched request contained 64 uncached prompt tokens and generated this 21-token answer: — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#correct-output-still-failed-numerical-comparison
- [definition] Precision, memory and recovery need separate evidence — Source inspection found different activation-quantization paths in the CPU and CUDA calculations. The Q5_K output projection uses CPU Q8_K activations and a CUDA Q8_1 dot path. — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#precision-memory-and-recovery-need-separate-evidence
- [definition] What the newer Mac research changed — Reviewing the Mac-local-LLM skill and hub concept corpus added useful hypotheses about agent input, prefix caching, reasoning replay and hybrid checkpoints. It did not supply a measured cure for the physical numerical failure. — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#what-the-newer-mac-research-changed
- [definition] Operational lessons and the remaining work — Repeated trials also filled the model stores. Cleanup used saved rejection provenance, active-file-holder checks and retained-manifest reachability. — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#operational-lessons-and-the-remaining-work
- [definition] Inspect the consolidated evidence — The overview's machine-readable record separates recorded results, reported-only data, source inspection and unverified requirements: https://llms-explorer.com/downloads/benchmarks/local-model-findings-2026-10-05/findings.json — https://llms-explorer.com/blog/local-models-real-work-mlx-egpu/#inspect-the-consolidated-evidence

## Markdown as the LLM Output Gateway
<https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/>

- [snippet] 5\. The Pipeline: Tokens → AST → Render: MACHINE SIDE                                                            HUMAN SIDE — ` MACHINE SIDE                                                            HUMAN SIDE` — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#5-the-pipeline-tokens-ast-render
- [snippet] Appendix B — A Round-Trip Illustration: {"clusters":[{"name":"prod-east","tier":"M30","alerts":2},{"name":"prod-west","tier":"M40","alerts":0}]} — `{"clusters":[{"name":"prod-east","tier":"M30","alerts":2},{"name":"prod-west","tier":"M40","alerts":` — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#appendix-b-a-round-trip-illustration
- [snippet] Appendix B — A Round-Trip Illustration: | Cluster   | Tier | Open alerts | — `| Cluster   | Tier | Open alerts |` — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#appendix-b-a-round-trip-illustration
- [parameter] **marked.js**: Ecosystem=browser/Node; Model=lexer → tokens → renderer; Notable trait=Fast; deliberately *does not sanitize* (defers to DOMPurify) — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#5-the-pipeline-tokens-ast-render
- [parameter] **markdown-it**: Ecosystem=browser/Node; Model=pluggable token stream; Notable trait=CommonMark-compliant; HTML disabled by default (`html: false`) — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#5-the-pipeline-tokens-ast-render
- [parameter] **remark / unified**: Ecosystem=Node/build; Model=mdast \+ plugin transforms; Notable trait=Spec-grade via micromark; powers MDX, react-markdown's pipeline — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#5-the-pipeline-tokens-ast-render
- [parameter] **micromark**: Ecosystem=low-level; Model=streaming tokenizer; Notable trait=CommonMark/GFM reference-grade core — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#5-the-pipeline-tokens-ast-render
- [parameter] **react-markdown**: Ecosystem=React; Model=mdast → hast → React elements; Notable trait=Renders to a component tree, not an HTML string — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#5-the-pipeline-tokens-ast-render
- [parameter] Human readability (unrendered): Markdown=**High**; JSON=Low (nested); XML=Low–med; HTML=Med (verbose); Plain text=**Highest** — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#9-the-format-bake-off
- [parameter] Structural fidelity: Markdown=Bounded prose structures; JSON=Typed data model; XML=Structured elements/attributes; HTML=Document structure and layout; Plain text=Conventions only — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#9-the-format-bake-off
- [parameter] Token overhead: Markdown=**Low**; JSON=Medium; XML=High; HTML=High; Plain text=**Lowest** — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#9-the-format-bake-off
- [parameter] Streaming / partial-parse: Markdown=Reparse growing buffer; JSON=Incremental parser or record framing; XML=Event parsers available; HTML=Incremental browser parser; Plain text=Immediate display — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#9-the-format-bake-off
- [parameter] Machine round-trip: Markdown=Mapping needs assumptions; JSON=Values within supported types/number precision; XML=Defined by parser and canonicalization; HTML=DOM may normalize source; Plain text=Mapping needs conventions — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#9-the-format-bake-off
- [parameter] Native render target: Markdown=via HTML; JSON=none; XML=none; HTML=**direct**; Plain text=none — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#9-the-format-bake-off
- [parameter] **Markdown**: A lightweight, punctuation-based markup language (Gruber & Swartz, 2004\) whose source is meant to be legible unrendered. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#appendix-a-glossary
- [parameter] **CommonMark**: A strict, versioned, test-suite-backed Markdown specification created to remove ambiguity. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#appendix-a-glossary
- [parameter] **GFM**: GitHub Flavored Markdown; a CommonMark superset adding tables, task lists, strikethrough, autolinks, and a raw-HTML filter. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#appendix-a-glossary
- [parameter] **mdast / hast**: Markdown AST / HTML AST in the unified ecosystem. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#appendix-a-glossary
- [parameter] **micromark**: Low-level CommonMark/GFM-compliant tokenizer underpinning remark. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#appendix-a-glossary
- [parameter] **DOMPurify**: The standard client-side HTML sanitizer used to neutralize XSS in rendered Markdown. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#appendix-a-glossary
- [parameter] **Gateway (this doc)**: A semantic translation membrane between machine representation and human cognition — *not* an AI-proxy control plane. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#appendix-a-glossary
- [parameter] **llms.txt**: A 2024 proposed convention for an LLM-friendly Markdown file at a site root (limited adoption). — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#appendix-a-glossary
- [definition] Markdown as the LLM Output Gateway — A technical review of Markdown as an LLM presentation layer, with sources for parsing, streaming, security and the limits of structured-data conversion. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#markdown-as-the-llm-output-gateway
- [definition] 1\. Framing the Thesis — An LLM's native output is a sequence of tokens sampled one at a time from a probability distribution. Nothing about that sequence is intrinsically "formatted." Formatting is a *convention the model learned to emit* and that downstream software learned to *interpret*. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#1-framing-the-thesis
- [definition] 2\. What "Machine → Human" Actually Means Here — The phrase "transforming machine language into human-readable output" needs unpacking, because three distinct machine-side inputs converge on the same Markdown gateway: - **The token stream itself.** The model's own next-token output, shaped into Markdown syntax because the model was trained to… — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#2-what-machine-human-actually-means-here
- [definition] 3\. Why LLMs Converged on Markdown — Why this format and not HTML, JSON, reStructuredText, or plain prose? The reasons sort cleanly into what is well-established, what is plausible mechanism, and what is genuinely contested. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#3-why-llms-converged-on-markdown
- [definition] 4\. The Format Substance: CommonMark, GFM, and Dialect Drift — "Markdown" is not one language; it is a family with a contested center. Reviewing the gateway requires knowing exactly what structure the contract guarantees. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#4-the-format-substance-commonmark-gfm-and-dialect-drift
- [definition] 5\. The Pipeline: Tokens → AST → Render — The gateway is not a single step; it is a small pipeline. Understanding it is necessary to reason about both streaming (§7) and security (§6). — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#5-the-pipeline-tokens-ast-render
- [definition] 6\. Rendering and the Safety Surface — The moment Markdown becomes HTML, it inherits HTML's attack surface — and LLM output is, by definition, untrusted-adjacent text that may be steered by upstream content (prompt injection, poisoned RAG context). — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#6-rendering-and-the-safety-surface
- [definition] 7\. Streaming: Markdown's Structural Advantage and Its Failure Mode — LLMs generate left-to-right, and modern UIs stream tokens as they arrive. Markdown is unusually well-suited to this, and understanding why — and where it breaks — is core to the gateway's behavior. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#7-streaming-markdowns-structural-advantage-and-its-failure-mode
- [definition] 8\. Semantic Fidelity: Markdown Is Lossy by Design — The single most important property for evaluating the thesis: **Markdown is a lossy, bounded representation.** It is not a general structured-data format and was never meant to be. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#8-semantic-fidelity-markdown-is-lossy-by-design
- [definition] 9\. The Format Bake-Off — Set Markdown against the alternatives on the dimensions that matter for a machine→human contract. **\[ANALYSIS — qualitative synthesis.\]** — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#9-the-format-bake-off
- [definition] 10\. The Reverse Channel: Markdown as Machine *Input* — A complete review must note that the gateway runs **both directions**, which is under-appreciated. Markdown is not only how models *talk to humans*; it is increasingly how humans (and pipelines) *talk to models*. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#10-the-reverse-channel-markdown-as-machine-input
- [definition] 11\. Failure Modes and Anti-Patterns — Naming the gateway's failure modes is part of operating it responsibly. — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#11-failure-modes-and-anti-patterns
- [definition] 12\. Evidence & Epistemics — To keep the review honest, the claims sort into three tiers: - **\[ESTABLISHED\]** (verifiable from specs/implementations): the described two-phase parse strategy; CommonMark's existence as a versioned spec with a test suite; GFM's superset features; the raw-HTML XSS class and DOMPurify/CSP as… — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#12-evidence-epistemics
- [definition] Appendix B — A Round-Trip Illustration — Machine-side input (a structured tool result the model holds in context): — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#appendix-b-a-round-trip-illustration
- [definition] Sources and scope — This review checks format and parser behavior against [CommonMark 0.31.2](https://spec.commonmark.org/0.31.2/), [GFM](https://github.github.com/gfm/), [marked](https://marked.js.org/), [react-markdown](https://github.com/remarkjs/react-markdown), [micromark](https://github.com/micromark/micromark)… — https://llms-explorer.com/blog/markdown-as-the-llm-output-gateway/#sources-and-scope

## MDB Case Assistant — Project Pitch
<https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/>

- [snippet] Origin allowlist: https://support.mongodb.com/* — `https://support.mongodb.com/*` — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#origin-allowlist
- [snippet] System context: Support engineer in Chrome — `Support engineer in Chrome` — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#system-context
- [snippet] Install steps: git clone <repo-url> — `# 1. Clone the repository` — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#install-steps
- [parameter] **Context switching**: Triage panel appears on the case page itself — engineers do not leave the Hub or Support Portal to get enriched context or an AI summary. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#problems-solved-leadership-team
- [parameter] **Tribal knowledge**: In-repo KB index and diagnostic tool registry surface relevant articles and tools at the case level, reducing reliance on knowing where to look. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#problems-solved-leadership-team
- [parameter] **Prompt drift**: A single shared prompt builder (`buildCaseAnalysisPrompt`) produces a consistent tracker-style case structure across Glean and manual flows; format does not vary by engineer. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#problems-solved-leadership-team
- [parameter] **Manual lookups**: TS Tools enrichment, HELP Jira resolution, and account case listing run together from a single operator action, replacing individual copy-paste lookups. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#problems-solved-leadership-team
- [parameter] **Auth friction**: The extension reuses the engineer's active Chrome session; no separate credentials are required to access Hub, Support, or Jira data. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#problems-solved-leadership-team
- [parameter] **Ownerless case blind spots**: Operator-triggered account sync flags unowned cases and surfaces an alert popup for acknowledgment or escalation. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#problems-solved-leadership-team
- [parameter] **Untested incident playbooks**: Firedrill mode rehearses the joint incident playbook against a simulated case — same tracker UI, roles, and severity model as a real S1 — with a readiness scorecard, so teams find gaps before a real outage instead of during one. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#problems-solved-leadership-team
- [parameter] **Slow S1 mobilization**: The S1 Swarm pre-assembles analysis, Slack drafts, action items, and an escalation path the moment an S1 is detected, so the responder starts from a packet ready for human review. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#problems-solved-leadership-team
- [parameter] **Session loss on worker restart**: MV3 lifecycle handled through `chrome.storage.session` cache and alarm-driven pruning so case context survives worker suspension. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#problems-solved-leadership-team
- [parameter] Chrome extension running on `support.mongodb.com` and internal MongoDB employee domains: Firefox, Safari, Edge, or other browsers — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#scope-leadership-reviewers
- [parameter] Glean endpoint requests for AI-assisted analysis: Direct calls to any other AI or LLM provider — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#scope-leadership-reviewers
- [parameter] Hub API enrichment via same-tab cookie-backed or bearer-token fallback: Fetching data from any non-declared internal API host — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#scope-leadership-reviewers
- [parameter] HELP Jira issue enrichment from `jira.mongodb.org`: Other Jira tenants or Atlassian products — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#scope-leadership-reviewers
- [parameter] Local stdio MCP server for AI assistant integration (developer/operator tool): A packaged, hosted, or public MCP backend — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#scope-leadership-reviewers
- [parameter] Reading live case data; mutating local extension state (tracking) and driving the local Firedrill simulator: Mutating a real customer case — status, assignment, or comments on the live Salesforce/Jira record — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#scope-leadership-reviewers
- [parameter] Manual, operator-triggered backend calls (manual mode, default since 2026-05-28): Unattended background polling or auto-refresh of internal systems — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#scope-leadership-reviewers
- [parameter] Static in-repo KB and diagnostic tool registry: Live indexing from external documentation or search services — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#scope-leadership-reviewers
- [parameter] `chrome.storage.local` and `chrome.storage.session` for durable and disposable state: Remote persistence, telemetry, or central logging — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#scope-leadership-reviewers
- [parameter] `npm run dev:extension` localhost relay for development: A shipped production backend — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#scope-leadership-reviewers
- [parameter] Unpacked extension loaded in Chrome Developer mode: A signed Chrome Web Store release or enterprise deployment — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#scope-leadership-reviewers
- [parameter] Service worker: Entry point=`src/background/service-worker.js`; Role=Canonical `MCA_*` message router; owns storage, enrichment, analysis, overlay control, alarms — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#runtime-containers
- [parameter] Content script: Entry point=`src/content/hub-extractor.js`; Role=Scrapes case-page DOM; emits `MCA_UPSERT_CASE_CONTEXT` — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#runtime-containers
- [parameter] Overlay shell: Entry point=`src/content/case-overlay.js`; Role=Mounts shadow DOM; hosts the panel iframe; bridges `postMessage` — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#runtime-containers
- [parameter] Panel iframe: Entry point=`src/panel/panel.html` \+ `panel.js`; Role=Main operator triage workflow — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#runtime-containers
- [parameter] Toolbar popup: Entry point=`src/popup/*`; Role=Quick status, overlay toggle, open options — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#runtime-containers
- [parameter] Options page: Entry point=`src/options/*`; Role=Configure Glean, TS Tools, theme, auto-show — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#runtime-containers
- [parameter] Dashboard page: Entry point=`src/dashboard/*`; Role=Tracked account and case management — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#runtime-containers
- [parameter] Alert page: Entry point=`src/alerts/*`; Role=Ownerless-case acknowledgement — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#runtime-containers
- [parameter] Firedrill engine: Entry point=`src/background/firedrill-engine.js` (+ `firedrill-state.js`, `firedrill-persona.js`, `firedrill-scorecard.js`, `firedrill-snapshot-source.js`, `firedrill-worker-bridge.js`); Role=Drives the simulated-case drill: persona replies, injected complications, readiness scorecard, drill-safety guards — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#runtime-containers
- [parameter] S1 Swarm: Entry point=`src/background/s1-swarm-dispatcher.js` (+ `s1-swarm-config.js`, dashboard `s1-swarm-tab.js`); Role=Fans analysis agents out on S1 detection; assembles Slack drafts, action items, escalation path — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#runtime-containers
- [parameter] Backend gate: Entry point=`src/background/backend-gate.js`; Role=Checks manual-mode configuration and serializes backend requests; caller routing enforces operator triggers — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#runtime-containers
- [parameter] Shared packages: Entry point=`packages/*`; Role=Pure ESM: Atlas diagnostics, live Hub reconciliation, vault crypto — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#runtime-containers
- [parameter] Local MCP server: Entry point=`mcp-server/src/index.ts`; Role=stdio bridge into the helper relay; registers all 42 `mdb_case_*` tools — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#runtime-containers
- [definition] MDB Case Assistant — Project Pitch — A dated pitch for MDB Case Assistant, covering case triage, incident drills, operator-triggered enrichment and the local integration trust boundary. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#mdb-case-assistant-project-pitch
- [definition] Executive Summary *(leadership)* — MDB Case Assistant is a Chrome browser extension built for MongoDB Technical Account Managers and Support Engineers. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#executive-summary-leadership
- [definition] Trust model — The extension trusts the authenticated Chrome profile and any active browser session established with the declared host origins. There is no extension-specific login system for Hub, Jira, or TS Tools — that access flows through the engineer's existing browser session. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#trust-model
- [definition] Manual mode (default) — Following the 2026-05-28 security review, backend access is gated to **manual mode**: internal-system calls are intended to follow operator actions, with background polling removed. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#manual-mode-default
- [definition] Loopback-only binding — The development helper relay binds exclusively to `127.0.0.1:17324`. That binding limits direct reachability to the local machine unless someone adds forwarding or a proxy. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#loopback-only-binding
- [definition] Origin allowlist — `manifest.json` declares explicit `host_permissions` for every external surface the extension contacts. There is no `<all_urls>` permission. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#origin-allowlist
- [definition] Content Security Policy — `manifest.json` pins an explicit `content_security_policy.extension_pages`: `script-src 'self'` (no inline scripts, no `eval`), a `connect-src` allowlist matching the host allowlist above, `object-src 'none'`, `base-uri 'self'`, and `frame-ancestors` restricted to the supported Hub / Support /… — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#content-security-policy
- [definition] Local transport and credentials — The local MCP server uses stdio transport only. There is no loopback HTTP MCP endpoint. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#local-transport-and-credentials
- [definition] What to audit before changing transport — Before adding an HTTP MCP transport or exposing the relay on a network interface, audit: 1. `mcp-server/src/relay-client.ts` — relay token handling and relay command serialization 2. — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#what-to-audit-before-changing-transport
- [definition] System context — The following diagram is adapted with internal domains omitted from `docs/ARCHITECTURE.md` §3.1: — https://llms-explorer.com/blog/mdb-case-assistant-project-pitch/#system-context

## MDB Context Hub — Project Briefing
<https://llms-explorer.com/blog/mdb-context-hub-project-briefing/>

- [snippet] Layered model: Upstream docs (mdb-case-assistant, mdb-tam) + local-sources/ — `Upstream docs (mdb-case-assistant, mdb-tam) + local-sources/` — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#layered-model
- [parameter] **Context switching:** leaving the editor to find a runbook or skill guide: `tam_recommend_skills` and `tam_build_skill_bundle` surface ranked context in-editor from a natural-language query — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Tribal knowledge:** guidance lost on role change or departure: Skills, prompts, and catalogs are committed to a shared repo; every installer gets the same base — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Prompt drift:** each AI session starts blank, so output quality varies by operator: `tam_optimize_prompt` applies a consistent structure and saves reusable prompts to `prompts/saved/` — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Manual lookups:** which internal repo, shared module, or MCP server applies: `tam_recommend_repo_libraries` / `tam_recommend_shared_libraries` / `tam_recommend_mcps` return scored recommendations — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Onboarding friction:** weeks to learn the toolset: The skill pack documents every tool with a description and a when-to-use, readable by humans and agents alike — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Telemetry blindness:** no record of which tool calls ran or failed: Every tool is wrapped by `instrumentedRegisterTool`; call history and call cards expose status and suggested fixes — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Knowledge-coverage tracking:** no map of what has been researched: The 431-node concept tree ties researched topics back to skills — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Stale reference URLs:** links rot silently: The staleness detector HTTP-HEAD-checks URL reachability (`tam_staleness_scan`) — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#3-problems-solved-leadership-team
- [parameter] Service layer (all business logic): Path=`mcp-server/src/service.ts`; Approx. lines=~3,920 — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Server / tool registration: Path=`mcp-server/src/server.ts`; Approx. lines=~2,740 — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Telemetry middleware: Path=`mcp-server/src/telemetry.ts`; Approx. lines=~620 — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Staleness detector: Path=`mcp-server/src/staleness.ts`; Approx. lines=~540 — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Operations registry: Path=`mcp-server/src/operations-registry.ts`; Approx. lines=~530 — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Dependency graph: Path=`mcp-server/src/dependency-graph.ts`; Approx. lines=~390 — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Prompt variants: Path=`mcp-server/src/prompt-variants.ts`; Approx. lines=~260 — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Remaining MCP-server modules: Path=`mcp-server/src/*`; Approx. lines=balance of ~9,980 total — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Sync pipeline: Path=`scripts/*.mjs`; Approx. lines=~2,410 — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Test suite: Path=`tests/*.ts`; Approx. lines=~2,700 — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#4-scope-of-work-leadership-reviewers
- [definition] MDB Context Hub — Project Briefing — A project briefing on the MDB Context Hub, a local-first MCP server for TAM skills, prompts and catalogs, covering its features, architecture, security model and setup. — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#mdb-context-hub-project-briefing
- [definition] Trust model — The hub trusts a single local user. There is **no authentication, authorization, rate limiting, or audit logging by design**: the security model is loopback binding plus a trusted parent process, nothing more. — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#trust-model
- [definition] Loopback-only binding — The HTTP transport binds to `host = MDB_CONTEXT_HUB_HOST || '127.0.0.1'` and `port = MDB_CONTEXT_HUB_PORT || 3939` (`mcp-server/src/http.ts`). Requests that carry an `Origin` header are checked against the loopback origins and rejected with `403` otherwise. — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#loopback-only-binding
- [definition] Secret handling — The repo stores no credentials. `ANTHROPIC_API_KEY` is read from the environment at call time for `tam_optimize_prompt` and is never persisted. — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#secret-handling
- [definition] Input validation — Every tool input is validated with Zod. Queries are capped at 500 characters, result limits at 100 items per call, and context reads at 20,000 characters; saved IDs are slugified to `[a-z0-9-]` (max 48 chars). — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#input-validation
- [definition] 7. Installation & Quick Start *(new users)* — The steps below assume a checkout of the internal repository. — https://llms-explorer.com/blog/mdb-context-hub-project-briefing/#7-installation-quick-start-new-users

## Orientation — Worked Examples: The Tooling Explains Itself
<https://llms-explorer.com/blog/orientation-worked-examples-the-tooling-explains-itself/>

- [snippet] Example 1 — Explaining the optimizer family: ★ Insight ───────────────────────────────────── — `★ Insight ─────────────────────────────────────` — https://llms-explorer.com/blog/orientation-worked-examples-the-tooling-explains-itself/#example-1-explaining-the-optimizer-family
- [snippet] Example 2 — /dr and the concept-family explorer: ★ Insight ───────────────────────────────────── — `★ Insight ─────────────────────────────────────` — https://llms-explorer.com/blog/orientation-worked-examples-the-tooling-explains-itself/#example-2-dr-and-the-concept-family-explorer
- [definition] Orientation — Worked Examples: The Tooling Explains Itself — Two historical chat transcripts explaining the optimizer family and skill-guided development, with their recorded claims preserved as conversation. — https://llms-explorer.com/blog/orientation-worked-examples-the-tooling-explains-itself/#orientation-worked-examples-the-tooling-explains-itself
- [definition] Example 1 — Explaining the optimizer family — ❯ Explain all of the optimization skills I've developed? Include the repo-kickstarter, deep document, skill, code, prompt, and image optimizers. — https://llms-explorer.com/blog/orientation-worked-examples-the-tooling-explains-itself/#example-1-explaining-the-optimizer-family
- [definition] Example 2 — /dr and the concept-family explorer — ❯ Explain the /dr and concept family explorer skills and give a few examples of how it's been successfully used — https://llms-explorer.com/blog/orientation-worked-examples-the-tooling-explains-itself/#example-2-dr-and-the-concept-family-explorer

## Reducing LLM Cost and Latency Without Losing Context
<https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/>

- [parameter] `cache_control` ephemeral breakpoints: Layer=Cache; Implementation=`server/src/live/recommender.js`, `src/background/llm.js`; Status=Active — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Volatility-ordered prompt layout: Layer=Cache; Implementation=`recommender.js` (system / preamble / snapshot); Status=Active — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Reusable prefix/suffix envelope: Layer=Cache; Implementation=`buildPromptEnvelope()` in `llm.js`; Status=Active — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Cache TTL 5m/1h calibration: Layer=Cache; Implementation=`normalizeAnthropicPromptCacheTtl()` in `llm.js`; Status=Active — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Extension caching toggle: Layer=Cache; Implementation=`llmPromptCachingEnabled` setting, options UI; does not govern the server recommender; Status=Active — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Cache usage capture: Layer=Cache; Implementation=Separate cache counters returned in extension `llm.js`; cited server trace/store retain input/output counts; Status=Partial across paths — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Top-k indexed retrieval limiting: Layer=Reduce; Implementation=`PROMPT_SCOPE_RESULT_LIMITS` in `preprocessor.js`; Status=Active for selected modules/chunks — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Indexed retrieval age filtering: Layer=Reduce; Implementation=`PROMPT_SCOPE_MAX_AGE_DAYS` in `preprocessor.js`; Status=Active for dated index candidates — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Recent-item windowing: Layer=Reduce; Implementation=`getRecentItemsByHours()` in `llm.js`; Status=Active — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Truncation with text-length caps: Layer=Reduce; Implementation=`truncateUntrusted()`, `MAX_REPORT_BYTES`, Monday limits; Status=Active — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Deduplication: Layer=Reduce; Implementation=`dedupeSentences()`, corpus write-queue coalescing; Status=Active — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Noise analysis and whitespace normalization: Layer=Reduce; Implementation=`content-optimizer.js` background job; Status=Analysis available; writes require non-dry-run application — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Minified JSON context: Layer=Reduce; Implementation=`contextToCompactPromptContext()` in `preprocessor.js`; Status=Active — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Per-workflow output budgets: Layer=Reduce; Implementation=Cited paths use 1,024–4,096 output tokens; `runCaseDeepDive()` requests 8,192; Status=Active — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Local segment caching: Layer=Cross-cutting; Implementation=`ACCOUNT_CONTEXT_SEGMENT_TTLS_MS` in `preprocessor.js`; Status=Active — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] Injection-hardening escape/truncate: Layer=Cross-cutting; Implementation=`escapeUntrusted()`, `truncateUntrusted()` in `recommender.js`; Status=Active — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [parameter] `llmPromptCachingEnabled`: Location=options UI / `chrome.storage.local`; Default=`true`; Controls=Extension prompt-caching on/off; not the server recommender — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#appendix-a-configuration-reference
- [parameter] `anthropicPromptCacheTtl`: Location=options UI / `chrome.storage.local`; Default=`5m`; Controls=Cache TTL (`5m` or `1h`) — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#appendix-a-configuration-reference
- [parameter] `llmModel`: Location=options UI / `chrome.storage.local`; Default=`claude-sonnet-4-6`; Controls=Model selection — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#appendix-a-configuration-reference
- [parameter] `RECOMMENDER_MAX_TOKENS`: Location=env (`server`); Default=`1024`; Controls=Live-recommendation output budget — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#appendix-a-configuration-reference
- [parameter] `REPORT_MAX_TOKENS`: Location=env (`server`); Default=`4096`; Controls=Scheduled-report output budget — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#appendix-a-configuration-reference
- [parameter] `ANTHROPIC_MODEL`: Location=env (`server`); Default=`claude-sonnet-4-6`; Controls=Server-side model selection — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#appendix-a-configuration-reference
- [parameter] `PROMPT_SCOPE_RESULT_LIMITS`: Location=`preprocessor.js`; Default=12–24 modules; Controls=Top-k retrieval size per scope — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#appendix-a-configuration-reference
- [parameter] `PROMPT_SCOPE_MAX_AGE_DAYS`: Location=`preprocessor.js`; Default=30–365 days; Controls=Recency horizon for dated indexed retrieval candidates — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#appendix-a-configuration-reference
- [parameter] `ACCOUNT_CONTEXT_SEGMENT_TTLS_MS`: Location=`preprocessor.js`; Default=2–20 min; Controls=Local segment cache lifetime — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#appendix-a-configuration-reference
- [parameter] `MAX_REPORT_BYTES`: Location=`recommendation-store.js`; Default=256 × 1,024 string units; Controls=Report text-length cap (name says bytes) — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#appendix-a-configuration-reference
- [parameter] `MONDAY_CORPUS_DIGEST_LIMIT`: Location=`monday.js`; Default=16,000 string units; Controls=Monday corpus digest cap — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#appendix-a-configuration-reference
- [parameter] `MONDAY_PROMPT_CONTEXT_LIMIT`: Location=`monday.js`; Default=32,000 string units; Controls=Monday prompt context cap — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#appendix-a-configuration-reference
- [definition] Reducing LLM Cost and Latency Without Losing Context — A June 2026 review of mdb-tam’s context reduction and Anthropic caching controls explains partial telemetry and the unmeasured cost, latency, and quality tradeoffs. — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#reducing-llm-cost-and-latency-without-losing-context
- [definition] 1\. The problem: large context, repeated calls — An LLM-backed account dashboard sits on top of an unusually hostile cost profile. — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#1-the-problem-large-context-repeated-calls
- [definition] 2\. Why single-technique approaches fall short — Three common approaches each solve part of the problem and leave the rest. — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#2-why-single-technique-approaches-fall-short
- [definition] 3\. The approach: reduce first, then cache — mdb-tam treats cost control as two ordered layers. Layer 1 decides *what context is worth sending*. — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#3-the-approach-reduce-first-then-cache
- [definition] 3.1 Layer 1 — reduce what gets sent — Reduction is a pipeline of independent, composable filters applied during context assembly in `src/background/preprocessor.js` and the workflow builders in `src/background/llm.js`. — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#31-layer-1-reduce-what-gets-sent
- [definition] 3.2 Layer 2 — cache what stays stable — What survives reduction is sent to Anthropic with cache breakpoints placed according to a single principle: **cache by volatility, front to back.** Because the cache is a prefix match, the stable content goes first and the volatile content goes last, so the cached prefix is as long as possible on… — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#32-layer-2-cache-what-stays-stable
- [definition] 4\. Proof: the architecture as implemented — The design above is not aspirational; it is wired into the running system. The table below maps each technique to its implementation and current status. — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#4-proof-the-architecture-as-implemented
- [definition] Measurement — The extension returns `cache_creation_input_tokens`, `cache_read_input_tokens`, `input_tokens`, and `output_tokens` from Anthropic’s `usage` response. — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#measurement
- [definition] 5\. Implementation considerations — A team adopting this architecture should weigh five points drawn from how mdb-tam is built. — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#5-implementation-considerations
- [definition] 6\. Conclusion — mdb-tam's token economics follow from one architectural commitment: reduce the context first, then cache what remains. — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#6-conclusion
- [definition] Appendix B — Source references — Implementation files cited in this paper, relative to the repository root: 1. `server/src/live/recommender.js` — live recommender; volatility-ordered cache breakpoints; untrusted-input escaping and truncation; token-usage telemetry. — https://llms-explorer.com/blog/reducing-llm-cost-and-latency-without-losing-context/#appendix-b-source-references

## Running Ollama on an RTX 5080 eGPU via Thunderbolt 5 on Apple Silicon M5 Max
<https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/>

- [snippet] Running Ollama on an RTX 5080 eGPU via Thunderbolt 5 on Apple Silicon M5 Max: $ OLLAMA_HOST=http://127.0.0.1:11440 ollama run Qwen2-beta-14B-Chat "Provide a 2-sentence summary of quantum computing a — `$ OLLAMA_HOST=http://127.0.0.1:11440 ollama run Qwen2-beta-14B-Chat "Provide a 2-sentence summary of` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#running-ollama-on-an-rtx-5080-egpu-via-thunderbolt-5-on-apple-silicon-m5-max
- [snippet] 2. The Core Problem: The DriverKit Boundary: ┌────────────────────────────────────────────────────────┐ — `┌────────────────────────────────────────────────────────┐` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#2-the-core-problem-the-driverkit-boundary
- [snippet] Incident 1: Kernel Panic via `IOPCIFamily` Data Abort: panic(cpu 0 caller 0xfffffe0013b827e8): Data abort in kernel mode — `panic(cpu 0 caller 0xfffffe0013b827e8): Data abort in kernel mode` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#incident-1-kernel-panic-via-iopcifamily-data-abort
- [snippet] Incident 1: Kernel Panic via `IOPCIFamily` Data Abort: ioreg -r -c IOPCIDevice -l | grep -q "<022c0000>" — `# Registry-based link check used by the helper:` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#incident-1-kernel-panic-via-iopcifamily-data-abort
- [snippet] Incident 2: Kernel Panic via Hot-Unplug Power-Gating Timeout: panic(cpu 4 caller 0xfffffe001cb18e24): ApplePMGR::_waitForXNUClusterPowerGatingThreadCall ... — `panic(cpu 4 caller 0xfffffe001cb18e24): ApplePMGR::_waitForXNUClusterPowerGatingThreadCall ...` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#incident-2-kernel-panic-via-hot-unplug-power-gating-timeout
- [snippet] Incident 2: Kernel Panic via Hot-Unplug Power-Gating Timeout: python3 rtx5080_egpu_harness.py stop — `python3 rtx5080_egpu_harness.py stop` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#incident-2-kernel-panic-via-hot-unplug-power-gating-timeout
- [snippet] Incident 3: Blackwell GB203 GSP Initialization & Page Table Bug: AssertionError: Must be table pt=0x0 — `AssertionError: Must be table pt=0x0` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#incident-3-blackwell-gb203-gsp-initialization-page-table-bug
- [snippet] Incident 3: Blackwell GB203 GSP Initialization & Page Table Bug: if not self.nvdev.fmc_boot: — `# tinygrad/runtime/support/nv/ip.py` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#incident-3-blackwell-gb203-gsp-initialization-page-table-bug
- [snippet] Incident 4: Thunderbolt Bus Resets Drop the PCIe Tunnel: if self.reg("NV_PFB_PRI_MMU_WPR2_ADDR_HI").read() != 0 and not isinstance(self.pci_dev, RemotePCIDevice): — `# tinygrad/runtime/support/nv/nvdev.py` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#incident-4-thunderbolt-bus-resets-drop-the-pcie-tunnel
- [snippet] Incident 6: GGUF Tokenizer & RoPE Theta KeyErrors: rope_theta=kv.get(f'{arch}.rope.freq_base', 1000000.0 if 'qwen' in arch else 10000.0) — `# tinygrad/llm/model.py` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#incident-6-gguf-tokenizer-rope-theta-keyerrors
- [snippet] 6. Context Window Scaling & KV Cache Math: python3 rtx5080_egpu_harness.py stop — `python3 rtx5080_egpu_harness.py stop` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#6-context-window-scaling-kv-cache-math
- [snippet] A. ChatGPT CLI & OpenAI SDK (`OPENAI_BASE_URL`): export OPENAI_BASE_URL="http://127.0.0.1:8000/v1" — `export OPENAI_BASE_URL="http://127.0.0.1:8000/v1"` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#a-chatgpt-cli-openai-sdk-openai-base-url
- [snippet] D. Aider CLI: OLLAMA_HOST=http://127.0.0.1:11440 aider --model ollama/Qwen2-beta-14B-Chat — `# Via Ollama bridge (port 11440):` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#d-aider-cli
- [snippet] Method A: Use Existing Ollama Model Blobs: cat ~/.ollama/models/manifests/registry.ollama.ai/library/qwen2.5/14b | grep -A 2 "image.model" — `cat ~/.ollama/models/manifests/registry.ollama.ai/library/qwen2.5/14b | grep -A 2 "image.model"` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#method-a-use-existing-ollama-model-blobs
- [snippet] Method A: Use Existing Ollama Model Blobs: pkill -f tinygrad.llm — `pkill -f tinygrad.llm` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#method-a-use-existing-ollama-model-blobs
- [snippet] Method B: Direct Hugging Face ID or Local File: pkill -f tinygrad.llm — `pkill -f tinygrad.llm` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#method-b-direct-hugging-face-id-or-local-file
- [snippet] Quickstart Option 1: All-In-One Automated Harness: curl -fsSL -O https://llms-explorer.com/downloads/egpu/rtx5080_egpu_harness.py — `# 1. Download harness` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#quickstart-option-1-all-in-one-automated-harness
- [snippet] Quickstart Option 2: Manual Script Installation: git clone https://github.com/tinygrad/tinygrad.git ~/tinygrad — `# 1. Clone and patch tinygrad` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#quickstart-option-2-manual-script-installation
- [parameter] **Host System**: Hardware / Component=Apple MacBook Pro (16-inch, 2026); Details=Reported M5 Max, 64 GB unified memory; confirm the actual macOS build — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#1-hardware-topology
- [parameter] **Bus / Tunnel**: Hardware / Component=Thunderbolt 5 (USB4 v2); Details=Intel Barlow Ridge / Apple Thunderbolt 5 controller, 80 Gb/s bidirectional link (PCIe Gen 4 x4 tunnel) — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#1-hardware-topology
- [parameter] **Enclosure**: Hardware / Component=Razer Core X V2 eGPU; Details=PCIe enclosure; setup reports an installed 650W ATX PSU (sold separately) — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#1-hardware-topology
- [parameter] **Accelerator**: Hardware / Component=NVIDIA GeForce RTX 5080; Details=GB203 die, `sm_120`, 16 GB GDDR7, PCI ID `10de:2c02` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#1-hardware-topology
- [parameter] **DriverKit Driver**: Hardware / Component=Tiny Corp `TinyGPU.dext`; Details=DriverKit extension (`org.tinygrad.tinygpu.driver2`) matching `display@0` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#1-hardware-topology
- [parameter] **Compute Engine**: Hardware / Component=`tinygrad.llm`; Details=Low-level userspace driver + JIT NV compiler (`DEV=NV`) — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#1-hardware-topology
- [parameter] **API Bridge**: Hardware / Component=`ollama-egpu-proxy.py`; Details=Native Ollama REST API compatibility layer on port `11440` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#1-hardware-topology
- [parameter] 4,096: Blob size (weight-allocation proxy)=7.62 GiB; Calculated KV cache=3.125 GiB; Combined estimate before runtime overhead=10.74 GiB; Implication on a 16 GB card=Plausible; verify actual allocation — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#6-context-window-scaling-kv-cache-math
- [parameter] 8,192: Blob size (weight-allocation proxy)=7.62 GiB; Calculated KV cache=6.25 GiB; Combined estimate before runtime overhead=13.87 GiB; Implication on a 16 GB card=Tight; measure scratch-space headroom — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#6-context-window-scaling-kv-cache-math
- [parameter] 16,384: Blob size (weight-allocation proxy)=7.62 GiB; Calculated KV cache=12.5 GiB; Combined estimate before runtime overhead=20.12 GiB; Implication on a 16 GB card=Does not fit this estimate — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#6-context-window-scaling-kv-cache-math
- [parameter] 32,768: Blob size (weight-allocation proxy)=7.62 GiB; Calculated KV cache=25 GiB; Combined estimate before runtime overhead=32.62 GiB; Implication on a 16 GB card=Does not fit this estimate — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#6-context-window-scaling-kv-cache-math
- [parameter] **Driver / Backend**: Method 1: Interactive Pipeline=Host Agent (`dr_run.py`); Method 2: Local RTX 5080 eGPU Offload=Local `tinygrad.llm` (Port 8000, `DEV=NV`); Method 3: Automated Research Queue=Queue Daemon (`process-research-queue`) — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#benchmark-diagnostic-results
- [parameter] **Prefill Speed**: Method 1: Interactive Pipeline=N/A (Cloud Orchestration); Method 2: Local RTX 5080 eGPU Offload=**34 tokens/sec**; Method 3: Automated Research Queue=N/A — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#benchmark-diagnostic-results
- [parameter] **Generation Throughput**: Method 1: Interactive Pipeline=~60 tokens/sec; Method 2: Local RTX 5080 eGPU Offload=**7.0 tokens/sec** sustained (14B Q4); Method 3: Automated Research Queue=Asynchronous batch — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#benchmark-diagnostic-results
- [parameter] **Claim Schema Validation**: Method 1: Interactive Pipeline=Passed (`claims: 3, sources: 4`); Method 2: Local RTX 5080 eGPU Offload=Passed (`claims: 2, sources: 3`); Method 3: Automated Research Queue=Passed (`tree.json` injected) — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#benchmark-diagnostic-results
- [parameter] **Cloud Token Cost**: Method 1: Interactive Pipeline=Standard cloud API; Method 2: Local RTX 5080 eGPU Offload=No metered completion API in local path; full workflow cost unmeasured; Method 3: Automated Research Queue=Cost unmeasured — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#benchmark-diagnostic-results
- [parameter] **Tree Integration**: Method 1: Interactive Pipeline=Node created, 1 alias consumed; Method 2: Local RTX 5080 eGPU Offload=Claims merged into tree node; Method 3: Automated Research Queue=Queue marked `[x]` — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#benchmark-diagnostic-results
- [parameter] `rtx5080_egpu_harness.py`: Description=Partial bootstrap and daemon/benchmark helper; requires DriverKit, NV compiler setup and a compatible checkout; Direct Download=[Download rtx5080_egpu_harness.py](/downloads/egpu/rtx5080_egpu_harness.py) — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#10-downloadable-scripts-source-code
- [parameter] `chatgpt`: Description=Standalone interactive ChatGPT CLI connected to RTX 5080 backend with streaming; Direct Download=[Download chatgpt](/downloads/egpu/chatgpt) — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#10-downloadable-scripts-source-code
- [parameter] `ollama-egpu`: Description=Shell orchestrator: link detection, daemon management, port routing; Direct Download=[Download ollama-egpu](/downloads/egpu/ollama-egpu) — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#10-downloadable-scripts-source-code
- [parameter] `ollama-egpu-proxy.py`: Description=Python Ollama-to-tinygrad REST API bridge (port 11440); Direct Download=[Download ollama-egpu-proxy.py](/downloads/egpu/ollama-egpu-proxy.py) — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#10-downloadable-scripts-source-code
- [parameter] `tinygpu-blackwell-gsp.patch`: Description=Git patch for `tinygrad` covering Blackwell GSP boot, page tables, and Qwen2 RoPE fixes; Direct Download=[Download tinygpu-blackwell-gsp.patch](/downloads/egpu/tinygpu-blackwell-gsp.patch) — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#10-downloadable-scripts-source-code
- [definition] Running Ollama on an RTX 5080 eGPU via Thunderbolt 5 on Apple Silicon M5 Max — A partial RTX 5080 compute guide for Apple Silicon, covering recorded failures, tinygrad prerequisites, corrected KV-cache math and compatibility limits. — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#running-ollama-on-an-rtx-5080-egpu-via-thunderbolt-5-on-apple-silicon-m5-max
- [definition] 2. The Core Problem: The DriverKit Boundary — Linux NVIDIA drivers use kernel modules; Windows uses its own driver model rather than `.ko` modules. Apple's native eGPU support does not include Apple Silicon. — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#2-the-core-problem-the-driverkit-boundary
- [definition] 3. The Troubleshooting Journey: Failures & Fixes — When first connecting the RTX 5080 over Thunderbolt 5, the GPU lit up and negotiated link, but attempts to run inference crashed the system or aborted. Six reported incidents stood in the way: — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#3-the-troubleshooting-journey-failures-fixes
- [definition] Incident 1: Kernel Panic via `IOPCIFamily` Data Abort — **Symptom:** While checking the link state, running Apple's standard `system_profiler SPPCIDataType` caused an immediate hard kernel panic: — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#incident-1-kernel-panic-via-iopcifamily-data-abort
- [definition] Incident 2: Kernel Panic via Hot-Unplug Power-Gating Timeout — **Symptom:** Unplugging the Thunderbolt 5 cable while testing caused the entire Mac to lock up and kernel panic ~30 seconds later: — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#incident-2-kernel-panic-via-hot-unplug-power-gating-timeout
- [definition] Incident 3: Blackwell GB203 GSP Initialization & Page Table Bug — **Symptom:** When `tinygrad` attempted to initialize the GPU System Processor (GSP) firmware on the RTX 5080, it crashed with: — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#incident-3-blackwell-gb203-gsp-initialization-page-table-bug
- [definition] 4. The Bridge: Emulating Ollama — `tinygrad.llm` exposes an OpenAI-compatible endpoint on port `8000` (`/v1/chat/completions`). However, tools like Ollama CLI, Open WebUI, and local agent orchestrators expect the native Ollama REST protocol on `/api/tags`, `/api/generate`, `/api/chat`, and `/api/show`. — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#4-the-bridge-emulating-ollama
- [definition] 5. Recorded Performance & Evidence Limits — The setup notes report the following results. Raw transport and allocation traces are unavailable, so these are recorded observations rather than independently reproduced benchmarks: 1. — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#5-recorded-performance-evidence-limits
- [definition] 6. Context Window Scaling & KV Cache Math — Because the RTX 5080 features 16 GB of physical GDDR7 VRAM, how far can the context window scale before out-of-memory (OOM)? — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#6-context-window-scaling-kv-cache-math
- [definition] 7. Agent Harnesses & CLI Compatibility — The dual-port architecture exposes both OpenAI and Ollama protocols simultaneously: — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#7-agent-harnesses-cli-compatibility
- [definition] A. ChatGPT CLI & OpenAI SDK (`OPENAI_BASE_URL`) — `tinygrad.llm` on port `8000` is natively OpenAI-compatible (`/v1/chat/completions`). Clients configured for Chat Completions can use that endpoint. — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#a-chatgpt-cli-openai-sdk-openai-base-url
- [definition] B. Codex and other coding agents — Modern Codex uses the Responses API; a Chat Completions endpoint alone is insufficient. A provider configuration or protocol adapter must support the installed client's API, streaming and tools. — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#b-codex-and-other-coding-agents
- [definition] C. AGY (Antigravity CLI & SDK) — This article has no verified AGY provider configuration or successful tool-call trace for this backend. Do not assume its build honors Ollama/OpenAI environment variables. — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#c-agy-antigravity-cli-sdk
- [definition] D. Aider CLI — Aider documents both Ollama and OpenAI-compatible provider settings. These commands illustrate routing; the served model still needs an editing/tool-workflow acceptance test. — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#d-aider-cli
- [definition] E. Claude Code CLI adapter — Claude Code uses Anthropic's Messages protocol. An adapter such as LiteLLM may translate protocols, but the original command did not demonstrate a successful Claude Code tool cycle. — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#e-claude-code-cli-adapter
- [definition] 8. Evaluating `/dr` Deep Research on the RTX 5080: Three Workflows Compared — To stress-test the stack in realistic agentic development, we executed the global AI hub's `/dr` (deep-research-to-skill) pipeline on a real frontier concept: **"16 GB VRAM residency budgeting (weights + KV cache)"** across three distinct operational modes: — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#8-evaluating-dr-deep-research-on-the-rtx-5080-three-workflows-compared
- [definition] 9. How to Switch Models — The service accepts paths and repository identifiers only for architectures, quantization types and tokenizers supported by the installed tinygrad revision. Fitting the weights in VRAM is necessary but insufficient; include KV cache and runtime headroom. — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#9-how-to-switch-models
- [definition] Method A: Use Existing Ollama Model Blobs — Find the blob hash in `~/.ollama/models/manifests`: — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#method-a-use-existing-ollama-model-blobs
- [definition] 10. Downloadable Scripts & Source Code — All scripts created during this setup are available directly for download: — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#10-downloadable-scripts-source-code
- [definition] Quickstart Option 1: All-In-One Automated Harness — Before using the harness, install and approve TinyGPU, install Docker Desktop, and run tinygrad's NV compiler setup for macOS. See the [upstream procedure](https://docs.tinygrad.org/tinygpu/). — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#quickstart-option-1-all-in-one-automated-harness
- [definition] Quickstart Option 2: Manual Script Installation — This option assumes the same DriverKit/Docker/NVCC prerequisites and a prepared tinygrad virtualenv. Use a compatible checkout, review the patch before applying it, and put `~/.local/bin` on `PATH`. — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#quickstart-option-2-manual-script-installation
- [definition] Conclusion — External GPUs on Apple Silicon are far from plug-and-play, but they are no longer impossible. — https://llms-explorer.com/blog/rtx-5080-egpu-apple-silicon-m5-thunderbolt-5/#conclusion

## A Real RTX5080 Response at 59 Tokens/sec—and a Failed Numerical Gate
<https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/>

- [snippet] A Real RTX5080 Response at 59 Tokens/sec—and a Failed Numerical Gate: {"sum": 42, "product": 56, "gcd": 6} — `{"sum": 42, "product": 56, "gcd": 6}` — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#a-real-rtx5080-response-at-59-tokenssecand-a-failed-numerical-gate
- [parameter] Server prompt evaluation: 8-thread CPU reference=7.47 tokens/sec; RTX5080 eGPU=289.93 tokens/sec — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#a-real-rtx5080-response-at-59-tokenssecand-a-failed-numerical-gate
- [parameter] Server generation: 8-thread CPU reference=6.12 tokens/sec; RTX5080 eGPU=59.10 tokens/sec — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#a-real-rtx5080-response-at-59-tokenssecand-a-failed-numerical-gate
- [parameter] Complete client request: 8-thread CPU reference=11.8356s; RTX5080 eGPU=0.5619s — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#a-real-rtx5080-response-at-59-tokenssecand-a-failed-numerical-gate
- [parameter] Prompt evaluation: Earlier quantized-prefill trial=289.93 tokens/sec; F32 prefill trial=16.09 tokens/sec — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#the-f32-trial-correct-output-worse-numerical-agreement
- [parameter] Generation: Earlier quantized-prefill trial=59.10 tokens/sec; F32 prefill trial=59.80 tokens/sec — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#the-f32-trial-correct-output-worse-numerical-agreement
- [parameter] Complete client request: Earlier quantized-prefill trial=0.5619s; F32 prefill trial=4.3174s — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#the-f32-trial-correct-output-worse-numerical-agreement
- [parameter] Maximum selected-token logprob error: Earlier quantized-prefill trial=0.063163; F32 prefill trial=0.087565 — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#the-f32-trial-correct-output-worse-numerical-agreement
- [parameter] Original absolute tolerance: Earlier quantized-prefill trial=0.05; F32 prefill trial=0.05 — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#the-f32-trial-correct-output-worse-numerical-agreement
- [parameter] Numerical gate: Earlier quantized-prefill trial=failed; F32 prefill trial=failed — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#the-f32-trial-correct-output-worse-numerical-agreement
- [parameter] Emitted CPU/GPU selected-token log-probability difference: 0.087565 — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#raw-captures-divergence-before-the-output-projection
- [parameter] Difference after common float64 full-vocabulary normalization: 0.087527 — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#raw-captures-divergence-before-the-output-projection
- [parameter] Maximum normalized pre-output vector difference: 2.728110 — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#raw-captures-divergence-before-the-output-projection
- [parameter] Pre-output vector relative L2 difference: 33.22% — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#raw-captures-divergence-before-the-output-projection
- [parameter] Pre-output vector cosine similarity: 0.945000 — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#raw-captures-divergence-before-the-output-projection
- [parameter] Maximum full-vocabulary raw-logit difference: 3.830020 — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#raw-captures-divergence-before-the-output-projection
- [parameter] Original numerical tolerance: 0.05 — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#raw-captures-divergence-before-the-output-projection
- [definition] A Real RTX5080 Response at 59 Tokens/sec—and a Failed Numerical Gate — One matched CPU and eGPU request, preserved failure receipts, and a physical F32 prefill trial that remained numerically outside the original tolerance. — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#a-real-rtx5080-response-at-59-tokenssecand-a-failed-numerical-gate
- [definition] The F32 trial: correct output, worse numerical agreement — We ran the prepared F32 diagnostic after another explicitly confirmed Mac shutdown and enclosure power cycle. All 306 sealed input hashes matched. — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#the-f32-trial-correct-output-worse-numerical-agreement
- [definition] Raw captures: divergence before the output projection — On October 6, after another confirmed physical cold recovery, we captured the normalized pre-output vector and all 248320 output logits at each sampled position. Two fresh CPU requests on macOS 27.2 produced 86 finite vectors bit-for-bit identical to the historical CPU captures. — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#raw-captures-divergence-before-the-output-projection
- [definition] A projection control that refused to validate — A small CPU-only follow-up read three output-weight rows and the saved CPU/GPU normalized hidden vectors. The helper compiled successfully and ran once in 0.122 seconds, using about 77 KB of data buffers. — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#a-projection-control-that-refused-to-validate
- [definition] Matching the CPU projection exactly — A corrected control explicitly selected CPU_REPACK’s eight-row Q5_K implementation and checked the actual NEON/i8mm features and buffer type. It compiled once, then executed six tiny CPU graph projections in 0.130 seconds. — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#matching-the-cpu-projection-exactly
- [definition] The checkpoint-tail correction now compiles — The recorded prompt divides into 60 tokens followed by a four-token checkpoint tail. CUDA dispatch sends small quantized matrix multiplies through MMVQ before considering cuBLAS. — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#the-checkpoint-tail-correction-now-compiles
- [definition] Preparing the server for longer sessions — The tracing build has a further constraint: its capture callback is fixed at startup and aborts after 64 captured pairs or samples. Our two diagnostic numerical requests consume 42 samples. — https://llms-explorer.com/blog/rtx5080-real-response-numerical-gate/#preparing-the-server-for-longer-sessions

## Semantic indexing: two legs and a fusion
<https://llms-explorer.com/blog/semantic-indexing/>

- [snippet] Run it yourself: docset_indexer.py keyword <docset> "CLAUDE_CODE_SYNC_SKILLS" — `# the cheap leg — FTS5/BM25, no model call` — https://llms-explorer.com/blog/semantic-indexing/#run-it-yourself
- [definition] Semantic indexing: two legs and a fusion — How keyword and vector retrieval differ, how optional rank fusion combines them and what one recorded eleven-question run can establish. — https://llms-explorer.com/blog/semantic-indexing/#semantic-indexing-two-legs-and-a-fusion
- [definition] The two legs — A docset in the hub is indexed twice over the same units. — https://llms-explorer.com/blog/semantic-indexing/#the-two-legs
- [definition] Fusing them — The hub defaults to `mode="semantic"`. Opting into `hub_query_docset(mode="hybrid")` runs both and fuses them with **reciprocal-rank fusion**: each hit scores `1 / (60 + rank)` in each list it appears in, and the scores add, keyed by `(url, seq)`. — https://llms-explorer.com/blog/semantic-indexing/#fusing-them
- [definition] What the recording shows — Read [`/demo/`](/demo/) with three questions in mind. — https://llms-explorer.com/blog/semantic-indexing/#what-the-recording-shows
- [definition] Run it yourself — Everything on the demo page comes from one command against an indexed docset, so the same comparison can be run over yours. The keyword index is built on first use; the facts layer is preferred automatically when a docset has one. — https://llms-explorer.com/blog/semantic-indexing/#run-it-yourself

## Semantic Skill Discovery and the Optimizer Family
<https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/>

- [snippet] 4.2 Worked example: the "Skill & Prompt Engineer" role: role.id:       skill-knowledge-engineer — `role.id:       skill-knowledge-engineer` — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#42-worked-example-the-skill-prompt-engineer-role
- [parameter] Input: Relevance-ranked discovery (`tam_recommend_skills`)=Prose task description; Simple keyword discovery (`tam_search_skills`)=A known term / id / tag — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#31-the-two-models-side-by-side
- [parameter] Output: Relevance-ranked discovery (`tam_recommend_skills`)=Ranked, paginated lexical candidates; optional semantic reranking within the page; Simple keyword discovery (`tam_search_skills`)=Ranked, paginated lexical candidates — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#31-the-two-models-side-by-side
- [parameter] Transparency: Relevance-ranked discovery (`tam_recommend_skills`)=Score, `matchedKeywords`, and `contextPath`; Simple keyword discovery (`tam_search_skills`)=Score and `matchedKeywords` — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#31-the-two-models-side-by-side
- [parameter] Best when: Relevance-ranked discovery (`tam_recommend_skills`)=You don't know the exact skill; Simple keyword discovery (`tam_search_skills`)=You know the exact item — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#31-the-two-models-side-by-side
- [parameter] Failure mode: Relevance-ranked discovery (`tam_recommend_skills`)=Over-recall (marginal matches ranked low); Simple keyword discovery (`tam_search_skills`)=False positives on incidental words — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#31-the-two-models-side-by-side
- [parameter] \~1,024 chars: Severity=spec maximum; Reason=Anthropic's documented `description` field max — the primary activation signal — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#62-level-1-the-two-tier-description-cap
- [parameter] \> 1,000 chars: Severity=**Medium**; Reason=Glean export hard cap (single definition: `/sko` Pass M) — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#62-level-1-the-two-tier-description-cap
- [parameter] \> 1,536 chars: Severity=**High**; Reason=harness truncation — past this the description is silently cut — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#62-level-1-the-two-tier-description-cap
- [parameter] No initial prompt, only examples: **APE** (generate-and-select) — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#73-algorithm-aware-recommendations
- [parameter] Quick single-prompt, zero setup: **OPRO** (API-only meta-prompt) — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#73-algorithm-aware-recommendations
- [parameter] Error-guided refinement with textual feedback: **ProTeGi** (textual gradients + beam search) — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#73-algorithm-aware-recommendations
- [parameter] Compound multi-component AI system: **TextGrad** (computation-graph backprop) — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#73-algorithm-aware-recommendations
- [parameter] Population diversity across tasks: **EvoPrompt** (DE variant) — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#73-algorithm-aware-recommendations
- [parameter] Joint instruction + demo optimization: **MIPROv2** (Bayesian search) — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#73-algorithm-aware-recommendations
- [parameter] Rich diagnostic feedback available: **GEPA** (Pareto frontier + reflection) — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#73-algorithm-aware-recommendations
- [parameter] Maximum quality, fine-tune budget: **BetterTogether** (prompt → weight → prompt) — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#73-algorithm-aware-recommendations
- [parameter] **A**: Name=Correctness; Bundle=B1; Scope=internal contradictions, dead tool/skill/path names, loop-logic errors, undefined terms, family-freshness stamp — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **B**: Name=Inconsistency; Bundle=B1; Scope=scope/label/priority mismatches not already an A contradiction — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **C**: Name=Formatting; Bundle=B1; Scope=heading hierarchy, bullet/marker consistency, table shape, code fences, YAML syntax — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **D**: Name=Clarity; Bundle=B1; Scope=vague qualifiers lacking a decision rule, missing examples, undefined jargon, restated points — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **E**: Name=Optimization; Bundle=B1; Scope=table-ize rules, shorten prose, reorder sections, merge redundant steps — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **F**: Name=Feature gap; Bundle=B1; Scope=uncovered use cases, unhandled edge cases, missing when-not-to-use / output-format / context rules — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **G**: Name=Frontmatter / manifest audit; Bundle=B2; Scope=description quality, whenToUse specificity, tag collisions, category, version/updated, related_skills, SKIP presence — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **H**: Name=Trigger-accuracy eval; Bundle=B3; Scope=a **20-query** predicted/measured eval; bar is **≥ 9/10 positives** and **≤ 1/10 false positives** — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **I**: Name=Cross-skill collision; Bundle=B4; Scope=keyword and concept-tree-sibling overlap with peers; recommend tighten / SKIP / hand to O — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **J**: Name=Length budget & progressive disclosure; Bundle=B4; Scope=**\~6k-token soft budget, \~10k hard ceiling (High)**; earning-its-rent extraction to `references/` — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **K**: Name=Anti-AI-ism enforcement; Bundle=B4; Scope=banned-term list, em-dash density \> 1/100 words, machine-generated tells — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **L**: Name=Whitespace / character hygiene; Bundle=B4; Scope=deterministic byte-level cleanup (a YAML-frontmatter tab is High; otherwise reported as a Hygiene row, excluded from Medium+) — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **M**: Name=Description optimization; Bundle=B2; Scope=rewrite the description to its strongest form; **1,000-char Glean hard cap** — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **N**: Name=SKIP / whenToUse / triggers optimization; Bundle=B2; Scope=rewrite the routing surface; every `SKIP:` target must resolve to a real peer — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **O**: Name=Cross-pollination / peer seeding; Bundle=after B2+B4; Scope=seed additive downward/upward/lifecycle deferral edges into peers — **the only pass that edits peer files** — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [parameter] **Target artifact**: `/sko` skill-optimizer=A `SKILL.md` (+ manifest); `/pdo` prompt-deep-optimizer=A production prompt (system prompt, agent block, tool template, workflow scaffold); `/ddo` document deep optimizer=A prose document (runbook, weekly update, RFC, KB, case analysis); `/cdo` code deep optimizer=A source file or whole repo — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#102-where-they-diverge
- [parameter] **Pass structure**: `/sko` skill-optimizer=**15 passes A–O** in 4 bundles (B1 content, B2 routing, B3 trigger-eval, B4 collision/length/AI-ism/hygiene) + sequential Pass O; `/pdo` prompt-deep-optimizer=**16 passes A–P** in **5 semantic groups** (Intent&Output · Context&Inputs · Process&Tools · Safety&Robustness · Structure/Model/Algorithm); `/ddo` document deep optimizer=**document-critique… — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#102-where-they-diverge
- [parameter] **Iteration cap**: `/sko` skill-optimizer=3 (→5 if Medium+ dropped ≥50% prior iter); `/pdo` prompt-deep-optimizer=5 (3 small-profile); `/ddo` document deep optimizer=3 (→5 conditionally); `/cdo` code deep optimizer=5 (3 small-profile) — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#102-where-they-diverge
- [parameter] **Fix-application policy**: `/sko` skill-optimizer=Write all Medium+ into the target; **Pass O additively edits peers**; `/pdo` prompt-deep-optimizer=One complete drop-in rewrite per iteration; preserve dynamic slots; **redact secrets/PII**; `/ddo` document deep optimizer=Apply Blocking/Major/Medium edits **in place** (modes: `--voice-only`, `--minimal`, `--annotate`, `--read-only`, `--report`)… — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#102-where-they-diverge
- [parameter] **Verification method**: `/sko` skill-optimizer=**20-query trigger eval (Pass H, ≥9/10·≤1/10)** + blind re-audit + frontmatter-parse check; `/pdo` prompt-deep-optimizer=**Behavioral smoke test** + intent-preservation 5-field checklist + blind re-audit (clean exits); `/ddo` document deep optimizer=**Re-read against the Step-2 intent contract** + terminology consistency + fact-preservation diff on… — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#102-where-they-diverge
- [parameter] **Signature feature**: `/sko` skill-optimizer=**Peer-deferral seeding** (only family member that edits other skills) + hub registration; `/pdo` prompt-deep-optimizer=**Algorithm recommendation** (APE/OPRO/MIPROv2/GEPA/…) for learned re-optimization; `/ddo` document deep optimizer=**Writing-skill routing** + document-type **severity calibration** (e.g., runbook missing rollback → Blocking)… — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#102-where-they-diverge
- [parameter] **Output / sync**: `/sko` skill-optimizer=Convergence table, findings, trigger-eval, diff, **registration verdict, hub sync**; `/pdo` prompt-deep-optimizer=Rewritten prompt, iteration log, changes table, **algorithm pick**, redaction footer, optional variant registration; `/ddo` document deep optimizer=Optimized file written back, iteration summary, pass scorecard, optional `.ddo-report.md` /… — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#102-where-they-diverge
- [definition] Semantic Skill Discovery and the Optimizer Family — A June account of skill discovery and the four optimizers, corrected against September code for ranked lexical search and optional semantic reranking. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#semantic-skill-discovery-and-the-optimizer-family
- [definition] 1. System overview: the three layers — The hub is best understood as three layers stacked beneath any task: 1. **The skill tree**: `~/.claude/skills/<id>/SKILL.md` files organized as **hubs** (broad routers) and **spokes** (narrow references folded into a hub's `references/` directory). — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#1-system-overview-the-three-layers
- [definition] 2.1 What "finding a skill" means — When a task arrives, the system must answer: *of the hundreds of installed skills, which few are relevant?* The hub answers this with **relevance-ranked discovery** rather than asking the model to read every skill. Three surfaces participate: — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#21-what-finding-a-skill-means
- [definition] 2.2 What the score is built from — The September implementation scores query terms against `id`, `title`, `description`, `category`, `tags`, `keywords`, and `whenToUse`, with different weights. It excludes stopwords and terms shorter than two characters. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#22-what-the-score-is-built-from
- [definition] 2.3 Discovery is recall; curation is precision — A ranked candidate list can include incidental matches or omit relevant skills. In the inspected recommender, lexical membership limits recall before semantic reranking. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#23-discovery-is-recall-curation-is-precision
- [definition] 3.2 Why simple keyword matching fails — Substring matching has no notion of *what a word means in context*, so it fires on stopword-like tokens that appear incidentally. Three real leaks observed in the hub illustrate the failure mode precisely: — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#32-why-simple-keyword-matching-fails
- [definition] 3.3 The lesson — Ranking with visible match evidence does not eliminate noise; it makes noise **legible and filterable**. That is the reason to inspect ranked results rather than accept the raw list. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#33-the-lesson
- [definition] 4.1 The mechanism — A **role** is a named persona in the context-hub registry with a fixed set of **`autoSkills`** that should load *whenever that persona is active, regardless of the specific query*. The tool is **`tam_role_resolve_skills(role, query)`**, and its key return field is **`matchVia`**: — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#41-the-mechanism
- [definition] 4.2 Worked example: the "Skill & Prompt Engineer" role — Resolving `tam_role_resolve_skills("skill-knowledge-engineer", <this task>)` returned: — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#42-worked-example-the-skill-prompt-engineer-role
- [definition] 4.3 Why this beats query-only selection — Query-only selection is memoryless; it re-derives the toolset from scratch every prompt, so a persona's standing tools blink in and out as the wording changes. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#43-why-this-beats-query-only-selection
- [definition] 5.1 The problem it solves — Two skills with adjacent scopes will both score on a borderline query — a *collision*. Left alone, collisions cause the wrong skill to fire or both to fire. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#51-the-problem-it-solves
- [definition] 5.2 How edges get seeded — `/sko` Pass O — `skill-optimizer`'s **Pass O (Cross-pollination / peer seeding)** is the only pass in the entire optimizer family that **edits files other than its target**. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#52-how-edges-get-seeded-sko-pass-o
- [definition] 5.3 Integrity maintenance — Deferral edges are referents, and referents rot when skills move or rename. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#53-integrity-maintenance
- [definition] 5.4 Peer seeding vs. keyword discovery — the contrast the title asks for — Keyword discovery is a **runtime guess**: at selection time, score the query against every skill and hope the right one wins. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#54-peer-seeding-vs-keyword-discovery-the-contrast-the-title-asks-for
- [definition] 6.1 Why a skill costs tokens before it ever runs — Every installed skill contributes its **description** to the always-loaded routing context — that is the text the model and the discovery layer read to decide whether the skill is relevant. With hundreds of skills, the sum of descriptions is a real, recurring budget line. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#61-why-a-skill-costs-tokens-before-it-ever-runs
- [definition] 6.2 Level 1 — the two-tier description cap — A skill description is the primary activation signal, but it is length-capped: — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#62-level-1-the-two-tier-description-cap
- [definition] 6.3 Level 2 — hub-and-spoke progressive disclosure — The most important token lever is structural. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#63-level-2-hub-and-spoke-progressive-disclosure
- [definition] 6.4 Level 3 — per-skill progressive disclosure (SKILL.md vs references/) — The same principle operates *inside* a skill. A SKILL.md body carries a **\~6k-token soft budget and a \~10k-token hard ceiling** (`/sko` Pass J). — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#64-level-3-per-skill-progressive-disclosure-skillmd-vs-references
- [definition] 6.5 Level 4 — deferred-tool loading (the tool-side parallel) — Tools have the same problem as skills: a large MCP catalog (the hub exposes hundreds of `tam_*`, `mcp__*` tools) would blow the context budget if every schema were always loaded. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#65-level-4-deferred-tool-loading-the-tool-side-parallel
- [definition] 6.6 Level 5 — prompt/context compression (the ML technique layer) — Where the budget is still tight after structural optimization, the `prompt-context-compression` skill covers the ML techniques that shrink token count while preserving task quality: **LLMLingua / LongLLMLingua** (perplexity-based token pruning under a budget controller), **LLMLingua-2**… — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#66-level-5-promptcontext-compression-the-ml-technique-layer
- [definition] 6.7 Bonus lever — tiering (hot/idle promotion) — The `/skill-tier` engine (`tiering/tier.mjs`, `tier-state.json`, `tier-config.json`) promotes *hot* skills into the always-loaded index and demotes *idle* ones back under their hub. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#67-bonus-lever-tiering-hotidle-promotion
- [definition] 7.1 Two tiers of prompt optimizer — The hub draws a sharp line by prompt *lifecycle*: - **One-off / exploratory prompts** → **`/ph`** (review: critique + recommendations) and **`/phe`** (auto-execute: optimize, save, then immediately run). This is `prompt-helper-optimizer`. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#71-two-tiers-of-prompt-optimizer
- [definition] 7.2 The `tam_optimize_prompt` pipeline (and its instructive failure mode) — `/ph` and `/phe` call **`tam_optimize_prompt`**, which runs: **interpret intent → select relevant skills/MCPs → critique weaknesses → emit an agent-ready rewrite**. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#72-the-tam-optimize-prompt-pipeline-and-its-instructive-failure-mode
- [definition] 7.3 Algorithm-aware recommendations — Both `/phe` and `/pdo` are **algorithm-aware**: when training data exists, they recommend a learned optimization algorithm rather than pretending structural rewriting is the end of the road. The decision table: — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#73-algorithm-aware-recommendations
- [definition] 8. Skill optimization strategies — Across the family, the optimization philosophy is consistent and rests on five pillars: 1. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#8-skill-optimization-strategies
- [definition] 9. The multi-stage passes of `/sko` (skill-optimizer) — `skill-optimizer` reads a `SKILL.md` (or `context.md` + `manifest.yaml`), runs **15 analytical passes (A–O)** inside a **convergence loop (≤3 iterations, conditionally extensible to 5)**, fixes all Medium+ findings, seeds peer-deferral edges, verifies, and syncs to the hub. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#9-the-multi-stage-passes-of-sko-skill-optimizer
- [definition] 9.1 The pass catalog (A–O) and their dispatch bundles — The passes are dispatched as parallel-agent **bundles** for concurrency; Pass O runs sequentially last because it consumes the outputs of Passes I and N. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#91-the-pass-catalog-ao-and-their-dispatch-bundles
- [definition] 9.3 The `--meta` structural-only mode — `/sko <target> --meta` runs **only the wiring/registry/validation work** and skips the content-quality passes — for hub-consolidation cleanup, post-move/rename fixes, and pre-sync checks. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#93-the-meta-structural-only-mode
- [definition] 10.1 The shared spine — All four are explicit **siblings** that cite one canonical contract, `~/.claude/skill-consolidation/convergence-and-severity.md`, for: - the **7 convergence exit conditions**: clean · no-progress · content-cycling · stable-rewrite · loop-instability · iteration-cap · budget; - the **canonical… — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#101-the-shared-spine
- [definition] 10.2 Where they diverge — The differences follow from the artifact each optimizer operates on, and they concentrate in the **pass catalog** and the **verification method**. — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#102-where-they-diverge
- [definition] 10.3 The unifying idea, stated plainly — The four optimizers are **the same convergence machine pointed at four artifact types**, and the single most informative way to tell them apart is *how each defines "verified."* Prose is re-read and its factual claims are checked against evidence (`/ddo`); a prompt can be behaviorally smoke-tested… — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#103-the-unifying-idea-stated-plainly
- [definition] Appendix — Sources — Grounded in the following files and live tools (read/observed 2026-06-17): **Skill definitions** (`~/.claude/skills/<id>/SKILL.md`): `skill-optimizer` (v2.7.0), `prompt-deep-optimizer` (v2.4.0), `ddo` (v1.2.1), `code-deep-optimizer` (v1.1.2), `skill-tree-architect` (v1.2.0), `claude-code-skills`… — https://llms-explorer.com/blog/semantic-skill-discovery-and-the-optimizer-family/#appendix-sources

## Six months of hand-made llms files
<https://llms-explorer.com/blog/six-months-of-hand-made-llms/>

- [snippet] Commands: .venv/bin/python scripts/pipeline_manager.py run          # mirror (trafilatura) → distill → index — `# cwd: ~/.global-ai-hub` — https://llms-explorer.com/blog/six-months-of-hand-made-llms/#commands
- [parameter] code blocks and tab panels dropped: `**macOS, Linux, WSL:**` followed by nothing; 122 fences in 37k lines; `curl -fsSL` twice on a site whose install page is built on it — https://llms-explorer.com/blog/six-months-of-hand-made-llms/#inputs
- [parameter] site chrome kept: 22 % of non-blank lines are duplicates (28,740 unique of 37,033); one FAQ paragraph appears 53 times — https://llms-explorer.com/blog/six-months-of-hand-made-llms/#inputs
- [parameter] link-only lines: 3,144 bare `[text](url)` lines, 8.5 % of the file — https://llms-explorer.com/blog/six-months-of-hand-made-llms/#inputs
- [parameter] one page is 11 % of the mirror: `/docs/en/changelog`, 535 KB, no date structure left — https://llms-explorer.com/blog/six-months-of-hand-made-llms/#inputs
- [parameter] the "distilled" output: 4.65 MB against a 4.74 MB mirror: 17,816 bullets, punctuation scrubbed, regex-bucketed, consumed by nothing — https://llms-explorer.com/blog/six-months-of-hand-made-llms/#inputs
- [parameter] V1 raw trafilatura: Mirror=4,744,720 B; Pages=228; Code fences=122; `curl -fsSL` lines=2; Score=**11 / 20** — https://llms-explorer.com/blog/six-months-of-hand-made-llms/#outputs
- [parameter] V2 after `llms-full.txt` acquisition: Mirror=8,547,884 B; Pages=191; Code fences=5,250; `curl -fsSL` lines=36; Score=— — https://llms-explorer.com/blog/six-months-of-hand-made-llms/#outputs
- [parameter] V2 facts layer (11,965 units: 5,034 parameters, 3,573 definitions, 2,624 snippets, 380 changes, 354 LLM): Mirror=—; Pages=191; Code fences=—; `curl -fsSL` lines=—; Score=**14 / 20** (partial LLM pass) — https://llms-explorer.com/blog/six-months-of-hand-made-llms/#outputs
- [definition] Six months of hand-made llms files — A recorded survey of 608 downloaded llms files and the hub’s V1-to-V2 pilot, with sourced adoption evidence and limits on retrieval results. — https://llms-explorer.com/blog/six-months-of-hand-made-llms/#six-months-of-hand-made-llms-files

## Testing speculative decoding on Apple Silicon and an RTX 5080
<https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/>

- [snippet] The first successful parity test used a bad prompt: <bos><|turn>user — `<bos><|turn>user` — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#the-first-successful-parity-test-used-a-bad-prompt
- [snippet] The validation plan and the next experiment: round cost = drafting + block verification + complete transport/synchronization — `round cost = drafting + block verification + complete transport/synchronization` — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#the-validation-plan-and-the-next-experiment
- [snippet] Inspect or rerun it: PYTHONPATH=llmsx python3 -m llmsx.speculative validate --execute \ — `PYTHONPATH=llmsx python3 -m llmsx.speculative validate --execute \` — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#inspect-or-rerun-it
- [parameter] Apple target: Canonical Gemma 4 31B MLX alias, existing NVFP4 artifacts — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#why-put-a-drafter-on-the-rtx
- [parameter] Native verifier: Go sidecar importing Ollama 0.35.0 — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#why-put-a-drafter-on-the-rtx
- [parameter] Loaded MLX library: `0.32.2-65-g59d600b` — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#why-put-a-drafter-on-the-rtx
- [parameter] RTX suggestion model: Existing Qwen2-beta-14B-Chat tinygrad server — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#why-put-a-drafter-on-the-rtx
- [parameter] Transport: Loopback HTTP between processes, plus the attached device path — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#why-put-a-drafter-on-the-rtx
- [parameter] Experimental context cap: 4,096 tokens — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#why-put-a-drafter-on-the-rtx
- [parameter] Saved research context: 65,536 tokens, unchanged — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#why-put-a-drafter-on-the-rtx
- [parameter] Plain native target: Samples=6; Median committed tokens/sec=21.13; Accepted / proposed draft IDs=—; Strict parity in this sample=Reference — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#corrected-results-low-acceptance-and-slower-output
- [parameter] RTX draft, k=2: Samples=6; Median committed tokens/sec=2.51; Accepted / proposed draft IDs=30 / 426, 7.04%; Strict parity in this sample=Pass — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#corrected-results-low-acceptance-and-slower-output
- [parameter] RTX draft, k=4: Samples=6; Median committed tokens/sec=1.87; Accepted / proposed draft IDs=50 / 772, 6.48%; Strict parity in this sample=Pass — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#corrected-results-low-acceptance-and-slower-output
- [parameter] RTX draft, k=8: Samples=6; Median committed tokens/sec=1.21; Accepted / proposed draft IDs=74 / 1,374, 5.39%; Strict parity in this sample=Both code runs fail — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#corrected-results-low-acceptance-and-slower-output
- [parameter] Plain native target: Median first committed token, seconds=0.171; Exploratory p95, seconds=0.871 — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#corrected-results-low-acceptance-and-slower-output
- [parameter] RTX draft, k=2: Median first committed token, seconds=1.024; Exploratory p95, seconds=3.745 — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#corrected-results-low-acceptance-and-slower-output
- [parameter] RTX draft, k=4: Median first committed token, seconds=0.835; Exploratory p95, seconds=0.843 — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#corrected-results-low-acceptance-and-slower-output
- [parameter] RTX draft, k=8: Median first committed token, seconds=1.428; Exploratory p95, seconds=1.552 — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#corrected-results-low-acceptance-and-slower-output
- [parameter] One-token commits: Proposals k=0; Score for “tells”=22.75; Score for “specifies”=22.75; Selected token=tells — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#same-prefix-different-scores
- [parameter] One-token commits: Proposals k=8; Score for “tells”=22.875; Score for “specifies”=23; Selected token=specifies — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#same-prefix-different-scores
- [parameter] Block commits: Proposals k=0; Score for “tells”=22.625; Score for “specifies”=22.75; Selected token=specifies — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#same-prefix-different-scores
- [parameter] Fresh prefill: Proposals k=0; Score for “tells”=22.875; Score for “specifies”=22.625; Selected token=tells — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#same-prefix-different-scores
- [parameter] Provenance and capabilities: Evidence required=Artifact, tokenizer, model and one-forward verifier identity; Current disposition=Tested checks pass — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#the-validation-plan-and-the-next-experiment
- [parameter] Deterministic contracts: Evidence required=Acceptance, rejection, stale state, EOS, budgets and cleanup; Current disposition=Contract suite passes — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#the-validation-plan-and-the-next-experiment
- [parameter] Native cache and token parity: Evidence required=Single-token oracle, block tests, window crossings and retry; Current disposition=Window sample passes; short block parity fails — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#the-validation-plan-and-the-next-experiment
- [parameter] Actual RTX suggestions: Evidence required=Real proposal acceptance and exact target parity; Current disposition=k=8 code trials fail; latency regresses — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#the-validation-plan-and-the-next-experiment
- [parameter] Installed-runtime control: Evidence required=Same raw prompt, byte/count comparison and cold/warm receipts; Current disposition=Recorded; two byte mismatches — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#the-validation-plan-and-the-next-experiment
- [parameter] Research and long contexts: Evidence required=Tools, factual evidence, 4K/8K/32K/65K contexts, pressure and cancellation; Current disposition=Unqualified — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#the-validation-plan-and-the-next-experiment
- [parameter] Performance promotion: Evidence required=At least 20 balanced warm pairs per workload; Current disposition=Not run — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#the-validation-plan-and-the-next-experiment
- [definition] Testing speculative decoding on Apple Silicon and an RTX 5080 — A working native MLX verifier, a cross-device draft adapter, and the tests that rejected the configuration: low acceptance, slower output and a reproducible token-parity failure. — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#testing-speculative-decoding-on-apple-silicon-and-an-rtx-5080
- [definition] Why put a drafter on the RTX? — The Apple Silicon target was already selected: **`llmsx-research-gemma31-mlx`**, our canonical successful Ollama model for local research. The proposed split kept that target on the 64 GB M5 Max and used the attached RTX 5080 to propose tokens ahead of it. — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#why-put-a-drafter-on-the-rtx
- [definition] What speculative decoding needs from both engines — A drafter proposes `k` tokens. The target evaluates the pending token and those proposals in one causal forward, returning `k+1` next-token decisions. — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#what-speculative-decoding-needs-from-both-engines
- [definition] The backend we built — The target sidecar loads the existing canonical manifest and per-tensor blobs. It calls the real Gemma `Forward` and `Unembed` methods through the imported Ollama source. — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#the-backend-we-built
- [definition] A conservative bridge for Qwen suggestions — The RTX server produces chat-conditioned suggestions. It does not receive Gemma's raw token prefix or expose coordinated native cache rollback. — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#a-conservative-bridge-for-qwen-suggestions
- [definition] The target already bundles an assistant — The manifest audit found a Gemma assistant despite an earlier `mtp_layers: 0` count. That count covered a different naming pattern; the assistant's configuration and `draft.*` tensors were present. — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#the-target-already-bundles-an-assistant
- [definition] The first successful parity test used a bad prompt — The initial raw chat fixtures omitted the literal `<bos>` from Gemma's template. The loaded tokenizer's default was `tokenizer_add_bos=false`, so neither endpoint inserted it automatically. — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#the-first-successful-parity-test-used-a-bad-prompt
- [definition] Corrected results: low acceptance and slower output — Each of the three prompts ran twice. We compared six plain-native controls with 18 real-draft trials at `k=2,4,8`, plus 12 forced oracle trials exercising acceptance and rejection branches. — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#corrected-results-low-acceptance-and-slower-output
- [definition] The ordinary Ollama control — We stopped the sidecar and used the ordinary installed Ollama endpoint with the same raw prompts, neutral greedy options and output cap. Four of six visible byte streams matched the plain native baselines. — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#the-ordinary-ollama-control
- [definition] Same prefix, different scores — We then removed the RTX from the diagnostic question. At the failing prefix, could the native target itself choose different tokens when evaluated in different shapes or with differently constructed caches? — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#same-prefix-different-scores
- [definition] What could cause it? — Shape-dependent floating-point arithmetic is a plausible explanation. The pinned Ollama [quantized projection code](https://github.com/ollama/ollama/blob/cc4069396f3ad2c370c53eed2e4a42ac13adab84/mlxrunner/nn/linear.go) passes the full query tensor into quantized matrix multiplication. — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#what-could-cause-it
- [definition] Cache checks and honest timing — A separate 1,118-token fixture crossed Gemma's actual 1,024-token sliding window. Invalid commitment was rejected. — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#cache-checks-and-honest-timing
- [definition] The validation plan and the next experiment — The [executable plan](/downloads/benchmarks/speculative-decoding-2026-09-30/validation-plan.md) separates implementation checks from hardware qualification: — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#the-validation-plan-and-the-next-experiment
- [definition] Inspect or rerun it — The bundle contains the native sidecar, Python coordinator and CLI, synthetic fixtures, sanitized receipts, source notes and hash manifest. Its README explains the source overlay and existing-model prerequisites. — https://llms-explorer.com/blog/speculative-decoding-apple-silicon-rtx-5080/#inspect-or-rerun-it

## State That Survives the Session
<https://llms-explorer.com/blog/state-that-survives-the-session/>

- [parameter] Session handoff (State / Next / Context): Capability=Resume; Implementation=`.remember/remember.md`; Status=Active — https://llms-explorer.com/blog/state-that-survives-the-session/#4-proof-the-architecture-as-implemented
- [parameter] Rolling \+ recency-tiered buffers: Capability=Resume; Implementation=`.remember/now.md`, `recent.md`, `archive.md`, `core-memories.md`, dated `today-*.done.md`; Status=Active — https://llms-explorer.com/blog/state-that-survives-the-session/#4-proof-the-architecture-as-implemented
- [parameter] Auto-load handoff at session start: Capability=Resume; Implementation=SessionStart hook in `.claude/settings.local.json`; Status=Active — https://llms-explorer.com/blog/state-that-survives-the-session/#4-proof-the-architecture-as-implemented
- [parameter] Indexed single-fact store: Capability=Recall (semantic/episodic); Implementation=`~/.claude/projects/<project>/memory/` — `MEMORY.md` index \+ one-fact-per-file w/ frontmatter (harness-level); Status=Active (\>20 facts) — https://llms-explorer.com/blog/state-that-survives-the-session/#4-proof-the-architecture-as-implemented
- [parameter] Reusable prompt library: Capability=Recall (procedural); Implementation=`tam_save_prompt` / `tam_get_prompt` / `tam_recommend_prompts`; markdown under `prompts/saved/`; kinds `saved`/`workflow`/`template`/`report`/`bundle`; Status=Active — https://llms-explorer.com/blog/state-that-survives-the-session/#4-proof-the-architecture-as-implemented
- [parameter] Always-on procedural memory: Capability=Recall (always-loaded); Implementation=root `CLAUDE.md` \+ `~/.claude/CLAUDE.md`; Status=Active — https://llms-explorer.com/blog/state-that-survives-the-session/#4-proof-the-architecture-as-implemented
- [parameter] Versioned project journal: Capability=Resume \+ audit; Implementation=`memory.md`, `prompts.md` (`## v1.0.NNN`); Status=Active — https://llms-explorer.com/blog/state-that-survives-the-session/#4-proof-the-architecture-as-implemented
- [parameter] Journal rotation (bound the read path): Capability=Resume hygiene; Implementation=`scripts/rotate-workflow-logs.mjs` (rotate \>\~200 KB → `docs/archive/`); Status=Active — https://llms-explorer.com/blog/state-that-survives-the-session/#4-proof-the-architecture-as-implemented
- [parameter] Settings / secrets persistence: Capability=App state; Implementation=`chrome.storage.local` (vault envelope, refresh tokens); Status=Active — https://llms-explorer.com/blog/state-that-survives-the-session/#4-proof-the-architecture-as-implemented
- [parameter] Memory-only session secrets: Capability=Ephemeral by design; Implementation=`chrome.storage.session` (DEK, access tokens — never persisted); Status=Active by design — https://llms-explorer.com/blog/state-that-survives-the-session/#4-proof-the-architecture-as-implemented
- [parameter] Primary corpus store: Capability=App recall; Implementation=IndexedDB — `src/background/db.js`, `corpus-store/`; Status=Active — https://llms-explorer.com/blog/state-that-survives-the-session/#4-proof-the-architecture-as-implemented
- [parameter] Best-effort corpus mirror: Capability=App recall; Implementation=asynchronous write to Node `/api/corpus` via `corpus-store/dual-write-corpus-store.js`; Status=Implemented; per-write completion needs verification — https://llms-explorer.com/blog/state-that-survives-the-session/#4-proof-the-architecture-as-implemented
- [parameter] Stable-prefix cache: Capability=Cost of re-send; Implementation=`cache_control` (see sibling whitepaper); Status=Active — https://llms-explorer.com/blog/state-that-survives-the-session/#4-proof-the-architecture-as-implemented
- [parameter] `.remember/remember.md`: Capability=Resume; Level=Project; Holds=Next-session handoff: State / Next / Context — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] `.remember/now.md`: Capability=Resume; Level=Project; Holds=Rolling buffer of recent session checkpoints — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] `.remember/recent.md`: Capability=Resume; Level=Project; Holds=\~7-day window of activity — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] `.remember/archive.md`: Capability=Resume; Level=Project; Holds=Older activity, off the hot read path — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] `.remember/core-memories.md`: Capability=Resume; Level=Project; Holds=Durable "key moments" — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] `.remember/today-*.done.md`: Capability=Resume; Level=Project; Holds=Closed daily logs — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] `~/.claude/projects/<project>/memory/MEMORY.md`: Capability=Recall; Level=Harness; Holds=One-line index over all stored facts — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] `~/.claude/projects/<project>/memory/<fact>.md`: Capability=Recall; Level=Harness; Holds=One fact per file; frontmatter `name` / `description` / `metadata.type` (`user`/`feedback`/`project`/`reference`) — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] `prompts/saved/*.md` (via tam-MCP): Capability=Recall; Level=Project / hub; Holds=Reusable prompts; `kind` ∈ {saved, workflow, template, report, bundle} — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] `CLAUDE.md` (root) \+ `~/.claude/CLAUDE.md`: Capability=Recall; Level=Project \+ Harness; Holds=Always-loaded procedural memory: rules, conventions, architecture — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] `memory.md`, `prompts.md`: Capability=Resume \+ audit; Level=Project; Holds=Versioned project journal (`## v1.0.NNN`) — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] `scripts/rotate-workflow-logs.mjs`: Capability=Hygiene; Level=Project; Holds=Rotates logs \>\~200 KB into `docs/archive/` — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] `chrome.storage.local`: Capability=App state; Level=Runtime; Holds=Settings, accounts, OAuth refresh tokens, vault envelope — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] `chrome.storage.session`: Capability=Ephemeral; Level=Runtime; Holds=Vault DEK, OAuth access tokens — memory-only, never persisted — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] IndexedDB (`src/background/db.js`, `corpus-store/`): Capability=App recall; Level=Runtime; Holds=Primary account-corpus store — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] Node backend `/api/corpus` (dual-write): Capability=App recall; Level=Server; Holds=Best-effort corpus mirror; verify completion — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [parameter] `.claude/settings.local.json` (SessionStart hook): Capability=Resume trigger; Level=Harness; Holds=Injects the `.remember/` handoff at session start — https://llms-explorer.com/blog/state-that-survives-the-session/#appendix-a-on-disk-persistence-inventory
- [definition] State That Survives the Session — The June mdb-tam memory design separates session handoffs from indexed recall, with limits on persistence, mirroring, and measured benefit. — https://llms-explorer.com/blog/state-that-survives-the-session/#state-that-survives-the-session
- [definition] 1\. The problem: the working memory is finite, degrading, and discarded — An LLM agent that must carry work across time sits on top of four compounding constraints. — https://llms-explorer.com/blog/state-that-survives-the-session/#1-the-problem-the-working-memory-is-finite-degrading-and-discarded
- [definition] 2\. Why single-technique approaches fall short — Four obvious approaches each solve part of the problem and leave the rest. — https://llms-explorer.com/blog/state-that-survives-the-session/#2-why-single-technique-approaches-fall-short
- [definition] 3\. The approach: split by capability, tier by recency, keep the read short — The architecture rests on one idea: **externalize state to disk, but separate the resume path from the recall path, because they have opposite shape requirements.** Resumability wants the *smallest ordered set of current state*, read on every session start, so it must stay short or it reintroduces… — https://llms-explorer.com/blog/state-that-survives-the-session/#3-the-approach-split-by-capability-tier-by-recency-keep-the-read-short
- [definition] 3.1 The resumability layer — the `.remember/` handoff — Resumability is served by a dedicated, recency-tiered set of files at the repo root under `.remember/`, written at session end and read at session start: - **`remember.md`**: the explicit next-session handoff, structured as **State / Next / Context**: what is currently true, what to do next, and… — https://llms-explorer.com/blog/state-that-survives-the-session/#31-the-resumability-layer-the-remember-handoff
- [definition] 3.2 The recall layer — an indexed fact store and a prompt library — Recall is served by two durable, retrieval-shaped stores. — https://llms-explorer.com/blog/state-that-survives-the-session/#32-the-recall-layer-an-indexed-fact-store-and-a-prompt-library
- [definition] 3.3 The project journal and the runtime stores — Two more persistence surfaces sit alongside the agent-memory layers and serve the application itself. — https://llms-explorer.com/blog/state-that-survives-the-session/#33-the-project-journal-and-the-runtime-stores
- [definition] 3.4 The ordering principle — The layers compose under one rule drawn directly from the context-rot evidence: **keep the read the smallest high-signal set, not the biggest dump** (LangChain's Write / Select / Compress / Isolate frame; Karpathy's finite "attention budget"). Resume reads are kept short and ordered by recency. — https://llms-explorer.com/blog/state-that-survives-the-session/#34-the-ordering-principle
- [definition] 4\. Proof: the architecture as implemented — The table records the implementation and status reported in June 2026; paths are relative to mdb-tam unless marked harness-level. It is not a live September status check. — https://llms-explorer.com/blog/state-that-survives-the-session/#4-proof-the-architecture-as-implemented
- [definition] 5\. Implementation considerations — Six points drawn from how this system is built. — https://llms-explorer.com/blog/state-that-survives-the-session/#5-implementation-considerations
- [definition] 6\. Conclusion — A caller constructs model context for each request. Durable transcripts, checkpoints, and fact stores let a harness restore context after a session or process ends. — https://llms-explorer.com/blog/state-that-survives-the-session/#6-conclusion

## StickySites — Project Briefing
<https://llms-explorer.com/blog/stickysites-project-briefing/>

- [snippet] 6. Architecture Overview *(reviewers + team)*: Browser action popup (popup.*) ─┐ — `Browser action popup (popup.*) ─┐` — https://llms-explorer.com/blog/stickysites-project-briefing/#6-architecture-overview-reviewers-team
- [snippet] Development: npm install          # dev dependencies (Vitest, canvas) — `npm install          # dev dependencies (Vitest, canvas)` — https://llms-explorer.com/blog/stickysites-project-briefing/#development
- [snippet] Validation gate: npm test — `npm test` — https://llms-explorer.com/blog/stickysites-project-briefing/#validation-gate
- [parameter] **Notes scattered across apps** — context for a site lives in a separate notes app you have to switch to: Notes live on the page itself, scoped to the site, page, or day you're looking at — https://llms-explorer.com/blog/stickysites-project-briefing/#3-problems-solved-leadership-team
- [parameter] **One-size note scope** — a single notepad can't separate "this page" from "this site" from "today": Six note types with separate storage keys and resolvers, including global To-do and Outliner storage — https://llms-explorer.com/blog/stickysites-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Losing notes on SPA navigation** — single-page apps change the URL without a reload: The panel snapshots the active key at open and re-keys safely on `popstate`/`hashchange`/href-poll — https://llms-explorer.com/blog/stickysites-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Sensitive notes in plaintext**: Opt-in AES-256-GCM encryption with a PBKDF2-derived key and an in-page lock — https://llms-explorer.com/blog/stickysites-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Hotkeys hijacking the page**: Ctrl/Cmd (`F1`–`F6`) coexist with bare `1`–`5` and `A` while the cluster is visible outside editable fields. The bare-key handler does not exclude Ctrl/Cmd modifiers, so select-all can still conflict — https://llms-explorer.com/blog/stickysites-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Finding a note later**: A popup dashboard with full-text search, sort, type/tag filters, and Markdown export — https://llms-explorer.com/blog/stickysites-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Capturing text while reading**: Right-click context-menu clipping into any note type — https://llms-explorer.com/blog/stickysites-project-briefing/#3-problems-solved-leadership-team
- [parameter] **Privacy concerns with note tools**: Local-only storage, zero external calls, no telemetry, no third-party scripts — https://llms-explorer.com/blog/stickysites-project-briefing/#3-problems-solved-leadership-team
- [parameter] Workspace panel + rich-text editor: Path=`src/content/panel.js`; Approx. lines=1,848 — https://llms-explorer.com/blog/stickysites-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Outliner UI: Path=`src/content/outline.js`; Approx. lines=800 — https://llms-explorer.com/blog/stickysites-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Storage CRUD (shared module): Path=`src/shared/notes-storage.js`; Approx. lines=363 — https://llms-explorer.com/blog/stickysites-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Other content scripts (cluster, mentions, todo, outline-ops, crypto-content, note-types, prefs, orchestrator): Path=`src/content/*`; Approx. lines=~1,274 — https://llms-explorer.com/blog/stickysites-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Service worker: Path=`src/background/service-worker.js`; Approx. lines=86 — https://llms-explorer.com/blog/stickysites-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Crypto primitives (shared module): Path=`src/shared/crypto.js`; Approx. lines=71 — https://llms-explorer.com/blog/stickysites-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Popup dashboard: Path=`popup.js`; Approx. lines=869 — https://llms-explorer.com/blog/stickysites-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Popout window: Path=`popout.js`; Approx. lines=41 — https://llms-explorer.com/blog/stickysites-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] Unit tests (3 suites): Path=`tests/*.js`; Approx. lines=572 — https://llms-explorer.com/blog/stickysites-project-briefing/#4-scope-of-work-leadership-reviewers
- [parameter] `STICKYSITES_TOGGLE`: Direction=SW → content; Purpose=Toggle cluster visibility — https://llms-explorer.com/blog/stickysites-project-briefing/#message-contract
- [parameter] `STICKYSITES_OPEN`: Direction=SW → content; Purpose=Open a specific note type (optional `key` targets an outline doc) — https://llms-explorer.com/blog/stickysites-project-briefing/#message-contract
- [parameter] `STICKYSITES_CLIP`: Direction=SW → content; Purpose=Clip selected text into a note — https://llms-explorer.com/blog/stickysites-project-briefing/#message-contract
- [parameter] `STICKYSITES_POPOUT`: Direction=content → SW; Purpose=Open the current note in a standalone window — https://llms-explorer.com/blog/stickysites-project-briefing/#message-contract
- [parameter] `vitest`: Version=`^4.1.0`; Rationale=Unit-test runner (node environment; `chrome.*` mocked) — https://llms-explorer.com/blog/stickysites-project-briefing/#development-devdependencies-in-packagejson
- [parameter] `canvas`: Version=`^3.2.3`; Rationale=Used by `scripts/generate-icons.js` to render the extension icons — https://llms-explorer.com/blog/stickysites-project-briefing/#development-devdependencies-in-packagejson
- [parameter] **No Shadow DOM encapsulation**: Injected UI shares the host DOM; aggressive host-page CSS can break the StickySites UI, and host-page JS can read the open panel. A Shadow DOM root is the planned fix. — https://llms-explorer.com/blog/stickysites-project-briefing/#11-known-limitations-all
- [parameter] **Content-script re-injection on update**: Chrome may re-inject after an extension update; a guard prevents double UI, but listeners from the previous injection can be orphaned until the page is reloaded. — https://llms-explorer.com/blog/stickysites-project-briefing/#11-known-limitations-all
- [parameter] **PBKDF2 is slow on low-end devices**: 600 K iterations can take 2–4 s to unlock, with no progress indicator, so the unlock button appears to hang. By design (security floor); a spinner is the planned improvement. — https://llms-explorer.com/blog/stickysites-project-briefing/#11-known-limitations-all
- [parameter] **Cached key persists on disk until locked**: The derived key lives in `chrome.storage.local` until **Lock Now** or disable — not cleared on browser close (see §5). — https://llms-explorer.com/blog/stickysites-project-briefing/#11-known-limitations-all
- [parameter] **Rich-text editor uses `document.execCommand`**: The toolbar relies on the deprecated `execCommand` API; it works in current Chrome but is not future-proof. — https://llms-explorer.com/blog/stickysites-project-briefing/#11-known-limitations-all
- [parameter] Architecture: `docs/ARCHITECTURE.md` — https://llms-explorer.com/blog/stickysites-project-briefing/#links
- [parameter] Components: `docs/COMPONENTS.md` — https://llms-explorer.com/blog/stickysites-project-briefing/#links
- [parameter] Security model: `docs/SECURITY.md` — https://llms-explorer.com/blog/stickysites-project-briefing/#links
- [parameter] Development: `docs/DEVELOPMENT.md` — https://llms-explorer.com/blog/stickysites-project-briefing/#links
- [parameter] Installation: `docs/INSTALLATION.md` — https://llms-explorer.com/blog/stickysites-project-briefing/#links
- [parameter] Testing: `docs/TESTING.md` — https://llms-explorer.com/blog/stickysites-project-briefing/#links
- [parameter] Logging: `docs/logging.md` — https://llms-explorer.com/blog/stickysites-project-briefing/#links
- [parameter] Caching & optimization: `docs/caching-and-optimization.md` — https://llms-explorer.com/blog/stickysites-project-briefing/#links
- [parameter] External calls (none): `docs/external-calls.md` — https://llms-explorer.com/blog/stickysites-project-briefing/#links
- [parameter] Known issues: `docs/known-issues.md` — https://llms-explorer.com/blog/stickysites-project-briefing/#links
- [parameter] Codebase overview: `docs/codebase-overview.md` — https://llms-explorer.com/blog/stickysites-project-briefing/#links
- [parameter] File index (machine-readable): `docs/high_signal_file_index.json` — https://llms-explorer.com/blog/stickysites-project-briefing/#links
- [parameter] Runbooks: `docs/runbooks/` — https://llms-explorer.com/blog/stickysites-project-briefing/#links
- [parameter] Bootstrap audit (2026-06-17): `docs/repo-bootstrap-audit-2026-06-17.md` — https://llms-explorer.com/blog/stickysites-project-briefing/#links
- [definition] StickySites — Project Briefing — A June 2026 briefing of StickySites v1.10.0 covers its six note types, Chrome page access, local storage, and opt-in AES-256-GCM encryption. — https://llms-explorer.com/blog/stickysites-project-briefing/#stickysites-project-briefing
- [definition] Permissions — The manifest requests only `storage`, `activeTab`, and `contextMenus`. There are **no `host_permissions`** and no `tabs`, `webRequest`, `cookies`, `history`, or `identity` permissions. — https://llms-explorer.com/blog/stickysites-project-briefing/#permissions
- [definition] Encryption — Open the popup **Settings** panel and enable encryption with a passphrase. All six note types are re-encrypted in place. — https://llms-explorer.com/blog/stickysites-project-briefing/#encryption
- [definition] Runtime — none — The shipped extension has **zero runtime dependencies**. It runs entirely on built-in browser APIs: `chrome.storage`, `chrome.runtime`, `chrome.tabs`, `chrome.contextMenus`, `chrome.commands`, `chrome.windows`, and the Web Crypto API (`crypto.subtle`). — https://llms-explorer.com/blog/stickysites-project-briefing/#runtime-none
- [definition] Workflow log — The repo keeps a committed operator log: append the user request to `prompts.md` and update the latest `memory.md` entry as work progresses. (A separate, gitignored `.remember/` directory is used by local tooling; `memory.md`/`prompts.md` are the shareable record.) — https://llms-explorer.com/blog/stickysites-project-briefing/#workflow-log
- [definition] Version bump — `manifest.json.version` is the canonical release version. Bump the patch there and keep `package.json.version` in sync on any meaningful change. — https://llms-explorer.com/blog/stickysites-project-briefing/#version-bump
- [definition] 11. Known Limitations *(all)* — See `docs/known-issues.md` for full detail. — https://llms-explorer.com/blog/stickysites-project-briefing/#11-known-limitations-all
- [definition] Links — The logging, caching, file-index, runbook, and bootstrap-audit links below point to later repository documentation. They were not present in the v1.10.0 snapshot and do not describe its CI gate. — https://llms-explorer.com/blog/stickysites-project-briefing/#links

## The Deep Document Optimizer — A Live Run
<https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/>

- [snippet] Prompt and setup: ❯ Use the deep document optimizer on this filee ~/Downloads/skills_showcase.md — `❯ Use the deep document optimizer on this filee ~/Downloads/skills_showcase.md` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#prompt-and-setup
- [snippet] Prompt and setup: ⏺ Read(~/Downloads/skills_showcase.md) — `⏺ Read(~/Downloads/skills_showcase.md)` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#prompt-and-setup
- [snippet] Prompt and setup: ⏺ Skill(ddo) — `⏺ Skill(ddo)` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#prompt-and-setup
- [snippet] Prompt and setup: ⏺ Read(~/.claude/skills/writing-expert/references/document-critique.md) — `⏺ Read(~/.claude/skills/writing-expert/references/document-critique.md)` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#prompt-and-setup
- [snippet] Prompt and setup: ⏺ Bash(TS=$(date +%Y%m%d-%H%M%S); DIR=~/.claude/skill-consolidation/backups/ddo-$TS; mkdir -p "$DIR"; cp ~/Downloads/ski — `⏺ Bash(TS=$(date +%Y%m%d-%H%M%S); DIR=~/.claude/skill-consolidation/backups/ddo-$TS; mkdir -p "$DIR"` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#prompt-and-setup
- [snippet] The rewrite: ⏺ Write(~/Downloads/skills_showcase.md) — `⏺ Write(~/Downloads/skills_showcase.md)` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-rewrite
- [snippet] The rewrite: # Skills Ecosystem — Showcase — `# Skills Ecosystem — Showcase` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-rewrite
- [snippet] The verification gate: ⏺ Bash(post-edit gate: word count, code-fence parity, heading levels, residual escape artifacts, URL list, Slack-cruft r — `⏺ Bash(post-edit gate: word count, code-fence parity, heading levels, residual escape artifacts, URL` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-verification-gate
- [snippet] The verification gate: ⏺ Bash(count residual typos, lowercase term leaks, and any surviving text from the opening context-doc/Aha question) — `⏺ Bash(count residual typos, lowercase term leaks, and any surviving text from the opening context-d` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-verification-gate
- [snippet] The verification gate: ⏺ Bash(case-sensitive grep for the exact misspellings, then confirm the "overhead" fix landed) — `⏺ Bash(case-sensitive grep for the exact misspellings, then confirm the "overhead" fix landed)` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-verification-gate
- [snippet] The verification gate: ⏺ Bash(append four per-pass rows to ~/.claude/skill-consolidation/optimizer-telemetry.jsonl) — `⏺ Bash(append four per-pass rows to ~/.claude/skill-consolidation/optimizer-telemetry.jsonl)` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-verification-gate
- [snippet] The close-out report: Optimized document written to: ~/Downloads/skills_showcase.md — `Optimized document written to: ~/Downloads/skills_showcase.md` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-close-out-report
- [snippet] The close-out report: cp ~/.claude/skill-consolidation/backups/ddo-20260617-123209/skills_showcase.md ~/Downloads/skills_showcase.md — `cp ~/.claude/skill-consolidation/backups/ddo-20260617-123209/skills_showcase.md ~/Downloads/skills_s` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-close-out-report
- [parameter] Target: `~/Downloads/skills_showcase.md` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] Type: Showcase / capture — Slack-thread export + 2 pasted Claude Q&A transcripts — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] Audience: MongoDB colleagues & leadership (technical, internal) `[inferred: internal GitHub repo links, "MDB is paying for the tokens", internal Slack/Aha URLs]` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] Purpose: Show what Mitch built across the skill ecosystem and why it raised his case-solve rate. — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] Reader action: Understand the architecture; appreciate/support/adopt the approach. — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] Success evidence: Reader grasps the hub-and-spoke + meta-research design and the demonstrated wins `[inferred: "showcase" filename + persuasive framing]` — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] Constraints: Internal-only (contains internal URLs + candid asides); preserve the two transcripts as verbatim exhibits; preserve all URLs, repo names, and factual claims. — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] Mode: full — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] Max iters: 3 — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] Converge: no medium-or-higher findings remain — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] Document type: General prose / showcase (unknown → dynamic fallback) — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] Hub: writing-expert — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] References: `writing-expert/references/editing-and-revision.md` (skeleton), `kill-the-AI-ism.md` (loaded) — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] Voice layer: kill-the-AI-ism — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] Note: Region B (lines 76–258) = directly-quoted transcripts → Pass 13 immunity (quoted material); clean paste-corruption only, do not rephrase. — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [parameter] 1/2: Name=Intent/Structure; Severity=MAJOR; Finding=Lines 1–5 open with an unrelated context-doc / Aha-report question (unanswered fragments) that contradict the showcase purpose — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-audit
- [parameter] 2: Name=Structure; Severity=MAJOR; Finding=Flat Slack dump, no organizing structure; reader can't navigate the showcase — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-audit
- [parameter] 2: Name=Structure; Severity=MEDIUM; Finding=Two appended transcripts pasted raw with no framing as exhibits — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-audit
- [parameter] 12: Name=Meta-artifact; Severity=MAJOR; Finding=Markdown-escape corruption throughout (`[ ] # ~ < > - _ .`) — renders literal backslashes everywhere (mechanical integrity) — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-audit
- [parameter] 12: Name=Meta-artifact; Severity=MEDIUM; Finding=Slack-UI cruft: ~14 standalone timestamps, duplicate speaker labels, "Zip"/triplicated zip link, "1x", "\| Screen Recording…mov" fragment — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-audit
- [parameter] 12/13: Name=Meta/Voice; Severity=MEDIUM; Finding=Live-chat navigational filler ("Ok I'm done now.", "please tell me to stop", "hold on this may be easier:") — scaffolding, not content — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-audit
- [parameter] 3.5: Name=Terminology; Severity=MEDIUM; Finding=Inconsistent caps: glean/Glean, mcp/MCP, claude-code/Claude Code, AHA/Aha!, voyageai/VoyageAI, MDB/MongoDB in prose — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-audit
- [parameter] 13: Name=Voice; Severity=MINOR→fix (co-located); Finding=Typos: experrience, overheard→overhead, funcationality, WHIch, triaining, extertise, "versus and agent" — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-audit
- [parameter] 10.5: Name=Verification; Severity=—; Finding=All URLs internal/auth-walled → unverifiable (requires auth); not altered. Self-referential claims about own tooling — left intact — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-audit
- [parameter] 11.5: Name=Adversarial; Severity=—; Finding=Embedded `❯ Explain…` prompts + answers are exhibit content, not injection. Clean. No disprovable hallucinated IDs — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-audit
- [parameter] 13: Name=Voice (Region B); Severity=N/A; Finding=Transcripts = directly-quoted material → immune; de-corrupt formatting only, do not rephrase — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-audit
- [parameter] 1: Blocking=0; Major=3; Medium=4; Minor=~7; Nits=—; Action=Fixed all Major + Medium; folded co-located typos; deferred voice — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-close-out-report
- [parameter] 0: Name=Domain awareness; Status=writing-expert + kill-the-AI-ism activated — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-close-out-report
- [parameter] 1: Name=Intent; Status=contract locked; off-topic opener removed — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-close-out-report
- [parameter] 2: Name=Structure; Status=flat dump → 9 navigable sections + exhibit appendix — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-close-out-report
- [parameter] 3: Name=Technical correctness; Status=self-report, internally consistent — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-close-out-report
- [parameter] 3.5: Name=Terminology; Status=Glean, MCP, MongoDB, Claude Code, VoyageAI standardized — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-close-out-report
- [parameter] 6: Name=Completeness; Status=N/A (showcase, not operational) — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-close-out-report
- [parameter] 10.5: Name=Verification; Status=all URLs auth-walled → unverifiable (requires auth); not altered — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-close-out-report
- [parameter] 11.5: Name=Adversarial/hallucination; Status=clean — embedded prompts are exhibit content, not injection — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-close-out-report
- [parameter] 12: Name=Meta-artifact cleanup; Status=de-escaped all markdown; removed ~14 timestamps, dup labels, "1x", ".mov" fragment, triplicated zip link — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-close-out-report
- [parameter] 13: Name=Human-voice; Status=Region A typos fixed; Region B transcripts kept verbatim (quoted-material immunity) — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-close-out-report
- [definition] The Deep Document Optimizer — A Live Run — A trimmed Claude Code transcript of /ddo cleaning a corrupted Slack export in one iteration, from contract to close-out report, with a rollback command for its one judgment call. — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-deep-document-optimizer-a-live-run
- [definition] The contract and routing — Optimization contract (Step 2): — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-contract-and-routing
- [definition] The verification gate — Running the post-edit verification gate (Step 5.5) — mechanical integrity, fact-preservation, delta bound. — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-verification-gate
- [definition] The close-out report — /ddo complete — converged clean in one iteration. — https://llms-explorer.com/blog/the-deep-document-optimizer-a-live-run/#the-close-out-report

## The lint that gates the estate
<https://llms-explorer.com/blog/the-lint-that-gates-the-estate/>

- [snippet] Commands: .venv/bin/python scripts/llms_lint.py detect text-mirror/mongodb.com.llms/llms.txt          # kind + grammar — `# cwd: ~/.global-ai-hub` — https://llms-explorer.com/blog/the-lint-that-gates-the-estate/#commands
- [parameter] P0 detect: Kind=all; What fails High=none — reports kind and grammar so the right passes run — https://llms-explorer.com/blog/the-lint-that-gates-the-estate/#outputs
- [parameter] P1 structure: Kind=index, family; What fails High=no H1; more than one H1 — https://llms-explorer.com/blog/the-lint-that-gates-the-estate/#outputs
- [parameter] P2 links: Kind=index, family; What fails High=a relative target that does not exist (spoke split), a link with no target — https://llms-explorer.com/blog/the-lint-that-gates-the-estate/#outputs
- [parameter] P3 descriptions: Kind=index; What fails High=missing descriptions on more than 40% of links, with at least three missing; lesser gaps, duplicates, and restated titles are Medium — https://llms-explorer.com/blog/the-lint-that-gates-the-estate/#outputs
- [parameter] P5 size ladder: Kind=all; What fails High=an index over 100,000 bytes — a full file wearing the wrong name — https://llms-explorer.com/blog/the-lint-that-gates-the-estate/#outputs
- [parameter] P6 full-file fidelity: Kind=full; What fails High=a grammar detected but zero page blocks parsed — https://llms-explorer.com/blog/the-lint-that-gates-the-estate/#outputs
- [parameter] P7 facts shape: Kind=facts; What fails High=a line with no source URL; a type outside the twelve; no unit lines at all — https://llms-explorer.com/blog/the-lint-that-gates-the-estate/#outputs
- [parameter] P9 provenance, rights and steering: Kind=all; What fails High=a real credential or PEM key body in copied text (attribute `P5`); third-party full text with no `<!-- internal -->` marker (attribute `P3`; the marker identifies internal use and does not grant publication rights). A suspected instruction to the reading model is attribute `P4` and only a Medium — the model pass confirms it — https://llms-explorer.com/blog/the-lint-that-gates-the-estate/#outputs
- [parameter] P14 hygiene: Kind=all; What fails High=never High (excluded from Medium+ credit) — https://llms-explorer.com/blog/the-lint-that-gates-the-estate/#outputs
- [definition] The lint that gates the estate — The August 2026 lint run reported 0 High findings across 15 docsets; source checks explain its current thresholds and limits on credentials, rights, and steering. — https://llms-explorer.com/blog/the-lint-that-gates-the-estate/#the-lint-that-gates-the-estate

## An RTX 5080 over Thunderbolt on a Linux NUC: the tunnel the kernel threw away
<https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/>

- [snippet] The setup: 00:07.0  Thunderbolt 4 root port         (tunnel: "2.5 GT/s x4", virtual) — `00:07.0  Thunderbolt 4 root port         (tunnel: "2.5 GT/s x4", virtual)` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-setup
- [snippet] Symptom: 1.2s  NVRM: loading NVIDIA UNIX Open Kernel Module 610.57.04 — `1.2s  NVRM: loading NVIDIA UNIX Open Kernel Module 610.57.04` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#symptom
- [snippet] Localizing the fault: import mmap, os, struct — `import mmap, os, struct` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#localizing-the-fault
- [snippet] Localizing the fault: for d in 00:07.0 02:00.0 03:00.0 04:00.0; do setpci -s $d CAP_EXP+0xa.w=0xf; done — `for d in 00:07.0 02:00.0 03:00.0 04:00.0; do setpci -s $d CAP_EXP+0xa.w=0xf; done` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#localizing-the-fault
- [snippet] The fix: GRUB_CMDLINE_LINUX_DEFAULT="$GRUB_CMDLINE_LINUX_DEFAULT thunderbolt.host_reset=0 pci=realloc=off pcie_ports=native pcie_ — `GRUB_CMDLINE_LINUX_DEFAULT="$GRUB_CMDLINE_LINUX_DEFAULT thunderbolt.host_reset=0 pci=realloc=off pci` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-fix
- [snippet] The fix: resource0 0x1b3000a1      ← PMC_BOOT_0: a GB203, answering — `resource0 0x1b3000a1      ← PMC_BOOT_0: a GB203, answering` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-fix
- [snippet] The fix: options nvidia NVreg_DynamicPowerManagement=0x00 NVreg_PreserveVideoMemoryAllocations=0 — `# /etc/modprobe.d/nvidia-egpu-pm.conf` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-fix
- [snippet] The fix: NVIDIA-SMI 610.57.04   KMD Version: 610.57.04   CUDA UMD Version: 13.3 — `NVIDIA-SMI 610.57.04   KMD Version: 610.57.04   CUDA UMD Version: 13.3` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-fix
- [snippet] Making it survive reboots: for i in $(seq 1 60); do — `#!/bin/sh` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#making-it-survive-reboots
- [snippet] Making it survive reboots: [Unit] — `# /etc/systemd/system/egpu-nvidia.service` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#making-it-survive-reboots
- [snippet] Ollama on the GPU: inference compute  id=0 library=CUDA compute=12.0 name=CUDA0 — `inference compute  id=0 library=CUDA compute=12.0 name=CUDA0` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#ollama-on-the-gpu
- [snippet] Ollama on the GPU: $ ollama run llama3.2:3b --verbose 'List 40 animals, one per line.' — `$ ollama run llama3.2:3b --verbose 'List 40 animals, one per line.'` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#ollama-on-the-gpu
- [snippet] BIOS CLI: iSetupCfg: sudo ./iSetupCfgLnx64 /o /s all.txt                          # dump everything — `sudo ./iSetupCfgLnx64 /o /s all.txt                          # dump everything` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#bios-cli-isetupcfg
- [parameter] Host: ASUS NUC 15 Pro (NUC15CRKU5), Intel Arrow Lake-H, Intel Arc iGPU — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-setup
- [parameter] BIOS: CRARL579.0032 (recorded July 2026 build) — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-setup
- [parameter] OS: Ubuntu 26.04, kernel 7.0.0-34-generic, Secure Boot off — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-setup
- [parameter] Driver: `nvidia-driver-610-open` 610.57.04 — the open kernel module, which is the flavor Blackwell needs — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-setup
- [parameter] Enclosure: Razer Core X V2 (USB4/Thunderbolt 5, Intel JHL9480 "Barlow Ridge" bridges) — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-setup
- [parameter] GPU: PNY GeForce RTX 5080, GB203, PCI ID `10de:2c02` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-setup
- [parameter] Host ports: Two Thunderbolt 4 root ports, `00:07.0` and `00:07.2` — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-setup
- [parameter] Goal: Ollama running models on the GPU, headless — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-setup
- [definition] An RTX 5080 over Thunderbolt on a Linux NUC: the tunnel the kernel threw away — A recorded RTX 5080 troubleshooting session on a Linux NUC, separating the working kernel profile from unverified causality and reboot guarantees. — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#an-rtx-5080-over-thunderbolt-on-a-linux-nuc-the-tunnel-the-kernel-threw-away
- [definition] Symptom — On every boot where the driver loaded early, the kernel log had the same shape: — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#symptom
- [definition] What was ruled out — By the time this session picked the problem up, the previous one had already closed the easy doors: - **Hardware.** The card, enclosure, cable and PSU had run a verified tinygrad `tinygpu` matmul on an Apple Silicon Mac at USB4 v2 80 Gb/s, PCIe Gen4 x4. — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#what-was-ruled-out
- [definition] Localizing the fault — The register that settles "is the GPU core alive" is `PMC_BOOT_0`, the chip ID at BAR0 offset 0. The following forensic read used this machine's enumerated address with the NVIDIA driver unloaded. — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#localizing-the-fault
- [definition] The advisory review — Before touching the BIOS, the whole evidence file was handed to a second model (Fable) for an independent, read-only review: rank the hypotheses, say what would discriminate between them, say what looks over-confident. Its headline changed the direction of the debugging: — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-advisory-review
- [definition] The fix — The kernel command line in `/etc/default/grub.d/egpu-rtx5080.cfg` was replaced with the forum recipe, dropping the hotplug-window parameters since the point was to *keep* the BIOS's assignment rather than redo it: — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#the-fix
- [definition] Making it survive reboots — `host_reset=0` alone would probably let the driver autoload safely at boot. It was not allowed to, on purpose. — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#making-it-survive-reboots
- [definition] Ollama on the GPU — Ollama says what it found at startup, and it is worth grepping for after every driver change: — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#ollama-on-the-gpu
- [definition] BIOS CLI: iSetupCfg — The BIOS route was never needed, but the research into it was done before the fix landed and it is worth keeping. The setup notes did not find "Thunderbolt pre-boot", "PCIe tunneling", Above 4G Decoding or Resizable BAR controls on this firmware. — https://llms-explorer.com/blog/thunderbolt-egpu-rtx-5080-linux-nuc/#bios-cli-isetupcfg

## A topical llms file from a pool of facts
<https://llms-explorer.com/blog/topical-llms-from-a-fact-pool/>

- [snippet] Commands: PYTHONPATH=scripts .venv/bin/python -m docset_refine topical \ — `# cwd: ~/.global-ai-hub` — https://llms-explorer.com/blog/topical-llms-from-a-fact-pool/#commands
- [parameter] `llms.txt`: Bytes=6,144; Tokens=1,523 — https://llms-explorer.com/blog/topical-llms-from-a-fact-pool/#outputs
- [parameter] `llms-facts.txt`: Bytes=74,210; Tokens=18,271 — https://llms-explorer.com/blog/topical-llms-from-a-fact-pool/#outputs
- [parameter] `llms-vocabulary.txt`: Bytes=10,313; Tokens=2,532 — https://llms-explorer.com/blog/topical-llms-from-a-fact-pool/#outputs
- [parameter] keyword match on section name / aliases: 30 — https://llms-explorer.com/blog/topical-llms-from-a-fact-pool/#outputs
- [parameter] file affinity (the spoke the fact came from): 122 — https://llms-explorer.com/blog/topical-llms-from-a-fact-pool/#outputs
- [parameter] embedding nearest-centroid: 9 — https://llms-explorer.com/blog/topical-llms-from-a-fact-pool/#outputs
- [parameter] `## Shared`: 7 — https://llms-explorer.com/blog/topical-llms-from-a-fact-pool/#outputs
- [definition] A topical llms file from a pool of facts — The August topical llms.txt pilot: keyword and file-affinity scoring, optional embeddings, assignment counts, and unresolved historical evidence. — https://llms-explorer.com/blog/topical-llms-from-a-fact-pool/#a-topical-llms-file-from-a-pool-of-facts

## V2 vs V1
<https://llms-explorer.com/blog/v2-vs-v1/>

- [parameter] Required elements: v1=H1 + blockquote + sections implied; v2 (2026-08-10)=**H1 only** is required; blockquote, prose and sections are optional; Effect on an existing file=none is invalidated; the lint still scores a missing blockquote as Medium (I2) — a quality finding, not a validity one — https://llms-explorer.com/blog/v2-vs-v1/#the-spec-v1-v2
- [parameter] Placement: v1=`/llms.txt` at the site root; v2 (2026-08-10)=root **or any subpath** (`/docs/llms.txt`); a file covers the URLs under its path; where several apply, **the most specific wins**; Effect on an existing file=enables families and split roots (`<section>/llms.txt`) — https://llms-explorer.com/blog/v2-vs-v1/#the-spec-v1-v2
- [parameter] Discovery: v1=none; v2 (2026-08-10)=`rel="describedby"` links to the index; `rel="alternate" type="text/markdown"` identifies a twin; Effect on an existing file=add discovery links through HTML or HTTP headers as applicable (see the [serving reference](/reference/usage/#1-serving)) — https://llms-explorer.com/blog/v2-vs-v1/#the-spec-v1-v2
- [parameter] Markdown twins: v1=`page.html.md`; v2 (2026-08-10)=`page.html.md` **or** `page.md`; directories append `index.html.md` or `index.md`; Effect on an existing file=either form passes the twin probe — https://llms-explorer.com/blog/v2-vs-v1/#the-spec-v1-v2
- [parameter] `## Optional`: v1=mechanical: "can be skipped if a shorter context is needed", consumed by `llms_txt2ctx`; v2 (2026-08-10)=a **convention** for secondary information; `llms_txt2ctx` and its context-expansion mechanics are no longer part of the proposal; Effect on an existing file=keep it last; build nothing that depends on it — https://llms-explorer.com/blog/v2-vs-v1/#the-spec-v1-v2
- [parameter] BOM: v1=—; v2 (2026-08-10)=an optional BOM is tolerated; Effect on an existing file=the lint strips it as hygiene (P14) — https://llms-explorer.com/blog/v2-vs-v1/#the-spec-v1-v2
- [parameter] Consumption expectation: v1=expand the file into context; v2 (2026-08-10)="view or search the index, then follow the relevant links"; the index stays small; detail lives behind links; Effect on an existing file=the size ladder (small / full) becomes the producer's job — https://llms-explorer.com/blog/v2-vs-v1/#the-spec-v1-v2
- [parameter] `/.well-known/`: v1=—; v2 (2026-08-10)=explicitly rejected: well-known URIs exist only at the origin root, which defeats subpath scoping; Effect on an existing file=serve at the root or the subpath, not under `.well-known` — https://llms-explorer.com/blog/v2-vs-v1/#the-spec-v1-v2
- [parameter] Acquire: V1 (to 2026-08-29)=trafilatura BFS crawl → banner mirror; V2 (from 2026-08-30)=`llms_acquire.py` tries the site’s `llms-full.txt`, then its `llms.txt` and absolute HTTP(S) links fetched once as text; if neither yields pages, the caller owns the crawl fallback. The banner mirror stays the internal format — https://llms-explorer.com/blog/v2-vs-v1/#the-pipeline-v1-v2
- [parameter] Clean: V1 (to 2026-08-29)=none (raw HTML → text); V2 (from 2026-08-30)=`docset_refine clean`: boilerplate lines, MDX → markdown, page classes (reference / guide / changelog / marketing / index) — https://llms-explorer.com/blog/v2-vs-v1/#the-pipeline-v1-v2
- [parameter] Extract: V1 (to 2026-08-29)=`distill_offline.py bulk` — zero-LLM, output never consumed; V2 (from 2026-08-30)=`extract` (code snippets, table rows → `parameter`, definitions, changelog `change` units; anchors to real source headings) + `units` (local LLM under the evidence rule) + `polish` (Claude) — https://llms-explorer.com/blog/v2-vs-v1/#the-pipeline-v1-v2
- [parameter] Export: V1 (to 2026-08-29)=none; V2 (from 2026-08-30)=`export_llms`: index (split above 10 KB) / full (Mintlify grammar) / small (≤ ~50k tokens) / facts / `manifest.json`; `topical`; `vocabulary` — https://llms-explorer.com/blog/v2-vs-v1/#the-pipeline-v1-v2
- [parameter] Index: V1 (to 2026-08-29)=one raw vector layer (`nomic-embed-text` in `hub.db` for files; `mxbai-embed-large` for docsets); V2 (from 2026-08-30)=raw **and** facts vector layers, plus an FTS5 keyword layer beside each (`docset_indexer keyword-index`) — https://llms-explorer.com/blog/v2-vs-v1/#the-pipeline-v1-v2
- [parameter] Serve: V1 (to 2026-08-29)=`web-text-mirror --serve` (HTML); V2 (from 2026-08-30)=`llms_serve.py`: `/llms.txt`, `/d/<stem>/…` (with sections), `/m/<key>/…`, `/t/<slug>/…`, markdown headers on every response — https://llms-explorer.com/blog/v2-vs-v1/#the-pipeline-v1-v2
- [parameter] Gate: V1 (to 2026-08-29)=none; V2 (from 2026-08-30)=`llms_lint.py` (the deterministic passes P0–P3, P5–P7, P9, P14) inside `docset_rollout cleanup`; `/ldo` for the model, live and family passes — https://llms-explorer.com/blog/v2-vs-v1/#the-pipeline-v1-v2
- [parameter] Artifacts: V1 (to 2026-08-29)=`<stem>.pages/`, `_master.md`, `._distill_index.json`; V2 (from 2026-08-30)=`<stem>.reference/{pages.json, structured.jsonl, units.jsonl, all_units.jsonl}` and `<stem>.llms/` — https://llms-explorer.com/blog/v2-vs-v1/#the-pipeline-v1-v2
- [parameter] v1 file at root: Claude Code (`WebFetch` / hub MCP)=works; Cursor=works; generic MCP client=works; `llms_acquire`=works; lint=works (I2 Medium if no blockquote); Lighthouse agentic audit=works — https://llms-explorer.com/blog/v2-vs-v1/#compatibility-matrix
- [parameter] v2 file at root: Claude Code (`WebFetch` / hub MCP)=works; Cursor=works; generic MCP client=works; `llms_acquire`=works; lint=works; Lighthouse agentic audit=works — https://llms-explorer.com/blog/v2-vs-v1/#compatibility-matrix
- [parameter] v2 file at a subpath only: Claude Code (`WebFetch` / hub MCP)=works if given the URL; Cursor=degraded — no root discovery; generic MCP client=works if given the URL; `llms_acquire`=works — the ladder probes the given path; lint=works; Lighthouse agentic audit=degraded — expects the root — https://llms-explorer.com/blog/v2-vs-v1/#compatibility-matrix
- [parameter] split root (`## Sections`): Claude Code (`WebFetch` / hub MCP)=works — follows section links; Cursor=works — one extra hop; generic MCP client=works; `llms_acquire`=degraded — no index recursion; relative targets are skipped; lint=works — `check DIR` walks sections; Lighthouse agentic audit=works — https://llms-explorer.com/blog/v2-vs-v1/#compatibility-matrix
- [parameter] family file (links only indexes): Claude Code (`WebFetch` / hub MCP)=works; Cursor=works; generic MCP client=works; `llms_acquire`=degraded — absolute targets become page text; no recursion; lint=works (F1 requires index targets); Lighthouse agentic audit=not evaluated — https://llms-explorer.com/blog/v2-vs-v1/#compatibility-matrix
- [parameter] `llms-full.txt`, Mintlify grammar: Claude Code (`WebFetch` / hub MCP)=works via `hub_llms_full_read(page=…)`; Cursor=degraded for large files (the reported ~50k threshold is unverified); generic MCP client=works; `llms_acquire`=works — `split_llms_full` parses page blocks; lint=works; Lighthouse agentic audit=not evaluated — https://llms-explorer.com/blog/v2-vs-v1/#compatibility-matrix
- [parameter] `llms-full.txt`, YAML-block or Cloudflare frontmatter grammar: Claude Code (`WebFetch` / hub MCP)=works; Cursor=large-file behavior unverified; generic MCP client=works; `llms_acquire`=works — splitter recognizes YAML/body structures; lint=works; Lighthouse agentic audit=not evaluated — https://llms-explorer.com/blog/v2-vs-v1/#compatibility-matrix
- [parameter] `llms-full.txt` served **as** `llms.txt`: Claude Code (`WebFetch` / hub MCP)=degraded — the index is unreadable at that size; Cursor=breaks; generic MCP client=degraded; `llms_acquire`=degraded — the index path does not detect and split a full file; lint=**High** (I6); Lighthouse agentic audit=breaks — https://llms-explorer.com/blog/v2-vs-v1/#compatibility-matrix
- [parameter] no `.md` twins: Claude Code (`WebFetch` / hub MCP)=works — fetches HTML; Cursor=works; generic MCP client=works; `llms_acquire`=degraded for HTML-only targets — no `Accept` probe; caller owns crawl; lint=High (N6, with `--check-links`); Lighthouse agentic audit=degraded — https://llms-explorer.com/blog/v2-vs-v1/#compatibility-matrix
- [parameter] no `Link` headers: Claude Code (`WebFetch` / hub MCP)=works; Cursor=works; generic MCP client=works; `llms_acquire`=works; lint=Low (H3); Lighthouse agentic audit=degraded — https://llms-explorer.com/blog/v2-vs-v1/#compatibility-matrix
- [definition] V2 vs V1 — Compare the llms.txt proposal’s August 2026 v2 changes with the hub pipeline’s V2 artifacts, migration steps, and limits of the compatibility assessment. — https://llms-explorer.com/blog/v2-vs-v1/#v2-vs-v1
- [definition] The spec: v1 → v2 — The spec's structure did not change: an optional BOM, an H1, a blockquote, free markdown without headings, then H2 sections holding `- [name](url): notes` lines. What changed is which parts are required, where the file may live, and how a consumer is expected to use it. — https://llms-explorer.com/blog/v2-vs-v1/#the-spec-v1-v2
- [definition] The pipeline: V1 → V2 — The hub's V1 pipeline produced site dumps. It crawled with trafilatura, wrote one banner mirror per site, distilled that mirror with a zero-LLM bulk pass, and indexed the raw text in one vector layer. — https://llms-explorer.com/blog/v2-vs-v1/#the-pipeline-v1-v2
- [definition] Migration — For a **publisher** with a v1 file: 1. From this repository, run `python3 hub/scripts/llms_lint.py check <file> --check-links`. — https://llms-explorer.com/blog/v2-vs-v1/#migration
- [definition] Compatibility matrix — Rows are producer choices; columns are consumers. This is a 2026-08-30 compatibility assessment. — https://llms-explorer.com/blog/v2-vs-v1/#compatibility-matrix
- [definition] What breaks — Honest list of what does not survive the two transitions. — https://llms-explorer.com/blog/v2-vs-v1/#what-breaks

## The vocabulary file
<https://llms-explorer.com/blog/vocabulary/>

- [snippet] The line grammar: > <n> terms of <family>; canonical name, definition, how it differs (not:), what people say instead (aka:). Each line an — `# <Family> — vocabulary` — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [snippet] The line grammar: - **llms-small.txt** [llms.small] (noun): the budgeted variant of a full file — reference-class pages first, within abou — `- **llms-small.txt** [llms.small] (noun): the budgeted variant of a full file — reference-class page` — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [snippet] The line grammar: - **llms-small.txt** — llms-small.txt is a small variant of a tokenized text file used to enforce size budgets on the pr — `- **llms-small.txt** — llms-small.txt is a small variant of a tokenized text file used to enforce si` — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [snippet] Build one: PYTHONPATH=scripts .venv/bin/python -m docset_refine vocabulary \ — `PYTHONPATH=scripts .venv/bin/python -m docset_refine vocabulary \` — https://llms-explorer.com/blog/vocabulary/#build-one
- [parameter] `**term**`: required=yes; comes from=tree node or canonical token; rule=one line per term per sense — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [parameter] `[sense-id]`: required=in a multi-family file; comes from=`<family-slug>.<term-slug>`; rule=disambiguates the pair (term × family) — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [parameter] `(pos)`: required=no; comes from=part of speech; rule=noun unless stated — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [parameter] `definition`: required=for a `## Terms` line; comes from=a kept unit; rule=extractive by default; model definitions are labeled and need review — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [parameter] `— url#anchor`: required=with a definition; comes from=the unit's source; rule=checked against raw-mirror headings when a mirror is supplied (P7) — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [parameter] `aka:`: required=no; comes from=surface forms in the pool; rule=source-backed; FTS5 expansion is designed, not shipped — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [parameter] `not:` … `— how`: required=no; comes from=contrast cues; rule=the neighbour and one clause on the difference — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [parameter] `ant:`: required=no; comes from=explicit antonyms; rule=proposed extension — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [parameter] `broader:` / `narrower:` / `related:`: required=no; comes from=the abstractor's relation taxonomy; rule=proposed extension — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [parameter] `measure:`: required=no; comes from=the unit a quantity is stated in; rule=proposed extension — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [parameter] `field:`: required=no; comes from=the family slug; rule=redundant with the sense id; kept for grep — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [parameter] `verified-as-of:`: required=no; comes from=an actual re-fetch; rule=a date bump without a fetch is not evidence — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [parameter] **assignment** — the topical builder's keyword pass: what it takes=`aka:` lists, merged into the concept-tree node's `aliases` by `--register` (add-only); what changes=a fact that says "session cookie" is filed under the node named "cookie" instead of falling to `## Shared` — https://llms-explorer.com/blog/vocabulary/#where-it-feeds
- [parameter] **keyword** — the FTS5 layer: what it takes=`aka:` surfaces of a matched term, OR-ed into the query (**designed**: an `expand` flag on `hub_query_docset`, which today takes only `docset, question, top, layer, mode`); what changes=an exact-token search for `X-Markdown-Tokens` would also find lines that wrote "the tokens header" — https://llms-explorer.com/blog/vocabulary/#where-it-feeds
- [parameter] **descriptions** — proposed index-exporter input: what it takes=the canonical definition; what changes=a link description could reuse a reviewed definition; current export code does not read the vocabulary — https://llms-explorer.com/blog/vocabulary/#where-it-feeds
- [definition] The vocabulary file — How llms-vocabulary.txt defines family terms, labels model-written definitions and supports aliases, with a clear boundary between shipped behavior and proposed senses. — https://llms-explorer.com/blog/vocabulary/#the-vocabulary-file
- [definition] What a vocabulary file is — `llms-vocabulary.txt` is one line per term of a family, each line carrying: the canonical name, an extractive definition or a labeled model-written definition grounded in kept units, the neighbours it is easy to confuse it with (`not:`) and how it differs, the words people say instead (`aka:`)… — https://llms-explorer.com/blog/vocabulary/#what-a-vocabulary-file-is
- [definition] The line grammar — The target grammar, including fields the current builder does not emit: — https://llms-explorer.com/blog/vocabulary/#the-line-grammar
- [definition] Senses across fields — In the proposed multi-family format, a sense id is `<family-slug>.<term-slug>`. A term is disambiguated by the pair (term × family): *cookie* in the `web` family is `web.cookie`, in a folklore family `folklore.cookie-monster`, in a recipe family `food.cookie`. — https://llms-explorer.com/blog/vocabulary/#senses-across-fields
- [definition] Where it feeds — The vocabulary was built because three consumers were weak without it: — https://llms-explorer.com/blog/vocabulary/#where-it-feeds
- [definition] Build one — Run the commands below from `~/.global-ai-hub`, with its environment and source pool present. The walkthrough builds the llms.txt family's own vocabulary — the terms are *index, full, small, facts, twin, describedby, family, split root, unit, anchor* and their neighbours. — https://llms-explorer.com/blog/vocabulary/#build-one

## What Good Docs, llms Files and Indexes Actually Save: 256 Agent Runs
<https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/>

- [snippet] Reproduce: python3 build_sandboxes.py        # corpora in sbx/, run copies at neutral paths w/v1..v4/<repo> — `python3 build_sandboxes.py        # corpora in sbx/, run copies at neutral paths w/v1..v4/<repo>` — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#reproduce
- [parameter] [llm-cache-proxy](https://github.com/mithudso/llm-cache-proxy): Language=JavaScript; Code + tests=119 KB; Human docs=90 KB; llms files=86 KB — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#setup
- [parameter] [llm-memory-pyramid](https://github.com/mithudso/llm-memory-pyramid): Language=Python; Code + tests=194 KB; Human docs=108 KB; llms files=35 KB — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#setup
- [parameter] **A**: On disk=code; Also in context=—; Tools=Read, Grep, Glob — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#setup
- [parameter] **B**: On disk=code + docs; Also in context=—; Tools=Read, Grep, Glob — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#setup
- [parameter] **C**: On disk=code + docs + llms files; Also in context=—; Tools=Read, Grep, Glob — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#setup
- [parameter] **D**: On disk=code + docs; Also in context=—; Tools=+ keyword and semantic search — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#setup
- [parameter] **E**: On disk=code; Also in context=—; Tools=+ keyword and semantic search — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#setup
- [parameter] **G**: On disk=code + docs; Also in context=the repo's `CLAUDE.md`; Tools=Read, Grep, Glob — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#setup
- [parameter] **H**: On disk=code + docs; Also in context=the repo's `CLAUDE.md`; Tools=+ keyword and semantic search — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#setup
- [parameter] **I**: On disk=code + docs + llms files; Also in context=`CLAUDE.md` with the llms pointer; Tools=Read, Grep, Glob — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#setup
- [parameter] A: Setup=code only; Correct=24/24; Mean cost=$0.0293; vs A=—; 95% CI=—; Turns=3.5 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] B: Setup=docs on disk; Correct=24/24; Mean cost=$0.0278; vs A=−5%; 95% CI=−19% to +12%; Turns=4.0 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] C: Setup=docs + llms on disk; Correct=23/24; Mean cost=$0.0326; vs A=+11%; 95% CI=−19% to +55%; Turns=3.9 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] D: Setup=docs on disk + index; Correct=24/24; Mean cost=$0.0321; vs A=+10%; 95% CI=−15% to +43%; Turns=4.0 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] E: Setup=code + index; Correct=24/24; Mean cost=$0.0280; vs A=−4%; 95% CI=−20% to +15%; Turns=3.8 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] **G**: Setup=**docs + CLAUDE.md**; Correct=24/24; Mean cost=**$0.0163**; vs A=**−44%**; 95% CI=−53% to −35%; Turns=2.5 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] **H**: Setup=**docs + CLAUDE.md + index**; Correct=24/24; Mean cost=**$0.0186**; vs A=**−36%**; 95% CI=−55% to −13%; Turns=2.5 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] **I**: Setup=**llms + CLAUDE.md pointer**; Correct=24/24; Mean cost=**$0.0185**; vs A=**−37%**; 95% CI=−51% to −18%; Turns=2.6 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] A: Setup=code only; Correct=8/8; Mean cost=$0.0758; vs A=—; 95% CI=—; Turns=6.4 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] B: Setup=docs on disk; Correct=8/8; Mean cost=$0.0620; vs A=−18%; 95% CI=−31% to −4%; Turns=3.6 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] C: Setup=docs + llms on disk; Correct=8/8; Mean cost=$0.0714; vs A=−6%; 95% CI=−30% to +33%; Turns=4.9 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] D: Setup=docs on disk + index; Correct=7/8; Mean cost=$0.0632; vs A=−17%; 95% CI=−33% to +12%; Turns=4.4 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] E: Setup=code + index; Correct=6/8; Mean cost=$0.0716; vs A=−6%; 95% CI=−27% to +4%; Turns=5.5 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] **G**: Setup=**docs + CLAUDE.md**; Correct=8/8; Mean cost=**$0.0482**; vs A=**−36%**; 95% CI=−55% to −13%; Turns=5.1 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] **H**: Setup=**docs + CLAUDE.md + index**; Correct=8/8; Mean cost=**$0.0502**; vs A=**−34%**; 95% CI=−44% to −16%; Turns=4.9 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] **I**: Setup=**llms + CLAUDE.md pointer**; Correct=8/8; Mean cost=**$0.0423**; vs A=**−44%**; 95% CI=−59% to −19%; Turns=4.6 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [parameter] Lookup A: Setup=code only; Mean cost=$0.0293; Cache writes=60%; Cache reads=20%; Output=20%; Total tokens=33,704 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-2-tokens-are-the-wrong-unit
- [parameter] Lookup G: Setup=docs + CLAUDE.md; Mean cost=$0.0163; Cache writes=41%; Cache reads=33%; Output=26%; Total tokens=28,793 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-2-tokens-are-the-wrong-unit
- [parameter] Comprehension A: Setup=code only; Mean cost=$0.0758; Cache writes=63%; Cache reads=13%; Output=24%; Total tokens=63,474 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-2-tokens-are-the-wrong-unit
- [parameter] Comprehension B: Setup=docs on disk; Mean cost=$0.0620; Cache writes=76%; Cache reads=9%; Output=15%; Total tokens=40,000 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-2-tokens-are-the-wrong-unit
- [parameter] Comprehension G: Setup=docs + CLAUDE.md; Mean cost=$0.0482; Cache writes=52%; Cache reads=22%; Output=26%; Total tokens=60,454 — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-2-tokens-are-the-wrong-unit
- [parameter] BM25 keyword (question text as the query): Code only=6/12; Code + docs=7/12; Build time per corpus=— — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-4-indexes-did-not-pay-on-small-repos
- [parameter] `nomic-embed-text`: Code only=9/12; Code + docs=8/12; Build time per corpus=1–2 s — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-4-indexes-did-not-pay-on-small-repos
- [parameter] `mxbai-embed-large`: Code only=10/12; Code + docs=9/12; Build time per corpus=3–17 s — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-4-indexes-did-not-pay-on-small-repos
- [parameter] `qwen3-embedding:4b`: Code only=8/12; Code + docs=10/12; Build time per corpus=20–32 s — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-4-indexes-did-not-pay-on-small-repos
- [parameter] `llms.txt` + `llms-small.txt`, from code and docs: llm-cache-proxy=$0.31 (16 turns); llm-memory-pyramid=$0.24 (18 turns) — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#what-the-assets-cost-and-when-they-pay-back
- [parameter] README + configuration reference, from code alone: llm-cache-proxy=$0.48 (23 turns); llm-memory-pyramid=$0.65 (32 turns) — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#what-the-assets-cost-and-when-they-pay-back
- [parameter] Keyword + semantic index: llm-cache-proxy=$0 in API tokens, 3–17 s locally; llm-memory-pyramid=$0 in API tokens, 3–4 s — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#what-the-assets-cost-and-when-they-pay-back
- [definition] What Good Docs, llms Files and Indexes Actually Save: 256 Agent Runs — In 256 runs on two small repos, loaded docs reduced lookup cost; llms files and indexes showed no measurable savings, with limits on model and interval reproducibility. — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#what-good-docs-llms-files-and-indexes-actually-save-256-agent-runs
- [definition] Why "true" savings needs a measurement — Most claims about docs and llms files compare file sizes. My own [inventory post](/blog/every-token-saving-strategy/) reports that `llms-small.txt` runs 13–97× smaller than `llms-full.txt`, and that retrieval answered a docset question in about 1,500 tokens instead of 248,761. — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#why-true-savings-needs-a-measurement
- [definition] Setup — **Repositories.** Two of my public repos, chosen because both have unusually thorough docs and a generated llms family: — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#setup
- [definition] Result 1: documentation pays most when it is in context — **Lookup questions** (12 questions × 2 runs = 24 per condition): — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-1-documentation-pays-most-when-it-is-in-context
- [definition] Result 2: tokens are the wrong unit — Where the money went, per question, by token type: — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-2-tokens-are-the-wrong-unit
- [definition] Result 3: these agents did not read llms files — Across all 256 runs, an agent opened a file named `llms*` **once**. That single read was in condition I, where `CLAUDE.md` said to start with `llms-small.txt`; the other 31 runs in I ignored the instruction and went to `grep`. — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-3-these-agents-did-not-read-llms-files
- [definition] Result 4: indexes did not pay on small repos — Before the agent runs, I measured retrieval quality on its own. For each of the 12 lookup questions, **hit@5** asks whether the top five results include a chunk containing the answer: — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#result-4-indexes-did-not-pay-on-small-repos
- [definition] What the assets cost, and when they pay back — I measured creation cost the same way: an isolated session with write access, asked to produce each asset. — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#what-the-assets-cost-and-when-they-pay-back
- [definition] How the measurement nearly lied — Three problems in the harness each changed the answer, and I found them only by reading individual runs. — https://llms-explorer.com/blog/what-docs-llms-files-and-indexes-actually-save/#how-the-measurement-nearly-lied

## About LLMSX
<https://llms-explorer.com/about/>

- [definition] About LLMSX — Who maintains LLMSX, who it serves, what the guides and tools offer, and how to report a correction or get in touch. — https://llms-explorer.com/about/#about-llmsx
- [definition] Contact and corrections — Email mitchphudson@gmail.com for private project, account or privacy questions. Public corrections belong in [repository issues](https://github.com/mithudso/llms-explorer/issues) with the page URL, disputed claim and supporting evidence. — https://llms-explorer.com/about/#contact-and-corrections

## Your account
<https://llms-explorer.com/account/>

- [definition] Your account — Who you are signed in as, which plan you are on, and the sign-in methods and private tree forks attached to the account — all fetched in the browser. — https://llms-explorer.com/account/#your-account
- [definition] What the account holds — Three things the public site has no place for: the plan and its quotas, the API keys that authenticate the hosted MCP endpoint, and the private tree forks whose changes are proposed back rather than published. Deleting the account revokes every key with it. — https://llms-explorer.com/account/#what-the-account-holds

## Context files
<https://llms-explorer.com/context/>

- [definition] Context files — Every concept facts file, filed under the roots of the concept tree — each one a plain markdown fetch. — https://llms-explorer.com/context/#context-files

## Contribute a subject
<https://llms-explorer.com/contribute/>

- [definition] Contribute a subject — Submit a new concept to the concept tree: a subject name, optional parent, and your text, run through a research pass and routed to moderators. — https://llms-explorer.com/contribute/#contribute-a-subject
- [definition] The process — Sign in, provide a subject name and content (or upload a file), and submit. A research pass generates an initial summary and fact sheet. — https://llms-explorer.com/contribute/#the-process

## Semantic indexing, recorded
<https://llms-explorer.com/demo/>

- [definition] Semantic indexing, recorded — One question set run three ways against one indexed docset — keyword (BM25), vector, and the fusion of both — hits and timings as recorded. — https://llms-explorer.com/demo/#semantic-indexing-recorded

## Donate
<https://llms-explorer.com/donate/>

- [definition] Donate — LLMS-Explorer is free — reading, the tree, every served llms file, no account needed — a one-time or monthly donation keeps it running. — https://llms-explorer.com/donate/#donate
- [definition] What happens after paying — A one-time donation is done. A monthly one can be managed or cancelled from the Stripe Customer Portal, reachable from your account once you've made one. — https://llms-explorer.com/donate/#what-happens-after-paying

## Downloads
<https://llms-explorer.com/downloads/>

- [definition] Downloads — Install Skills Explorer, GitHub Explorer and llmsx; download agent skills, context and facts files. — https://llms-explorer.com/downloads/#downloads
- [definition] GitHub Explorer — A separate MIT terminal workbench for macOS and Linux. Browse repository files, edit with embedded Vim, inspect branch/change/PR status, edit repository settings, and preview Git/GitHub commands before execution. — https://llms-explorer.com/downloads/#github-explorer
- [definition] Skills Explorer — Skills Explorer is a local terminal workbench for installed agent skills. Browse multiple harness roots, edit with backups, inspect metadata, follow references and launch installed optimizer and evaluation workflows. — https://llms-explorer.com/downloads/#skills-explorer
- [definition] More downloads — Install the agent skills with `npx skills add`, download the llmsx Python package with its concept-tree explorer, or install llmsx-skills from source for JavaScript. Context and concept facts files are listed at /context.md. — https://llms-explorer.com/downloads/#more-downloads

## Sources & editorial standards
<https://llms-explorer.com/editorial/>

- [definition] Sources & editorial standards — How to distinguish original experiments, implementation reports, agent-assisted concept references on LLMSX. — https://llms-explorer.com/editorial/#sources-editorial-standards

## LLMSX Explorer User Guide
<https://llms-explorer.com/explorer/guide/>

- [snippet] 1. Install and launch: python -m pip install 'llmsx[tui]'        # or the wheel from https://llms-explorer.com/downloads/#llmsx — `python -m pip install 'llmsx[tui]'        # or the wheel from https://llms-explorer.com/downloads/#l` — https://llms-explorer.com/explorer/guide/#1-install-and-launch
- [snippet] 2. The screen: ┌ filter / search ──────────┐ ┌ quick-action buttons ─────────────────────────┐ — `┌ filter / search ──────────┐ ┌ quick-action buttons ─────────────────────────┐` — https://llms-explorer.com/explorer/guide/#2-the-screen
- [snippet] 6. The scratchpad: - https://www.mongodb.com/docs/manual/indexes/ — Indexing · /Users/you/.global-ai-hub/llms-concepts/indexing.llms/llms.t — `- https://www.mongodb.com/docs/manual/indexes/ — Indexing · /Users/you/.global-ai-hub/llms-concepts/` — https://llms-explorer.com/explorer/guide/#6-the-scratchpad
- [parameter] `--repo PATH`: Open this checkout instead of searching. — https://llms-explorer.com/explorer/guide/#1-install-and-launch
- [parameter] `--no-sync`: Skip the `git pull --ff-only` on start. — https://llms-explorer.com/explorer/guide/#1-install-and-launch
- [parameter] `--guide`: Print this guide and exit. — https://llms-explorer.com/explorer/guide/#1-install-and-launch
- [parameter] `↑` `↓`: In the outline, move the cursor. Elsewhere, move focus to the widget directly above or below. — https://llms-explorer.com/explorer/guide/#3-moving-around
- [parameter] `→` `←`: Expand or collapse the concept under the cursor. `→` on an open or leaf node moves focus to the tabs; `←` on a root moves focus to the filter. — https://llms-explorer.com/explorer/guide/#3-moving-around
- [parameter] `/`: Focus the filter box. Typing filters the outline by name and alias. — https://llms-explorer.com/explorer/guide/#3-moving-around
- [parameter] `⌘F` or `ctrl+f`: Search: type, press Enter to jump to the first match, Enter again for the next. — https://llms-explorer.com/explorer/guide/#3-moving-around
- [parameter] `[` `]`: Previous or next detail tab. — https://llms-explorer.com/explorer/guide/#3-moving-around
- [parameter] `T`: Cycle the outline filter: all, frontier, researched, tagged. — https://llms-explorer.com/explorer/guide/#3-moving-around
- [parameter] `r`: Reload the tree and local state from disk. — https://llms-explorer.com/explorer/guide/#3-moving-around
- [parameter] `Tab` / `shift+Tab`: Move focus in reading order. — https://llms-explorer.com/explorer/guide/#3-moving-around
- [parameter] `q`: Quit. — https://llms-explorer.com/explorer/guide/#3-moving-around
- [parameter] **Overview**: Summary, parent, children, skill, mark, tags, linked concepts (clickable), highlights and your local notes. — https://llms-explorer.com/explorer/guide/#4-reading-a-concept
- [parameter] **Facts**: The concept pack: a one-line header (slug, parent, research date, sources, skill, mark, tags), the summary, and each facet's facts with a source link. — https://llms-explorer.com/explorer/guide/#4-reading-a-concept
- [parameter] **Skill**: The concept's `SKILL.md` or reference file, when it names a skill. — https://llms-explorer.com/explorer/guide/#4-reading-a-concept
- [parameter] **ref: …**: One tab per reference file of that skill. — https://llms-explorer.com/explorer/guide/#4-reading-a-concept
- [parameter] **Highlights**: Snippets you saved for this concept with `h`. — https://llms-explorer.com/explorer/guide/#4-reading-a-concept
- [parameter] **llms.txt, llms-full.txt, llms-small.txt, llms-facts.txt, llms-vocabulary.txt**: The hub's llms family for the concept, from `~/.global-ai-hub/llms-concepts/<slug>.llms/` or `$LLMSX_CONCEPTS_PATH`. — https://llms-explorer.com/explorer/guide/#4-reading-a-concept
- [parameter] Title: Example=`# Indexing`; Colour=bold magenta — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] Section: Example=`## Facets`; Colour=bold cyan — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] Sub-section: Example=`### Notes`; Colour=bold blue — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] Summary quote: Example=`> An index is …`; Colour=italic green — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] List marker: Example=`- ` `1. `; Colour=bold yellow — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] Link name / URL: Example=`[Doc](https://…)`; Colour=bold / underlined blue — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] Bare URL: Example=`https://example.com`; Colour=underlined blue — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] Inline code: Example=`` `createIndex` ``; Colour=orange — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] Source and generator tags: Example=`[src: notes]` `[gen: p/1.1.0]`; Colour=dim cyan — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] Citation tail: Example=`— path/file.md:12 (as of 2026-10-01)`; Colour=dim — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] Date: Example=`2026-10-13`; Colour=green — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] Search-hit prefix: Example=`L123:`; Colour=dim — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] Warning words: Example=`STALE:` `Misbelief:` `TODO` `never` `must`; Colour=bold red — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] Labels: Example=`Note:` `Default:` `Optional` `Why:`; Colour=bold yellow — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] Rules and comments: Example=`---` `<!-- … -->`; Colour=dim — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [parameter] `m`: Does=Mark the concept `needs-review`.; Writes=`concept-tree/marks.json` — https://llms-explorer.com/explorer/guide/#7-marks-tags-links-and-notes
- [parameter] `f`: Does=Mark the concept `further-research`, pick a research mode, and add a queue row.; Writes=`marks.json`, `concept-tree/RESEARCH_QUEUE.md` — https://llms-explorer.com/explorer/guide/#7-marks-tags-links-and-notes
- [parameter] `x`: Does=Clear the mark (tags stay).; Writes=`marks.json` — https://llms-explorer.com/explorer/guide/#7-marks-tags-links-and-notes
- [parameter] `t`: Does=Edit the concept's tags (comma separated). Frontier concepts take tags too.; Writes=`marks.json` — https://llms-explorer.com/explorer/guide/#7-marks-tags-links-and-notes
- [parameter] `l`: Does=Link the concept to another concept; links appear in the Overview.; Writes=`relatedConcepts` in `tree.json` — https://llms-explorer.com/explorer/guide/#7-marks-tags-links-and-notes
- [parameter] `n`: Does=Edit your private notes for the concept; `ctrl+s` saves.; Writes=`~/.llmsx/notes/<slug>.md` — https://llms-explorer.com/explorer/guide/#7-marks-tags-links-and-notes
- [parameter] `h`: Does=Save a highlight (a quote plus an optional note).; Writes=`~/.llmsx/highlights.json` — https://llms-explorer.com/explorer/guide/#7-marks-tags-links-and-notes
- [parameter] `H`: Does=Open the highlights manager: Enter jumps to the concept, `c` copies, `d` deletes.; Writes=`highlights.json` — https://llms-explorer.com/explorer/guide/#7-marks-tags-links-and-notes
- [parameter] `N`: Does=Add a local root to the outline.; Writes=`~/.llmsx/local-tree.json` — https://llms-explorer.com/explorer/guide/#7-marks-tags-links-and-notes
- [parameter] `M`: Does=Move the concept under another node or a local root (local view only).; Writes=`~/.llmsx/local-tree.json` — https://llms-explorer.com/explorer/guide/#7-marks-tags-links-and-notes
- [parameter] **⚡ /dr**: Start deep research (`/dr`) on the selected concept now. — https://llms-explorer.com/explorer/guide/#9-research-jobs-and-the-queue
- [parameter] **+ Queue**: Add the concept to `RESEARCH_QUEUE.md` without running anything. — https://llms-explorer.com/explorer/guide/#9-research-jobs-and-the-queue
- [parameter] **🐇 Rabbithole**: Research the concept depth-first (`deep` mode). — https://llms-explorer.com/explorer/guide/#9-research-jobs-and-the-queue
- [parameter] **🧭 Family**: Map the concept's family with concept-family-explorer. — https://llms-explorer.com/explorer/guide/#9-research-jobs-and-the-queue
- [parameter] `R`: Open the research dialog: choose a mode (`dr`, `family`, `deep`, `crawl`, `full`, `queue`) and a provider. Enter submits. — https://llms-explorer.com/explorer/guide/#9-research-jobs-and-the-queue
- [parameter] **📚 Batch** / `ctrl+b`: Research several concepts in one run. — https://llms-explorer.com/explorer/guide/#9-research-jobs-and-the-queue
- [parameter] **🚀 Auto** / `a`: Autopilot: research frontier concepts one after another; when none remain, expand the most-used concept's family. Press again to stop. — https://llms-explorer.com/explorer/guide/#9-research-jobs-and-the-queue
- [parameter] `P`: Prefill the queue: group every frontier concept into clusters of up to 8 related concepts. — https://llms-explorer.com/explorer/guide/#9-research-jobs-and-the-queue
- [parameter] **📋 Queue** / `u`: Open the queue viewer. — https://llms-explorer.com/explorer/guide/#9-research-jobs-and-the-queue
- [parameter] `o`: Open the live job log. — https://llms-explorer.com/explorer/guide/#9-research-jobs-and-the-queue
- [parameter] `L`: **Library:** the site's directory of scored llms-full files, blog posts, skills, and your imports, each with a preview. `b` bundles the row's file; `d` removes an import. — https://llms-explorer.com/explorer/guide/#11-library-skills-imports-and-capture
- [parameter] `S`: **Skills:** run any supported skill on a target: /dr, rabbithole, concept-family-explorer, full-suite, /lca, crawl-to-llms-txt, crawl-repo-to-llms, notes-to-llms-txt, memory-to-llms-txt and the deep optimizers. — https://llms-explorer.com/explorer/guide/#11-library-skills-imports-and-capture
- [parameter] `I`: **Import:** copy an llms file from a local path or an https URL into `~/.llmsx/imports/`. — https://llms-explorer.com/explorer/guide/#11-library-skills-imports-and-capture
- [parameter] `G`: **Ledger:** the llms access-ledger report by file, kind, project or surface. — https://llms-explorer.com/explorer/guide/#11-library-skills-imports-and-capture
- [parameter] `W`: **Braindump:** free capture. `ctrl+s` saves the dump verbatim; `ctrl+p` parses it with the braindump skill. — https://llms-explorer.com/explorer/guide/#11-library-skills-imports-and-capture
- [parameter] `J`: **Journal:** dated entries. `ctrl+n` jumps to today; `ctrl+s` saves; `ctrl+p` turns the journal into an llms family. — https://llms-explorer.com/explorer/guide/#11-library-skills-imports-and-capture
- [parameter] `concept-tree/tree.json`: Holds=The concept tree.; Committed?=yes (by `c`) — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `concept-tree/marks.json`: Holds=Marks and tags.; Committed?=yes (by `c`) — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `concept-tree/RESEARCH_QUEUE.md`: Holds=The research queue.; Committed?=yes (by `c`) — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `~/.llmsx/scratchpad.md`: Holds=The scratchpad.; Committed?=no — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `~/.llmsx/notes/<slug>.md`: Holds=Notes per concept.; Committed?=no — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `~/.llmsx/highlights.json`: Holds=Highlights.; Committed?=no — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `~/.llmsx/config.json`: Holds=Settings and keys (`0600`).; Committed?=no — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `~/.llmsx/local-tree.json`: Holds=Local roots and moves.; Committed?=no — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `~/.llmsx/bundles/`, `exports/`, `imports/`: Holds=Bundles, exports, imported llms files.; Committed?=no — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `~/.llmsx/braindumps/`, `journal/`: Holds=Capture.; Committed?=no — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `~/.llmsx/flashcards.json`: Holds=Flashcard boxes.; Committed?=no — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `~/.llmsx/jobs/`: Holds=Raw job logs.; Committed?=no — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `~/.llmsx/explorer.log`: Holds=Warnings and errors.; Committed?=no — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `LLMSX_HOME`: Where local data lives. — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `LLMSX_CONCEPTS_PATH`: Where hub `.llms` directories live (default `~/.global-ai-hub/llms-concepts`). — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `LLMSX_GITHUB_TOKEN`: Token for push and `ls-remote`. — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `LLMSX_RESEARCH_TIMEOUT`: Seconds one job may run (default 3600). — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `EDITOR` / `VISUAL`: Editor for `e` and `E`. — https://llms-explorer.com/explorer/guide/#15-where-your-data-lives
- [parameter] `↑` `↓`: Action=move / focus above, below; Key=`→` `←`; Action=expand / collapse — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `/`: Action=filter; Key=`⌘F` `ctrl+f`; Action=search — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `[` `]`: Action=previous / next tab; Key=`T`; Action=cycle filter — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `r`: Action=reload; Key=`q`; Action=quit — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `y`: Action=save line to scratchpad; Key=`p`; Action=open scratchpad — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `m`: Action=mark needs-review; Key=`f`; Action=mark further-research — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `x`: Action=clear mark; Key=`U`; Action=mark every no-facts concept — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `t`: Action=tags; Key=`l`; Action=link — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `n`: Action=notes; Key=`e`; Action=open file in `$EDITOR` — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `E`: Action=edit node; Key=`h` / `H`; Action=highlight / highlights manager — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `R`: Action=research dialog; Key=`a`; Action=autopilot — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `ctrl+b`: Action=batch research; Key=`P`; Action=prefill queue clusters — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `u`: Action=queue viewer; Key=`o`; Action=job log — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `b` / `B`: Action=bundle toggle / bundle; Key=`X`; Action=export — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `L`: Action=library; Key=`S`; Action=skills — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `I`: Action=import; Key=`G`; Action=ledger — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `W`: Action=braindump; Key=`J`; Action=journal — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `F`: Action=flashcards; Key=`Q`; Action=quiz — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `N`: Action=new local root; Key=`M`; Action=move (local) — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `s`: Action=sync; Key=`c`; Action=commit and push — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `,`: Action=settings; Key=`?`; Action=key cheat sheet — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `g`: Action=this guide — https://llms-explorer.com/explorer/guide/#16-key-reference
- [parameter] `llmsx explorer needs Textual`: Install the extra: `python -m pip install 'llmsx[tui]'`. — https://llms-explorer.com/explorer/guide/#17-troubleshooting
- [parameter] `no concept tree at …`: `--repo` must point at a checkout that contains `concept-tree/tree.json`. — https://llms-explorer.com/explorer/guide/#17-troubleshooting
- [parameter] The llms tabs say `no .llms directory`: The hub's concept packs are not on this machine. Set `LLMSX_CONCEPTS_PATH`. — https://llms-explorer.com/explorer/guide/#17-troubleshooting
- [parameter] Research offers only `queue`: The provider's command-line tool is not on `PATH`. Install it or switch provider in Settings. — https://llms-explorer.com/explorer/guide/#17-troubleshooting
- [parameter] A research job fails with 401: A stored API key overrides a working login. Clear the key in Settings. — https://llms-explorer.com/explorer/guide/#17-troubleshooting
- [parameter] `c` refuses to push: Set a GitHub token in Settings or `LLMSX_GITHUB_TOKEN`; use **Test** in Settings. — https://llms-explorer.com/explorer/guide/#17-troubleshooting
- [parameter] A new button is not visible: The button row scrolls sideways; widen the window, or use the key (`y`, `p`). — https://llms-explorer.com/explorer/guide/#17-troubleshooting
- [parameter] Something failed silently: Read `~/.llmsx/explorer.log`. — https://llms-explorer.com/explorer/guide/#17-troubleshooting
- [definition] LLMSX Explorer User Guide — The complete guide to llmsx explorer: navigation, facts, the llms colour scheme, the scratchpad, marks, research jobs and every key. — https://llms-explorer.com/explorer/guide/#llmsx-explorer-user-guide
- [definition] 4. Reading a concept — Select a concept with the cursor or a click. The explorer opens its **facts** first: 1. — https://llms-explorer.com/explorer/guide/#4-reading-a-concept
- [definition] 5. The llms colour scheme — The llms tabs show the file one numbered line per row, coloured by the llms format, with a cursor you move with `↑` `↓` `PgUp` `PgDn`. — https://llms-explorer.com/explorer/guide/#5-the-llms-colour-scheme
- [definition] 6. The scratchpad — The scratchpad is one global notes file, `~/.llmsx/scratchpad.md`, shared by every concept. Use it to collect URLs and facts while you look things up, then turn the collection into a list. — https://llms-explorer.com/explorer/guide/#6-the-scratchpad
- [definition] 8. Finding unresearched concepts — A concept has **facts** when its concept pack holds at least one fact, or when its hub `.llms` directory holds `llms-facts.txt`. Many concepts in the tree have neither: the tree knows their family, but nobody has researched them. — https://llms-explorer.com/explorer/guide/#8-finding-unresearched-concepts
- [definition] 10. Providers and settings — Press `,` or click the **🤖 provider** button to open Settings. — https://llms-explorer.com/explorer/guide/#10-providers-and-settings
- [definition] 13. Bundles and exports — A **bundle** is a list of files to hand to an agent. — https://llms-explorer.com/explorer/guide/#13-bundles-and-exports

## LLMSX Explorer — The Dynamic Research Workbench
<https://llms-explorer.com/explorer/>

- [definition] LLMSX Explorer — The Dynamic Research Workbench — A terminal research workbench with a concept tree, job queue, highlights, flashcards and quizzes. — https://llms-explorer.com/explorer/#llmsx-explorer-the-dynamic-research-workbench

## This site's llms family
<https://llms-explorer.com/family/>

- [definition] This site's llms family — The five files an agent reads, what each one is for, and the index rendered as clickable links rather than the raw text/markdown a browser cannot follow. — https://llms-explorer.com/family/#this-sites-llms-family
- [definition] What is on it — A table of the five members and what each is for, the index fetched and rendered with its links clickable, and a note on the `.md` twin every content page publishes beside itself. — https://llms-explorer.com/family/#what-is-on-it

## API keys
<https://llms-explorer.com/keys/>

- [definition] API keys — Create, list and revoke the scoped keys that authenticate the hosted MCP endpoint; the plaintext is shown once, at creation, and stored only as a hash. — https://llms-explorer.com/keys/#api-keys
- [definition] Shown once, stored hashed — What the API keeps is a non-secret lookup prefix and an Argon2id hash of the rest, so a key can be listed and revoked forever but never displayed twice. Losing one means issuing another and revoking the old, not recovering it. — https://llms-explorer.com/keys/#shown-once-stored-hashed

## Sign in
<https://llms-explorer.com/login/>

- [definition] Sign in — Sign in with a passkey, GitHub or Google; the API sets an HttpOnly session cookie that the account, keys and usage pages send back on every call. — https://llms-explorer.com/login/#sign-in
- [definition] Why an account exists — Only the metered surfaces need one — your own docsets, the hosted MCP endpoint, and private forks of the concept tree. Every published page, including the whole llms family, stays readable and unmetered without it. — https://llms-explorer.com/login/#why-an-account-exists

## Website privacy
<https://llms-explorer.com/privacy/>

- [definition] Website privacy — How LLMSX website analytics, accounts, external links and local tools handle information, and where to send privacy requests. — https://llms-explorer.com/privacy/#website-privacy

## My proposals
<https://llms-explorer.com/proposals/>

- [definition] My proposals — View the contributions you've submitted to the LLMS-Explorer directory — their status, lint findings, and moderation decisions. — https://llms-explorer.com/proposals/#my-proposals
- [definition] Resubmitting — If a proposal needs changes, you can go back to /contribute/ and submit an improved version. Each submission is independent and gets its own review. — https://llms-explorer.com/proposals/#resubmitting

## braindump
<https://llms-explorer.com/skills/braindump/>

- [definition] braindump — Capture a stream of loose thoughts verbatim, then break it into categorised llms files an agent can load — ideas, facts, questions, decisions — with every task pushed to your to-do list and every row cited back to the raw line. — https://llms-explorer.com/skills/braindump/#braindump

## code-deep-optimizer
<https://llms-explorer.com/skills/code-deep-optimizer/>

- [definition] code-deep-optimizer — Multi-stage review-and-fix optimizer for a source file or whole repo: 18-pass audit, domain reviewer activation, Medium+ fixes applied in place, build/lint/test verification with regression back-out. — https://llms-explorer.com/skills/code-deep-optimizer/#code-deep-optimizer

## concept-family-explorer
<https://llms-explorer.com/skills/concept-family-explorer/>

- [parameter] Parent / super-domain: What broader field is this a specialization of? — https://llms-explorer.com/skills/concept-family-explorer/#the-five-neighborhoods
- [parameter] Siblings: What sits at the same level under the same parent? — https://llms-explorer.com/skills/concept-family-explorer/#the-five-neighborhoods
- [parameter] Children / sub-concepts: What does this decompose into? — https://llms-explorer.com/skills/concept-family-explorer/#the-five-neighborhoods
- [parameter] Adjacent / cross-over: What neighboring domains overlap or interface here? — https://llms-explorer.com/skills/concept-family-explorer/#the-five-neighborhoods
- [parameter] Frontier / emerging: What is new, contested, or rising in this space? — https://llms-explorer.com/skills/concept-family-explorer/#the-five-neighborhoods
- [definition] concept-family-explorer — Gap-discovery layer above /dr — maps a subject's full conceptual family (parent, siblings, children, adjacent fields, frontier), scores what's missing, and researches every worthwhile gap to saturation. — https://llms-explorer.com/skills/concept-family-explorer/#concept-family-explorer
- [definition] The five neighborhoods — Every subject gets decomposed into five neighborhoods before anything is scored: — https://llms-explorer.com/skills/concept-family-explorer/#the-five-neighborhoods
- [definition] Where it sits — Breadth, not depth: it maps everything *around* a subject and stops at one useful pass per neighbor. Its narrow inverse — going *inside* one concept instead of around it — is [rabbithole](/skills/rabbithole/). — https://llms-explorer.com/skills/concept-family-explorer/#where-it-sits

## crawl-customer-to-llms
<https://llms-explorer.com/skills/crawl-customer-to-llms/>

- [definition] crawl-customer-to-llms — Walks a customer engagement folder on a shared drive AND queries the enterprise search index for that customer's context files, artifact library, cases and tickets, then merges both halves into one deduped, provenance-tagged truth pack — resolving Google Drive stubs, which are dataless on disk… — https://llms-explorer.com/skills/crawl-customer-to-llms/#crawl-customer-to-llms

## crawl-repo-to-llms
<https://llms-explorer.com/skills/crawl-repo-to-llms/>

- [definition] crawl-repo-to-llms — Walks a repository and compiles the whole thing into an agent-loadable dossier: a per-file card, an importance ranking, condensed docs, the index inventory with embedding models and backends, the infrastructure map, the git history, and a full executable/command inventory statically read from… — https://llms-explorer.com/skills/crawl-repo-to-llms/#crawl-repo-to-llms

## crawl-to-llms-txt
<https://llms-explorer.com/skills/crawl-to-llms-txt/>

- [definition] crawl-to-llms-txt — Crawls a whole website/docset or walks a local repo and condenses everything referenceable — commands, config, how-tos, gotchas — into a provenance-tagged llms.txt family. — https://llms-explorer.com/skills/crawl-to-llms-txt/#crawl-to-llms-txt

## deep-optimizer
<https://llms-explorer.com/skills/deep-optimizer/>

- [definition] deep-optimizer — The convergence-loop optimizer family router: multi-pass audit-and-fix loops for code, prose, prompts, skills, SQL, designs, strategies, and llms files — each looping to zero Medium+ findings. — https://llms-explorer.com/skills/deep-optimizer/#deep-optimizer

## deep-query-optimizer
<https://llms-explorer.com/skills/deep-query-optimizer/>

- [definition] deep-query-optimizer — Multi-pass review-and-fix optimizer for SQL: dialect detection, sargability, index design, join/N+1 analysis, and EXPLAIN-verified rewrites that back out any regression. — https://llms-explorer.com/skills/deep-query-optimizer/#deep-query-optimizer

## deep-strategy-optimizer
<https://llms-explorer.com/skills/deep-strategy-optimizer/>

- [definition] deep-strategy-optimizer — Audit-and-fix convergence optimizer for trading strategies and their backtests: 19 passes over simulation integrity, statistical honesty, claim provenance, and economics — where 'no promotion' is the expected result. — https://llms-explorer.com/skills/deep-strategy-optimizer/#deep-strategy-optimizer

## design-deep-optimizer
<https://llms-explorer.com/skills/design-deep-optimizer/>

- [definition] design-deep-optimizer — Critique-and-fix optimizer for graphic, brand, and UI/UX work: an 11-pass critique (hierarchy, gestalt, typography, color, usability heuristics, WCAG, trust) with code-backed fixes verified by re-render and contrast checks. — https://llms-explorer.com/skills/design-deep-optimizer/#design-deep-optimizer

## devops-linux-internals
<https://llms-explorer.com/skills/devops-linux-internals/>

- [definition] devops-linux-internals — Linux kernel and OS-internals hub — boot/init, memory and NUMA, storage and filesystems, virtualization, io_uring, cgroups and namespaces, sandboxing, immutable distros, the Linux privilege model — plus the Thunderbolt eGPU family: diagnosing a GPU that has fallen off the bus, PCIe hotplug BAR and… — https://llms-explorer.com/skills/devops-linux-internals/#devops-linux-internals
- [definition] The eGPU family (added 2026-09-24) — Twenty-three source-cited references (twenty-one in this hub; the Blackwell sm_120 inference stack and the model load path are in `ai-llm-model-layer`) built from the `concept-family-explorer` → `/dr` loop after an RTX 5080 in a Razer Core X V2 spent a day reporting "fallen off the bus" on an… — https://llms-explorer.com/skills/devops-linux-internals/#the-egpu-family-added-2026-09-24
- [definition] Routing — Kernel, PCIe, driver, Thunderbolt and boot mechanics of a Linux eGPU live here. LLM serving, runtime choice, model picking, the Blackwell sm_120 inference stack and the model load path belong to `ai-llm-model-layer`; Mac eGPUs to `mac-egpu-compute`. — https://llms-explorer.com/skills/devops-linux-internals/#routing
- [definition] The rest of the hub — Linux kernel architecture and scheduling, boot and init, memory and NUMA, storage and filesystems, virtualization (KVM/QEMU/libvirt/virtio), io_uring, cgroups v2 and namespaces, sandboxing and confinement, immutable/atomic distributions, and the Linux privilege model. — https://llms-explorer.com/skills/devops-linux-internals/#the-rest-of-the-hub

## /dr — deep-research
<https://llms-explorer.com/skills/dr/>

- [definition] /dr — deep-research — Multi-source deep research using firecrawl and exa, synthesizing findings into cited reports with inline attribution, confidence ratings, and explicit knowledge gaps. — https://llms-explorer.com/skills/dr/#dr-deep-research

## full-suite
<https://llms-explorer.com/skills/full-suite/>

- [definition] full-suite — Exhaustively covers a subject end to end — maps the full concept family, researches every worthwhile gap to saturation, and compiles per-concept plus rollup llms-family files with keyword and semantic indexes. — https://llms-explorer.com/skills/full-suite/#full-suite

## memory-to-llms-txt
<https://llms-explorer.com/skills/memory-to-llms-txt/>

- [definition] memory-to-llms-txt — Turns an agent's persistent memory store — Claude Code auto-memory, a .remember/ time-decay pyramid, a napmem-style pyramid, or an ad-hoc project MEMORY.md — into a well-formed llms.txt family, preserving type/recency structure as facets and flagging entries that have drifted from reality. — https://llms-explorer.com/skills/memory-to-llms-txt/#memory-to-llms-txt
- [definition] How it works — 1. — https://llms-explorer.com/skills/memory-to-llms-txt/#how-it-works

## notes-to-llms-txt
<https://llms-explorer.com/skills/notes-to-llms-txt/>

- [definition] notes-to-llms-txt — Turns disorganized notes — a scratch file, a run of meeting notes, a mixed-topic dump — into a well-formed llms.txt family, by segmenting, clustering by topic, and drafting a source-anchored entry per topic. — https://llms-explorer.com/skills/notes-to-llms-txt/#notes-to-llms-txt

## prompt-deep-optimizer
<https://llms-explorer.com/skills/prompt-deep-optimizer/>

- [definition] prompt-deep-optimizer — Iteratively optimizes prompts that live in code and run repeatedly — system prompts, agent instruction blocks, tool templates — via a 16-pass audit in parallel bundles, looping to convergence. — https://llms-explorer.com/skills/prompt-deep-optimizer/#prompt-deep-optimizer

## rabbithole
<https://llms-explorer.com/skills/rabbithole/>

- [definition] rabbithole — The narrow inverse of concept-family-explorer — takes one named concept and exhausts it completely, drilling down through mechanism, edge cases, and primary sources until a pass finds nothing new. — https://llms-explorer.com/skills/rabbithole/#rabbithole
- [definition] The six deepening questions — Every pass asks each of these against every claim still standing: 1. **Why is this true?** — the mechanism underneath a stated fact. — https://llms-explorer.com/skills/rabbithole/#the-six-deepening-questions
- [definition] Saturation, measured — Each pass's claims are diffed against the accumulated list from every prior pass. The **new-information rate** — new atomic claims this pass ÷ total claims after this pass — is recorded per pass, and the run stops after **two consecutive passes** each score below 5%. — https://llms-explorer.com/skills/rabbithole/#saturation-measured

## skill-optimizer
<https://llms-explorer.com/skills/skill-optimizer/>

- [definition] skill-optimizer — Audits and rewrites an agent skill (SKILL.md) until it passes a measurable bar: 15 analytical passes, a 20-query trigger eval, cross-skill collision checks, and peer routing-mesh seeding, inside a convergence loop. — https://llms-explorer.com/skills/skill-optimizer/#skill-optimizer

## skill-tree-architect
<https://llms-explorer.com/skills/skill-tree-architect/>

- [definition] skill-tree-architect — Whole-tree architect for a skill library's hub-and-spoke taxonomy — audits description-cap headroom, hub balance, and cross-hub placement, then rebalances for a new family. — https://llms-explorer.com/skills/skill-tree-architect/#skill-tree-architect

## todo
<https://llms-explorer.com/skills/todo/>

- [definition] todo — One markdown to-do list that fills itself: add items by hand, tick them off, and let it pull in the tasks your agent sessions and braindumps left behind — every row cited to where it came from. — https://llms-explorer.com/skills/todo/#todo
- [definition] Sections — `TODO.md` holds four sections: **Manual**, **From braindumps**, **From sessions** (one group per project), and **Done**, where ticked items move with the date they were closed. — https://llms-explorer.com/skills/todo/#sections

## used-car-buying
<https://llms-explorer.com/skills/used-car-buying/>

- [definition] used-car-buying — Reference hub for buying a used car through salvage auctions (Copart, IAAI) or the cheaper alternatives to them — auction mechanics, bidding brokers, reading a listing, valuation, repair-cost estimation, and newbie mistakes to avoid. — https://llms-explorer.com/skills/used-car-buying/#used-car-buying

## Start here
<https://llms-explorer.com/start-here/>

- [definition] Start here — Try a small AI context workflow: capture a decision, ask a bounded question, check the answer and keep a reusable handoff. — https://llms-explorer.com/start-here/#start-here

## Concepts
<https://llms-explorer.com/tree/>

- [definition] Concepts — Every researched concept in the hub's tree, one page each, with its parent, its children and the frontier names below it. — https://llms-explorer.com/tree/#concepts

## Usage and credits
<https://llms-explorer.com/usage/>

- [definition] Usage and credits — The metered work on your account this period — jobs, tokens and embeddings, each row priced from the append-only ledger — and the credit balance left against your quota. — https://llms-explorer.com/usage/#usage-and-credits
- [definition] What metering counts — Model tokens on the refine and vocabulary passes, embedding calls on indexing, and the wall time of a job holding a worker. Querying an already-built index is not metered. — https://llms-explorer.com/usage/#what-metering-counts
