# vLLM parser engine grammar (vllm/parser) and structural-tag strict tool calling > `vllm/parser/AGENTS.md` says `Parser` unifies reasoning extraction and tool-call extraction behind one object that serving calls through `parse`, `parse_delta` and `is_reasoning_end`. Parent: [Mac local LLMs: Chat templates, reasoning and tool calling](https://llms-explorer.com/tree/mac-local-llms-chat-templates-reasoning-and-tool-calling/) · 1 facets · 29 facts · page: https://llms-explorer.com/tree/vllm-parser-engine-grammar-vllm-parser-and-struc/ ## Facts - `vllm/parser/AGENTS.md` says `Parser` unifies reasoning extraction and tool-call extraction behind one object that serving calls through `parse`, `parse_delta` and `is_reasoning_end`. — [source](https://raw.githubusercontent.com/vllm-project/vllm/main/vllm/parser/AGENTS.md) - The `engine/` directory holds `parser_engine.py`, `streaming_parser_engine.py`, `parser_engine_config.py`, `token_id_scanner.py` (pre-lexes special-token ids), `incremental_lexer.py` (lexes text), `events.py` and `adapters.py` (exposes an engine through the legacy reasoning and tool parser interfaces). — [source](https://api.github.com/repos/vllm-project/vllm/contents/vllm/parser/engine) - The guidelines say text emitted in a state with no `content_events` entry is discarded, special tokens reach the engine as token ids not text, and a text terminal that spans a special token never matches while streaming and must be listed in `token_id_terminals`. — [source](https://raw.githubusercontent.com/vllm-project/vllm/main/vllm/parser/AGENTS.md) - `DelegatingParser` exists to wrap a legacy `ReasoningParser` plus `ToolParser` pair for backward compatibility and must not be used for new formats. — [source](https://raw.githubusercontent.com/vllm-project/vllm/main/vllm/parser/AGENTS.md) - On main (2026-10-04) `vllm/parser/` has per-model files for cohere_command, deepseek_v32, deepseek_v4, deepseek_v41, gemma4, glm47_moe, granite, granite_thinking, harmony, inkling, kimi_k2, kimi_k3, ling3, mimo, minimax_m2, mistral, nemotron_v3, plamo3, qwen3, seed_oss and step3p5, plus `response_template.py`. — [source](https://api.github.com/repos/vllm-project/vllm/contents/vllm/parser) - Open pull requests port the Hermes parser (51937), llama3_json and llama4_json (51577), Kimi K3 (50229), MiniMax M3 (59743), Olmo3 (48160) and MuseGlimmer (54585) to the engine. — [source](https://api.github.com/search/issues?q=repo:vllm-project/vllm+%22parser+engine%22&per_page=20) - vLLM's docs split structural-tag enforcement into call obligation and grammar activation: named and `"required"` always activate a structural tag; `"auto"` activates one only when a tool sets `strict: true` or `--tool-strict-level` is `function` or `parameter`; `"none"` disables tool calling. — [source](https://docs.vllm.ai/en/latest/features/tool_calling/) - The tool-call envelope (markup and function name) is constrained whenever a tag applies, but a tool's argument schema is pinned only when that tool sets `strict: true` or the server uses `--tool-strict-level parameter`; a tool that omits `strict` keeps unconstrained arguments even when another tool in the request is strict. — [source](https://docs.vllm.ai/en/latest/features/tool_calling/) - `--tool-strict-level` accepts `auto` (default), `function` (constrain the envelope for every request with tools) and `parameter` (also pin every tool's schema), and never relaxes a constraint the request would already get. — [source](https://docs.vllm.ai/en/latest/features/tool_calling/) - `VLLM_ENFORCE_STRICT_TOOL_CALLING` defaults to true; set to false it removes structural tags regardless of `strict` and takes precedence over `--tool-strict-level`, and it leaves schema-derived structured outputs for named and required calls unchanged. — [source](https://docs.vllm.ai/en/latest/features/tool_calling/) - The `strict` field is supported on Chat Completion, Responses and Anthropic Messages, and the docs recommend OpenAI strict-schema style (`additionalProperties: false`, all properties required, optional fields as `["string","null"]`). — [source](https://docs.vllm.ai/en/latest/features/tool_calling/) - The docs say most clients never set `strict`, so with `tool_choice="auto"` malformed markup can leak into the response, which is why `--tool-strict-level function` exists. — [source](https://docs.vllm.ai/en/latest/features/tool_calling/) - The `hf` parser reads a checkpoint's `response_template` from `tokenizer_config.json` (`--tool-call-parser hf --reasoning-parser hf`), fails at startup if the template or its `thinking` or `tool_calls` field is missing, and rejects strict tools, required or named choice and `parallel_tool_calls=false` because it does no constrained decoding. — [source](https://docs.vllm.ai/en/latest/features/tool_calling/) - With `tool_choice="none"` vLLM still puts tool definitions in the prompt unless `--exclude-tools-when-tool-choice-none` is set. — [source](https://docs.vllm.ai/en/latest/features/tool_calling/) - The structural-tag RFC (issue 32142) argued that forcing `tool_choice="required"` through a JSON-schema array may force a first token of `[` and skip the model's native tool-call start token and its thinking. — [source](https://api.github.com/repos/vllm-project/vllm/issues/32142) - Issue 53745 (closed 2026-08-26): with `--reasoning-parser qwen3 --tool-call-parser qwen3_coder`, `ParserManager.get_parser` returned the shared engine class directly (`parser_manager.py:142-143`), whose `adjust_request` only sets `skip_special_tokens = False`, so no structural tag attached and `strict: true` was a silent no-op. — [source](https://api.github.com/repos/vllm-project/vllm/issues/53745) - The production symptom was malformed argument keys (`objctive`, `obj`, `objecTive`) from an agent client, and v0.27.1 had attached a populated triggered-tags tag for the same request. — [source](https://api.github.com/repos/vllm-project/vllm/issues/53745) - A commenter confirmed PR 52830 (merged 2026-08-26) removed the short-circuit so `get_parser` composes a `DelegatingParser` and `_apply_structural_tag` runs when the tool parser has `structural_tag_model`, but said its tests do not build a strict request or use `qwen3_coder`, and PR 53752 with that test was still open. — [source](https://api.github.com/repos/vllm-project/vllm/issues/53745/comments?per_page=30) - Issue 54808 (closed 2026-09-29): on vLLM 0.28.0 with Qwen3.8-27B, `qwen3_coder` and `qwen3_xml` ignored `tool_choice` `"required"` and a named function, returning `finish_reason: "tool_calls"` with `tool_calls: null`, even with `strict: true`; the reporter links the same root cause to gemma4 (50477), poolside_v1 (49712) and step3p5 (51804). — [source](https://api.github.com/repos/vllm-project/vllm/issues/54808) - A commenter stated 54808 was fixed on main by PR 52830 (v0.29.0 and later), and the issue was closed on 2026-09-29. — [source](https://api.github.com/repos/vllm-project/vllm/issues/54808/comments?per_page=30) - A commenter on 54808 reported `tool_choice: "none"` with no tools declared still let Qwen3.8 emit raw `` XML in `content` with `finish_reason: "tool_calls"` on `--tool-call-parser qwen3_coder`. — [source](https://api.github.com/repos/vllm-project/vllm/issues/54808/comments?per_page=30) - Issue 55152 (open): with `--structured-outputs-config '{"backend": "guidance"}'`, any request whose parser emits a structural tag fails with `VLLMValidationError: Invalid grammar specification: 'triggers'`, because tool parsers build new-format `{"type":"structural_tag","format":{...}}` tags via `vllm/tool_parsers/structural_tag_registry.py` while `serialize_guidance_grammar` only reads the legacy `triggers`/`structures` shape. — [source](https://api.github.com/repos/vllm-project/vllm/issues/55152) - All 42 combinations of 14 registered `structural_tag_model` families by auto, required and named fail on guidance; PR 55153 makes hermes work in all three modes and llama and qwen_3 work for required, and rejects the rest with an error naming the shape (SequenceFormat, OptionalFormat, `excludes`). — [source](https://api.github.com/repos/vllm-project/vllm/issues/55152/comments?per_page=30) - With `VLLM_USE_RUST_FRONTEND=1`, `tool_choice: "required"` and named calls returned HTTP 500 on v0.30.0 with DeepSeek-V4.1-Flash and no structured-outputs flag, because the Rust frontend ignores `structured_outputs_config` and the requests reach the guidance path. — [source](https://api.github.com/repos/vllm-project/vllm/issues/55152/comments?per_page=30) - The author of vLLM's structured-output refactor RFC (48197) states xgrammar is the default for `backend=auto` and the strict tool-calling tags are built with xgrammar, and that spec-decode plus structured-output fixes (PRs 44297 and 44993) should make xgrammar at least as stable as guidance. — [source](https://api.github.com/repos/vllm-project/vllm/issues/55152/comments?per_page=30) - PR 59629 (open): when reasoning ends on a tool-call opener (GLM-4.7 and 5.x), the structured-output gate started the constraint one token past the opener, so the grammar re-forced a second opener and required or named calls came back empty; the fix feeds the opener to the grammar for content terminators, for the `glm47_moe`, `qwen3`, `gemma4` and `mistral` configs. — [source](https://api.github.com/repos/vllm-project/vllm/pulls/59629) - PR 56113 (open): with speculative decoding, `` and a tool call can arrive in one chunk and `DelegatingParser.parse_delta` kept only the `` text, losing the function name and arguments; stale `delta_token_ids` produced malformed arguments such as `{"command=ls": ""}`. — [source](https://api.github.com/repos/vllm-project/vllm/pulls/56113) - PR 58407 (open, labelled security): a closing tag copied inside a Qwen parameter value ended the value early and the model's own closers produced a second forged tool call; the fix detects more closers than openers and keeps the text in the first parameter. — [source](https://api.github.com/repos/vllm-project/vllm/pulls/58407) - Inferred: for a Qwen3.8 agent stack on vLLM 0.28 or earlier, strict and forced tool calling cannot be trusted; check `adjust_request(...).structured_outputs` for a non-empty `structural_tag` before relying on it. — source: `asserted`