LiteLLM gateway and SDK engineering
Parent: AI Gateways & LLM Proxy Infrastructure · Topic entry · 46 branches · skill ai-llm-model-layer/references/litellm-gateway-sdk-engineering.md
A published reference is not available for this topic yet.
Children
- Anthropic Messages native passthrough (frontier)
- Anthropic block fidelity and provider capabilities (frontier)
- Anthropic-to-Chat client tool translation (frontier)
- Anthropic-to-Responses routing (frontier)
- Context and thinking controls across local API surfaces (frontier)
- Endpoint-specific streaming failover (frontier)
- LiteLLM A2A agent gateway (frontier)
- LiteLLM Anthropic Messages interoperability
- LiteLLM MCP permission governance (frontier)
- LiteLLM OpenTelemetry generations and privacy (frontier)
- LiteLLM Responses API interoperability (frontier)
- LiteLLM Rust gateway migration (frontier)
- LiteLLM SDK exception taxonomy (frontier)
- LiteLLM SDK provider normalization
- LiteLLM budget reservation and reconciliation (frontier)
- LiteLLM cooldown policies (frontier)
- LiteLLM database-free deployment boundaries (frontier)
- LiteLLM distributed counter failure policy (frontier)
- LiteLLM exact cache identity and tenant namespace (frontier)
- LiteLLM gateway alias configuration (frontier)
- LiteLLM local Ollama and OpenAI-compatible backends
- LiteLLM migrations and image provenance (frontier)
- LiteLLM model capability metadata (frontier)
- LiteLLM model groups and deployment selection (frontier)
- LiteLLM native Ollama Chat adapter (frontier)
- LiteLLM native finish reason preservation (frontier)
- LiteLLM observability and caching
- LiteLLM passthrough endpoint capability parity (frontier)
- LiteLLM proxy deployment and configuration
- LiteLLM readiness and provider health (frontier)
- LiteLLM retry ownership and budgets (frontier)
- LiteLLM routing retries and fallbacks
- LiteLLM semantic replay correctness for agents (frontier)
- LiteLLM stream compatibility fixtures (frontier)
- LiteLLM streamed argument assembly (frontier)
- LiteLLM tenant authorization and key lifecycle (frontier)
- LiteLLM tool calls and SSE streaming
- LiteLLM tool result correlation (frontier)
- LiteLLM unsupported parameter policy (frontier)
- LiteLLM usage and stream termination (frontier)
- LiteLLM virtual keys budgets and rate limits
- Local function-tool capability qualification (frontier)
- OpenAI-compatible local server configuration (frontier)
- Provider usage normalization with cached tokens (frontier)
- Provider-specific token and spend accounting (frontier)
- Redis cache expiration eviction and ACLs (frontier)
Frontier under this node: LiteLLM A2A agent gateway, LiteLLM MCP permission governance, LiteLLM Responses API interoperability, LiteLLM Rust gateway migration, LiteLLM passthrough endpoint capability parity