AI Red-Teaming and Security-Testing Tooling
Parent: AI Agent Ecosystems · researched 2026-06-01T02:26:26.444Z· 46 sources · 8 concepts · skill ai-agent-engineering
AI & agent-engineering family ROUTER. Split into: ai-agents-orchestration (agent frameworks, multi-agent, memory, planning, guardrails, coding/GUI agents, autonomous loops, eval); ai-rag-retrieval (RA
ai-agent-engineering
- AI & agent-engineering family ROUTER. Split into: ai-agents-orchestration (agent frameworks, multi-agent, memory, planning, guardrails, coding/GUI agents, autonomous loops, eval); ai-rag-retrieval (RAG, iterative retrieval, vector/graph datastores); ai-llm-model-layer (training, fine-tuning, alignment/RLHF, compression, inference serving, transformer/multimodal architecture, model selection, observability); ai-mcp-sdk-prompting (MCP servers/builder, Anthropic SDK, prompt engineering, context engineering, LLM frameworks, tool-search, prompt lookup). Route to the matching sub-hub. [source]
- This hub routes to on-demand reference files under references/. See each spoke for depth. [source]
Children
- Open-source scanners/frameworks (Garak, PyRIT, promptfoo, Giskard, CyberSecEval) (frontier)
- Attack taxonomy (direct/indirect injection, jailbreak families, many-shot, Crescendo, exfiltration) (frontier)
- Automated attack generation (GCG, PAIR, TAP, red-teamer LLMs) (frontier)
- Benchmarks (AdvBench, HarmBench, JailbreakBench, AgentDojo) (frontier)
- Commercial continuous red-teaming (Lakera/Gandalf, Cisco AI Defense, Mindgard) (frontier)
- Process & governance (OWASP GenAI Red Teaming Guide, MITRE ATLAS, NIST AI RMF, red-team-in-CI) (frontier)
Frontier under this node: Attack taxonomy (direct/indirect injection, jailbreak families, many-shot, Crescendo, exfiltration), Automated attack generation (GCG, PAIR, TAP, red-teamer LLMs), Benchmarks (AdvBench, HarmBench, JailbreakBench, AgentDojo), Commercial continuous red-teaming (Lakera/Gandalf, Cisco AI Defense, Mindgard), Open-source scanners/frameworks (Garak, PyRIT, promptfoo, Giskard, CyberSecEval), Process & governance (OWASP GenAI Red Teaming Guide, MITRE ATLAS, NIST AI RMF, red-team-in-CI)