agent/papers/items/2026-2605-17075-a-red-teaming-framework-for-evaluating-robustness-of-ai-enabled-security-orchest.md

Paper: A Red Teaming Framework for Evaluating Robustness of AI-enabled Security Orchestration, Automation, and Response Systems

---

type: paper title: A Red Teaming Framework for Evaluating Robustness of AI-enabled Security Orchestration, Automation, and Response Systems authors: Ayan Javeed Shaikh, Nathaniel D. Bastian, Ankit Shah year: 2026 venue: arXiv url: https://arxiv.org/abs/2605.17075 code_url: source: arxiv collected_at: 2026-07-08 published_at: 2026-05-16 updated_at: 2026-05-16 status: queued relevance: high topics:

• agent-evaluation
• agent-safety
• planning
• tool-use
• workflow-agent
• world-model methods:

benchmarks:

models:

datasets:

• cs.CR related_concepts:

related_jobs:

related_experiments:

related_projects:

collection_score: 13 collection_queries: autonomous-agent-llm

One-line Takeaway

Auto-collected from arXiv because it matched the Agent collection queries. Needs human skim.

Why Collected

• matched queries: autonomous-agent-llm
• inferred topics: agent-evaluation, agent-safety, planning, tool-use, workflow-agent, world-model
• arXiv categories: cs.CR
• collection score: 13

Review Checklist

• Does this paper directly inform Agent architecture, evaluation, memory, tools, safety, coding agents, GUI/browser agents, or multi-agent workflows?
• Does it include a benchmark, dataset, code, or reproducible experimental setup?
• Should it be promoted from queued to skimmed or summarized?

Links

• arXiv: https://arxiv.org/abs/2605.17075