Metraipolis › archive › dc_069365e2edeb

From Guidelines to Practice: Defining Requirements for AI Red-Teaming Tools — arXiv:2611.04271

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.04271
License (as archived)
CC0-1.0
Archived
2026-11-04T18:47:30.762Z
SHA-256 of the archived text
77c1139ab6acde5a423092170fd4307261f750c084af70793354b0442de8d977
Stable URL of this page
https://metraipolis.com/documento/dc_069365e2edeb

How to cite

From Guidelines to Practice: Defining Requirements for AI Red-Teaming Tools — arXiv:2611.04271 — arXiv (en), https://arxiv.org/abs/2611.04271 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_069365e2edeb (Metraipolis archive dc_069365e2edeb, sha256 77c1139ab6acde5a423092170fd4307261f750c084af70793354b0442de8d977)
BibTeX
@misc{dc069365e2edeb,
  title = {From Guidelines to Practice: Defining Requirements for AI Red-Teaming Tools — arXiv:2611.04271},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.04271},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_069365e2edeb; sha256 77c1139ab6acde5a423092170fd4307261f750c084af70793354b0442de8d977},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.04271. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Artificial Intelligence (AI) has seen significant developments and increased usage in recent years. AI benefits various tasks, automates decision-making, and enhances efficiency. However, AI also introduces additional attack surfaces for threat actors to perform attacks like prompt injection and jailbreaking, making security a great concern. AI security testing aims to imitate adversarial attacks or malicious inputs via manual testing or with the assistance of tools. Thus, it is critical that organizations are aware of the capabilities and limitations of the tools before using them. Existing studies provide insights on the overall architecture of AI security testing tools and raise concerns on their reliability, but their analysis is limited to attack performance. Selection of a tool for AI risk assessments should also depend on their alignment with the recommendations of industry standards, but to our knowledge, previous studies have not utilized such guidelines. To bridge this gap, we analyze several industry standards and guidelines to identify the requirements of AI testing tools. We discuss and highlight desirable features across various AI security testing tools for a variety of different AI systems. We evaluated six tools across six Large Language Models, reported on our insights, and identified gaps that should be considered by future tools.

Tema degli esploratori: governance digitale e beni comuni (elenco arXiv cs.CY, nuovi lavori del giorno).
Categorie arXiv: Computers and Society (cs.CY).
Pagina del lavoro: https://arxiv.org/abs/2611.04271 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-04T18:33:52.097Z dalla pagina https://arxiv.org/list/cs.CY/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).