Metraipolis › archive › dc_84ad4aa3d205
EIO-Agents: The Missing Semantic Layer for AI Agent Evaluation — arXiv:2610.07675
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.07675
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T11:17:20.320Z
- SHA-256 of the archived text
f7d5ec3ab5a51abd1e1d57f577f290a57d09c8732d996c169637fbe93043d9c1- Stable URL of this page
https://metraipolis.com/documento/dc_84ad4aa3d205
How to cite
EIO-Agents: The Missing Semantic Layer for AI Agent Evaluation — arXiv:2610.07675 — arXiv (en), https://arxiv.org/abs/2610.07675 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_84ad4aa3d205 (Metraipolis archive dc_84ad4aa3d205, sha256 f7d5ec3ab5a51abd1e1d57f577f290a57d09c8732d996c169637fbe93043d9c1)
BibTeX
@misc{dc84ad4aa3d205,
title = {EIO-Agents: The Missing Semantic Layer for AI Agent Evaluation — arXiv:2610.07675},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.07675},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_84ad4aa3d205; sha256 f7d5ec3ab5a51abd1e1d57f577f290a57d09c8732d996c169637fbe93043d9c1},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.07675. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
AI agents are entering production in increasingly consequential environments without a shared semantic standard for what their evaluations actually mean. Scores, traces, judge outputs, and multi juror findings are increasingly used to justify readiness and release decisions, yet they often do not specify what evidence supports a claim, what that evidence can establish, or how the claim leads to a decision. We introduce EIO-Agents, an open specification for interoperable AI agent evaluation built on two layers. The Evaluation Intelligence Ontology (EIO) provides the semantic layer through typed evidence, versioned behavioral predicates, evidence contracts, claims, witness rules, proof status, recurrence, and computable derivations for metrics, findings, controls, and PASS, REVIEW, or BLOCK decisions. The Portable Evaluation Record (PER) provides the system of record: a canonical, content addressed representation of one evaluation that preserves the evidence to decision chain and can be re derived, explained, and verified. Scores summarize, juries interpret, and traces record, but none of them define what the evidence means or what it can prove. EIO provides that missing semantic contract, while PER preserves the resulting evaluation as a portable and verifiable system of record. As AI agents assume greater operational responsibility, evaluation must become more than a collection of scores and verdicts; it must become an accountable artifact whose meaning, evidence, limitations, and decisions can be independently checked. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.MA, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI) ; Multiagent Systems (cs.MA). Pagina del lavoro: https://arxiv.org/abs/2610.07675 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T11:15:09.478Z dalla pagina https://arxiv.org/list/cs.MA/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).