Metraipolis › archive › dc_efd0729808a3

Interaction Readiness: A Framework for Building and Evaluating AI Agents in Human Roles — arXiv:2608.12358

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.12358
License (as archived)
CC0-1.0
Archived
2026-10-19T04:17:54.288Z
SHA-256 of the archived text
859a898d5930bb57af8d40641a470dc59baeae88fbae99f19840afaa3a4ef04a
Stable URL of this page
https://metraipolis.com/documento/dc_efd0729808a3

How to cite

Interaction Readiness: A Framework for Building and Evaluating AI Agents in Human Roles — arXiv:2608.12358 — arXiv (en), https://arxiv.org/abs/2608.12358 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_efd0729808a3 (Metraipolis archive dc_efd0729808a3, sha256 859a898d5930bb57af8d40641a470dc59baeae88fbae99f19840afaa3a4ef04a)
BibTeX
@misc{dcefd0729808a3,
  title = {Interaction Readiness: A Framework for Building and Evaluating AI Agents in Human Roles — arXiv:2608.12358},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.12358},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_efd0729808a3; sha256 859a898d5930bb57af8d40641a470dc59baeae88fbae99f19840afaa3a4ef04a},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.12358. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Product and engineering teams building role-bearing AI agents face an evaluation gap: an agent can produce accurate, safe, and fluent content while still failing the behavioral requirements of its assigned role. This paper introduces Interaction Readiness as a framework for specifying and evaluating that missing layer of performance. The framework separates content specifications, which govern what an agent knows and says, from interaction specifications, which define how an agent should conduct itself in a role-governed exchange. Interaction specifications require teams to define role purpose, authority boundaries, recurring situations, boundary cases, repair behaviors, and audit criteria before deployment. We operationalize interaction readiness through four agent operations: understanding purpose, calibrating authority, managing tone, and repairing breakdowns. Using StudyChat, a public dataset of student interactions with an AI tutoring agent, we show that content accuracy and interaction quality are independent dimensions: an agent may be factually correct while failing as a tutor, or interactionally sound while technically wrong. The most persistent failure is authority miscalibration: the agent often knows how to answer, but not whether, when, or how the tutor role permits it to answer. The paper translates these findings into a specification template and audit procedures that product and engineering teams can apply before and after deployment

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-14 in cs.AI).
Categorie arXiv: Human-Computer Interaction (cs.HC) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2608.12358 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T04:13:06.656Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-14?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).