Metraipolis › archive › dc_9f3ec9dbfae4

ReplayLens: Auditing Agents' Use of Outcomes — arXiv:2609.34177

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.34177
License (as archived)
CC0-1.0
Archived
2026-10-07T20:54:15.451Z
SHA-256 of the archived text
0b30688a766864c38e2a42f3fd8c13807a49b364017739d5855308bfffe2fe22
Stable URL of this page
https://metraipolis.com/documento/dc_9f3ec9dbfae4

How to cite

ReplayLens: Auditing Agents' Use of Outcomes — arXiv:2609.34177 — arXiv (en), https://arxiv.org/abs/2609.34177 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_9f3ec9dbfae4 (Metraipolis archive dc_9f3ec9dbfae4, sha256 0b30688a766864c38e2a42f3fd8c13807a49b364017739d5855308bfffe2fe22)
BibTeX
@misc{dc9f3ec9dbfae4,
  title = {ReplayLens: Auditing Agents' Use of Outcomes — arXiv:2609.34177},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.34177},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_9f3ec9dbfae4; sha256 0b30688a766864c38e2a42f3fd8c13807a49b364017739d5855308bfffe2fe22},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.34177. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

When an agent reuses logged experience, a changed decision may reflect the recorded score, the action's name, or the record's position in storage. Standard memory evaluations do not reveal which relationship drives that change. We introduce ReplayLens, a black-box audit that changes one relationship in the stored history at a time, holds the remaining interface fixed, and measures the resulting decision. Four interventions target four relationships. Outcome reassignment swaps which scores belong to which actions. Pair transport moves intact action-score pairs to new record slots. Consistent renaming relabels actions in both history and menu. Key-slot reassignment changes both score attachment and position. A constructive separation shows why the audit is needed: two memory writers with identical endpoint accuracy respond differently to the same replay, so conventional evaluation cannot resolve the underlying dependence. On black-box LLM interfaces, swapping scores changes decisions while moving intact pairs does not, separating score attachment from record order. A bounded-memory study exposes ingestion-order sensitivity that endpoint comparison misses. In sequential experiment planning, altered historical scores redirect exploration and reduce final utility despite fresh measurements. A code-debugging agent with sealed hidden tests shows the same pattern outside model selection. ReplayLens provides a relationship-level audit for deciding whether logged experience can be merged, reordered, or reindexed safely.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.MA).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Machine Learning (cs.LG); Multiagent Systems (cs.MA).
Pagina del lavoro: https://arxiv.org/abs/2609.34177 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T20:24:41.721Z dalla pagina https://arxiv.org/catchup/cs.MA/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).