Metraipolis › archive › dc_abc8ce24297e
Beyond Dyadic Memory: Interaction-Aware Multimodal Memory with Adaptive Agentic Retrieval for Multi-Party Spoken Conversations — arXiv:2609.32522
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.32522
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T20:55:39.303Z
- SHA-256 of the archived text
2fc1e4e6f6a6a02f2900a8da4057b78386986df10ccb4fa9e74194d3c8592125- Stable URL of this page
https://metraipolis.com/documento/dc_abc8ce24297e
How to cite
Beyond Dyadic Memory: Interaction-Aware Multimodal Memory with Adaptive Agentic Retrieval for Multi-Party Spoken Conversations — arXiv:2609.32522 — arXiv (en), https://arxiv.org/abs/2609.32522 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_abc8ce24297e (Metraipolis archive dc_abc8ce24297e, sha256 2fc1e4e6f6a6a02f2900a8da4057b78386986df10ccb4fa9e74194d3c8592125)
BibTeX
@misc{dcabc8ce24297e,
title = {Beyond Dyadic Memory: Interaction-Aware Multimodal Memory with Adaptive Agentic Retrieval for Multi-Party Spoken Conversations — arXiv:2609.32522},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.32522},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_abc8ce24297e; sha256 2fc1e4e6f6a6a02f2900a8da4057b78386986df10ccb4fa9e74194d3c8592125},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.32522. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Long-term memory enables agents to accumulate information and reason across sessions, yet existing research primarily focuses on dyadic text or image-text conversations, leaving long-term memory for multi-party spoken conversations underexplored. This setting requires preserving conversational content, identifying participants across sessions, and retaining who speaks to whom. To this end, we propose VoxPolyMem, an interaction-aware multimodal memory framework combining incremental speaker identification with a memory hierarchy comprising interaction memory, fact memory, and participant profiles. We formulate retrieval as sequential decision-making, where an agent rewrites queries and selects retrieval tools and memory layers based on accumulated evidence to address information gaps. We further introduce Evidence-Gain GRPO (EG-GRPO), which uses round-wise credit assignment to encourage complementary evidence acquisition. We also construct VoxPolyBench to evaluate memory evolution, personalized answering, memory retrieval and reasoning, and interaction reasoning and attribution in multi-party spoken conversations. VoxPolyMem achieves an overall score of 85.0 on VoxPolyBench, surpassing the strongest evaluated baseline by 23.6 points. On Mem-Gallery and H2HMem-Multi, it scores 89.6 and 74.4, respectively, exceeding the strongest evaluated public memory baselines by over 8 points each. These results highlight its potential for persistent, personalized assistance in multi-party multimodal interactions. Code and datasets are available at this https URL Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI) ; Information Retrieval (cs.IR); Sound (cs.SD); Audio and Speech Processing (eess.AS). Pagina del lavoro: https://arxiv.org/abs/2609.32522 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T20:29:00.851Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).