Metraipolis › archive › dc_7cdb1915802d
MemU-Bench: Benchmarking GUI Agents on Long-Horizon User Interactions — arXiv:2611.00191
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.00191
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T11:00:36.126Z
- SHA-256 of the archived text
fc7dd7079326398ec8d406ec80ca0520eb0bfa6295b2a9828a1359c3dad4c79d- Stable URL of this page
https://metraipolis.com/documento/dc_7cdb1915802d
How to cite
MemU-Bench: Benchmarking GUI Agents on Long-Horizon User Interactions — arXiv:2611.00191 — arXiv (en), https://arxiv.org/abs/2611.00191 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_7cdb1915802d (Metraipolis archive dc_7cdb1915802d, sha256 fc7dd7079326398ec8d406ec80ca0520eb0bfa6295b2a9828a1359c3dad4c79d)
BibTeX
@misc{dc7cdb1915802d,
title = {MemU-Bench: Benchmarking GUI Agents on Long-Horizon User Interactions — arXiv:2611.00191},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.00191},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_7cdb1915802d; sha256 fc7dd7079326398ec8d406ec80ca0520eb0bfa6295b2a9828a1359c3dad4c79d},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.00191. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Existing Graphical User Interface (GUI) benchmarks predominantly rely on precise and stateless user instructions. In everyday usage, however, instructions are often \emph{vague and history-dependent}: users omit the exact details of their past operations because they no longer remember them, leaving the agent to recover the missing context from long and noisy interaction histories. To bridge this evaluation gap, we introduce \textbf{MemU-Bench}, a mobile benchmark of \textbf{118 vague tasks} grounded in 29 long-horizon user trajectories, where agents must distill raw interaction streams into memory and retrieve the missing context on demand, with task outcomes verified against serialized application databases. Alongside Success Rate, we incorporate Interaction Efficiency (IE) and Success weighted by Path Length (SPL) to expose agents that succeed by exhaustively searching across different applications rather than by \emph{genuinely recalling} the history. Evaluations show that without user history, state-of-the-art systems struggle under such ambiguity: the best-performing Gemini-3.1-Pro achieves an SPL of only 16.4\%, and end-to-end GUI agents fall below 5\%. To address this, we further propose \textbf{AppMem}, a training-free framework that distills user history into a \emph{structured, app-centric} memory bank, tracks interrupted intents across application switches, and selectively retrieves relevant memories via target-app inference. AppMem raises the SPL of GPT-5.5 from 15.7\% to 66.9\% (\textbf{+51.2\%}), outperforms a naive summary baseline by 9.3\%, and delivers consistent gains across evaluated backbones.
Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2611.00191 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T10:59:45.689Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).