Metraipolis › archive › dc_517d7dc0dce2
Software Engineering for and with GUI Agent — arXiv:2608.09278
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.09278
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T09:00:59.111Z
- SHA-256 of the archived text
d5c2514946d917e3f4a316ab6b23123f3b21af7d9a631fc521d156634cbacc28- Stable URL of this page
https://metraipolis.com/documento/dc_517d7dc0dce2
How to cite
Software Engineering for and with GUI Agent — arXiv:2608.09278 — arXiv (en), https://arxiv.org/abs/2608.09278 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_517d7dc0dce2 (Metraipolis archive dc_517d7dc0dce2, sha256 d5c2514946d917e3f4a316ab6b23123f3b21af7d9a631fc521d156634cbacc28)
BibTeX
@misc{dc517d7dc0dce2,
title = {Software Engineering for and with GUI Agent — arXiv:2608.09278},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.09278},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_517d7dc0dce2; sha256 d5c2514946d917e3f4a316ab6b23123f3b21af7d9a631fc521d156634cbacc28},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.09278. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
GUI agents have advanced rapidly, producing a growing body of frameworks, benchmarks, and applications. However, this growth has outpaced the maturity of the field. GUI agents remain technically brittle, incompletely engineered, and insufficiently validated for sustained real-world use. They are evolving into closed-loop software systems. Within these systems, model reasoning is coupled with interface perception, execution feedback, recovery, and human oversight. This evolution calls for a software engineering perspective that remains largely absent from existing research. We address this gap by reviewing 336 GUI-agent papers from January 2018 to April 2026. Five research questions examine the research landscape, architectures, evaluation, software lifecycle concerns, and future opportunities. Our findings show that the field has expanded sharply since 2024, while mobile and web settings remain dominant. Architectures increasingly adopt modular perceive-reason-act loops, but recovery, human escalation, safety enforcement, and auditability remain underdeveloped. This architectural imbalance extends to evaluation. Evaluations are becoming more interactive, but they remain centered on task success and are difficult to compare across protocols. More broadly, existing studies provide limited support for testing beyond benchmarks and for maintaining agents after release. Observability, privacy engineering, and systematic human oversight are also underdeveloped. Together, these findings show that capability improvements alone cannot ensure deployment readiness. Future research should connect dependable execution with lifecycle-centered testing and reproducible evaluation. It should also integrate permission and privacy controls with cost-aware, human-centered governance. This integration is necessary to build dependable, maintainable, secure, and deployable GUI-agent systems. Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-08-11 in cs.SE). Categorie arXiv: Software Engineering (cs.SE) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2608.09278 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T09:00:31.493Z dalla pagina https://arxiv.org/catchup/cs.SE/2026-08-11?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).