Metraipolis › archive › dc_a3ee59e6efa0

WebUIProof: Benchmarking WebUI Code Generators with UI-Agent Execution Harness — arXiv:2610.02617

Source
arXiv
Original
https://arxiv.org/abs/2610.02617
License (as archived)
CC0-1.0
Archived
2026-10-05T22:48:02.920Z
SHA-256 of the archived text
c8f994a283b3ab57dd1c9f91ec9b2fd01737aa7100c5168f3e60c4b55a28ee58
Stable URL of this page
https://metraipolis.com/documento/dc_a3ee59e6efa0

How to cite

WebUIProof: Benchmarking WebUI Code Generators with UI-Agent Execution Harness — arXiv:2610.02617 — arXiv, https://arxiv.org/abs/2610.02617 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_a3ee59e6efa0 (Metraipolis archive dc_a3ee59e6efa0, sha256 c8f994a283b3ab57dd1c9f91ec9b2fd01737aa7100c5168f3e60c4b55a28ee58)
BibTeX
@misc{dca3ee59e6efa0,
  title = {WebUIProof: Benchmarking WebUI Code Generators with UI-Agent Execution Harness — arXiv:2610.02617},
  howpublished = {arXiv},
  url = {https://arxiv.org/abs/2610.02617},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_a3ee59e6efa0; sha256 c8f994a283b3ab57dd1c9f91ec9b2fd01737aa7100c5168f3e60c4b55a28ee58},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv, https://arxiv.org/abs/2610.02617. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Evaluating WebUI code generation at scale is difficult: outputs may compile and look plausible yet fail under user interaction, and prior benchmarks largely rely on free-form prompts with static checks (build success, screenshots) that miss functional correctness. We introduce WebUIProof, an execution-oriented benchmark that provides structured specifications and dense, executable interaction tests for WebUI generation across two task families: general WebUIs (e.g., dashboards, game, interactive tools) and 3D interactive simulation (e.g., particle/galaxy systems, physics dynamics). WebUIProof includes a UI-agent harness that runs executable interaction tests in a headless browser using an iterative plan--act--observe loop: it locates DOM elements, performs actions, observes resulting UI/DOM changes, and checks the specified assertions. We evaluate across eight commercial LLMs and observe frequent failures on interaction-based requirements even when pages render successfully, especially on 3D simulation interfaces. Finally, we show the UI-agent harness can provide outcome-level training signals. Training compact models (e.g., Qwen2.5 14B and MIMO 7B) with RL rewards derived from executable interaction tests improves functional completion while reducing build failures.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.MA, nuovi lavori del giorno).
Categorie arXiv: Software Engineering (cs.SE) ; Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA).
Pagina del lavoro: https://arxiv.org/abs/2610.02617 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-05T22:45:40.639Z dalla pagina https://arxiv.org/list/cs.MA/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).