Metraipolis › archive › dc_22e0f021a651

LiveEvalBench: Toward Open-World Evaluation for Web Generation — arXiv:2608.03689

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.03689
License (as archived)
CC0-1.0
Archived
2026-10-31T12:16:34.255Z
SHA-256 of the archived text
9ed7e20308daf529cf4993f5aa7125bac7d8158b586d583bc068de3213f2448a
Stable URL of this page
https://metraipolis.com/documento/dc_22e0f021a651

How to cite

LiveEvalBench: Toward Open-World Evaluation for Web Generation — arXiv:2608.03689 — arXiv (en), https://arxiv.org/abs/2608.03689 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_22e0f021a651 (Metraipolis archive dc_22e0f021a651, sha256 9ed7e20308daf529cf4993f5aa7125bac7d8158b586d583bc068de3213f2448a)
BibTeX
@misc{dc22e0f021a651,
  title = {LiveEvalBench: Toward Open-World Evaluation for Web Generation — arXiv:2608.03689},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.03689},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_22e0f021a651; sha256 9ed7e20308daf529cf4993f5aa7125bac7d8158b586d583bc068de3213f2448a},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.03689. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large language models are increasingly capable of synthesizing executable frontend projects, yet existing benchmarks still treat web generation as a static evaluation problem. We argue that frontend artifacts demand a different paradigm: they are interactive rather than static, admit diverse yet equally valid implementations, and evolve faster than rigid pipelines can accommodate. To address these gaps, we present LiveEvalBench, an automated framework that reformulates web-generation evaluation as an agentic, adaptive, and extensible process. LiveEvalBench instantiates evaluation as a collaborative review workflow, in which a Build Engineer, a Code Engineer, and a UI Tester collectively gather evidence across the full lifecycle of a frontend project, from deployment and code inspection to browser-based interaction. To handle implementation diversity, an adaptive protocol couples shared rubrics for cross-model comparability with implementation-grounded criteria tailored to each artifact. The framework further supports incremental integration of new evaluator roles and assessment dimensions without pipeline redesign. Experiments across diverse real-world web-generation scenarios show that LiveEvalBench aligns closely with human expert judgment and provides fine-grained insights into frontier models' web generation capabilities. Code is available at this https URL

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-05 in cs.AI).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Software Engineering (cs.SE).
Pagina del lavoro: https://arxiv.org/abs/2608.03689 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-31T12:05:52.835Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-05?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).