Metraipolis › archive › dc_60f599673ab9

Does It Render Everywhere? A Study of Cross-Environment Compatibility in MLLM-Generated Webpages — arXiv:2608.12518

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.12518
License (as archived)
CC0-1.0
Archived
2026-10-19T04:40:55.332Z
SHA-256 of the archived text
ba18b2704b1a02560b76b4231e69a18babd0695604314332ad6da5ffcdfeafaf
Stable URL of this page
https://metraipolis.com/documento/dc_60f599673ab9

How to cite

Does It Render Everywhere? A Study of Cross-Environment Compatibility in MLLM-Generated Webpages — arXiv:2608.12518 — arXiv (en), https://arxiv.org/abs/2608.12518 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_60f599673ab9 (Metraipolis archive dc_60f599673ab9, sha256 ba18b2704b1a02560b76b4231e69a18babd0695604314332ad6da5ffcdfeafaf)
BibTeX
@misc{dc60f599673ab9,
  title = {Does It Render Everywhere? A Study of Cross-Environment Compatibility in MLLM-Generated Webpages — arXiv:2608.12518},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.12518},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_60f599673ab9; sha256 ba18b2704b1a02560b76b4231e69a18babd0695604314332ad6da5ffcdfeafaf},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.12518. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Multimodal Large Language Models (MLLMs) have been increasingly adopted to automate webpage generation from visual designs (e.g., screenshots). However, existing evaluations are limited to visual fidelity assessment under a fixed browser-device configuration. Such a setting overlooks the cross-environment rendering compatibility for real-world deployments. To address this gap, we present the first systematic empirical study of cross-environment compatibility in AI-generated webpages. Specifically, we construct WebCompat, a dataset of 2,032 annotated instances, comprising webpages generated by 8 representative AI tools, each rendered across 9 browser-and-device combinations. We analyze the prevalence of compatibility issues, their user-perceptible symptoms, and underlying code-level root causes. Our findings reveal that 68% of generated webpages exhibit at least one compatibility issue, underscoring the pervasive reliability concerns surrounding MLLM-generated front-end artifacts. The most prevalent symptoms are failures that disrupt the entire page layout (88.3%): pages shrink directly to fit the target screen with too small fonts, or exhibit scale mismatches that produce cut-off content. Failures localized to individual elements, such as image distortion or missing components, are comparatively less common (13.4%). Furthermore, although most MLLMs incorporate responsive design patterns into the generation, they fail to properly implement these codes. Guided by the findings, we develop XCompat, a lightweight offline compatibility issue detector that combines visual screenshots and the structural DOM tree for analysis. It achieves an F1 score of 0.903 on the WebCompat-test, outperforming the existing compatibility checking tools and LLM baselines. All datasets and tools are released to support future research on rendering reliability in MLLM-based front-end code generation.

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-08-14 in cs.SE).
Categorie arXiv: Software Engineering (cs.SE).
Pagina del lavoro: https://arxiv.org/abs/2608.12518 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T04:25:15.786Z dalla pagina https://arxiv.org/catchup/cs.SE/2026-08-14?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).