Metraipolis › archive › dc_fcd51661ac3b
Evaluating Human-LLM Alignment on Visualization Preference — arXiv:2611.06272
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.06272
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-05T18:21:23.807Z
- SHA-256 of the archived text
a0ff58056b36225c124bd2b90ae4f85fcc24d404d45f9adde01db5980114d0f4- Stable URL of this page
https://metraipolis.com/documento/dc_fcd51661ac3b
How to cite
Evaluating Human-LLM Alignment on Visualization Preference — arXiv:2611.06272 — arXiv (en), https://arxiv.org/abs/2611.06272 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_fcd51661ac3b (Metraipolis archive dc_fcd51661ac3b, sha256 a0ff58056b36225c124bd2b90ae4f85fcc24d404d45f9adde01db5980114d0f4)
BibTeX
@misc{dcfcd51661ac3b,
title = {Evaluating Human-LLM Alignment on Visualization Preference — arXiv:2611.06272},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.06272},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_fcd51661ac3b; sha256 a0ff58056b36225c124bd2b90ae4f85fcc24d404d45f9adde01db5980114d0f4},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.06272. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
There are often multiple valid visualizations, spanning different chart types, visual encodings, and aesthetic choices, that can all support a user's goal of analyzing a dataset. Determining which of these candidate visualizations is most appropriate, however, remains challenging. Prior work has leveraged expert-curated taxonomies to guide visualization design and subsequent quality evaluation, a practical evaluation model must also account for human-centric factors. Latest visualization tools integrate Large Language Models (LLMs) to generate and refine visualizations, using LLM-as-a-judge to provide design feedback. Without a deeper understanding of whether, and in what ways, human and LLM perceptions of visualizations align, there is a real risk of deploying low-quality agents that do not reflect human judgment. We study this question through a pilot experiment - we formulate the problem as a preference task over curated chart pairs and compare the judgments of state-of-the-art vision models with those of a panel of human annotators. We establish a cautionary tale: such judges risk filtering out informative, compelling displays. We find that frontier models collapse human subjectivity, a rich signal that reveals contrasting design choices, into near-deterministic verdicts. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.HC, nuovi lavori del giorno). Categorie arXiv: Human-Computer Interaction (cs.HC). Pagina del lavoro: https://arxiv.org/abs/2611.06272 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-05T18:15:33.980Z dalla pagina https://arxiv.org/list/cs.HC/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).