Metraipolis › archive › dc_fcd51661ac3b

Evaluating Human-LLM Alignment on Visualization Preference — arXiv:2611.06272

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.06272
License (as archived)
CC0-1.0
Archived
2026-11-05T18:21:23.807Z
SHA-256 of the archived text
a0ff58056b36225c124bd2b90ae4f85fcc24d404d45f9adde01db5980114d0f4
Stable URL of this page
https://metraipolis.com/documento/dc_fcd51661ac3b

How to cite

Evaluating Human-LLM Alignment on Visualization Preference — arXiv:2611.06272 — arXiv (en), https://arxiv.org/abs/2611.06272 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_fcd51661ac3b (Metraipolis archive dc_fcd51661ac3b, sha256 a0ff58056b36225c124bd2b90ae4f85fcc24d404d45f9adde01db5980114d0f4)
BibTeX
@misc{dcfcd51661ac3b,
  title = {Evaluating Human-LLM Alignment on Visualization Preference — arXiv:2611.06272},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.06272},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_fcd51661ac3b; sha256 a0ff58056b36225c124bd2b90ae4f85fcc24d404d45f9adde01db5980114d0f4},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.06272. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

There are often multiple valid visualizations, spanning different chart types, visual encodings, and aesthetic choices, that can all support a user's goal of analyzing a dataset. Determining which of these candidate visualizations is most appropriate, however, remains challenging. Prior work has leveraged expert-curated taxonomies to guide visualization design and subsequent quality evaluation, a practical evaluation model must also account for human-centric factors. Latest visualization tools integrate Large Language Models (LLMs) to generate and refine visualizations, using LLM-as-a-judge to provide design feedback. Without a deeper understanding of whether, and in what ways, human and LLM perceptions of visualizations align, there is a real risk of deploying low-quality agents that do not reflect human judgment. We study this question through a pilot experiment - we formulate the problem as a preference task over curated chart pairs and compare the judgments of state-of-the-art vision models with those of a panel of human annotators. We establish a cautionary tale: such judges risk filtering out informative, compelling displays. We find that frontier models collapse human subjectivity, a rich signal that reveals contrasting design choices, into near-deterministic verdicts.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.HC, nuovi lavori del giorno).
Categorie arXiv: Human-Computer Interaction (cs.HC).
Pagina del lavoro: https://arxiv.org/abs/2611.06272 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-05T18:15:33.980Z dalla pagina https://arxiv.org/list/cs.HC/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).