Metraipolis › archive › dc_e825cf79cf04
Do large language models rank moral values? A transitivity test of moral competence — arXiv:2611.10265
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.10265
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-10T18:40:51.193Z
- SHA-256 of the archived text
710f109dd6d75a7b0490339dfc3c42f28074b18873aa762d58806f90b4264f26- Stable URL of this page
https://metraipolis.com/documento/dc_e825cf79cf04
How to cite
Do large language models rank moral values? A transitivity test of moral competence — arXiv:2611.10265 — arXiv (en), https://arxiv.org/abs/2611.10265 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e825cf79cf04 (Metraipolis archive dc_e825cf79cf04, sha256 710f109dd6d75a7b0490339dfc3c42f28074b18873aa762d58806f90b4264f26)
BibTeX
@misc{dce825cf79cf04,
title = {Do large language models rank moral values? A transitivity test of moral competence — arXiv:2611.10265},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.10265},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e825cf79cf04; sha256 710f109dd6d75a7b0490339dfc3c42f28074b18873aa762d58806f90b4264f26},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.10265. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
LLMs are increasingly used to support decisions that require moral consideration. While LLMs perform well on morality benchmarks from psychology and philosophy, producing appropriate outputs on these benchmarks (moral performance) does not establish that an LLM weighs competing moral values at stake in a decision (moral competence). We test a minimal, necessary condition for such weighing: that an ordinal ranking can represent LLM moral choices. Such a ranking requires transitivity. To assess transitivity, we presented LLMs with pairwise trade-offs among moral value violations in vignette choice sets and extracted resulting choice probabilities from first-token distributions. Tested against three stochastic transitive choice models, most choice sets admitted weak or unstable orderings. Aggregating an LLM's responses, a common practice in LLM moral evaluation, produced transitive structure that matched no individual choice set. Evaluations of AI morality should establish that choices are structured before asking whether they are aligned. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI) ; Computation and Language (cs.CL); Computers and Society (cs.CY). Pagina del lavoro: https://arxiv.org/abs/2611.10265 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-10T18:37:37.484Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).