Metraipolis › archive › dc_ddbf81de2939
Beyond Right and Wrong: Evaluating Second-order Social Reasoning in Large Language Models — arXiv:2609.05437
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.05437
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T13:23:49.327Z
- SHA-256 of the archived text
d306fdc0f45938cb35a3508013c07b5e6307ce0f7ba410e011ded34ff17b0df6- Stable URL of this page
https://metraipolis.com/documento/dc_ddbf81de2939
How to cite
Beyond Right and Wrong: Evaluating Second-order Social Reasoning in Large Language Models — arXiv:2609.05437 — arXiv (en), https://arxiv.org/abs/2609.05437 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ddbf81de2939 (Metraipolis archive dc_ddbf81de2939, sha256 d306fdc0f45938cb35a3508013c07b5e6307ce0f7ba410e011ded34ff17b0df6)
BibTeX
@misc{dcddbf81de2939,
title = {Beyond Right and Wrong: Evaluating Second-order Social Reasoning in Large Language Models — arXiv:2609.05437},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.05437},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ddbf81de2939; sha256 d306fdc0f45938cb35a3508013c07b5e6307ce0f7ba410e011ded34ff17b0df6},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.05437. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Previous AI alignment efforts have focused primarily on first-order social norms -- teaching models what is socially acceptable or unacceptable (e.g., `do not steal'). However, social intelligence depends not only on norm recognition, but also on anticipating who will enforce it and how (e.g., public shame or even imprisonment). These second-order expectations, known as metanorms, govern how people respond when social rules are broken. We introduce a novel framework for evaluating metanorm reasoning in Large Language Models (LLMs) along two dimensions: emotional appraisal and behavioral response, and propose new classification tasks, namely, predicting self-regulation in violators, and other-regulation in observers. We release a multi-perspective dataset, NormReact, of 450 norm violation scenarios, hand-annotated for emotions and behavioral responses across norm violators' gender and observers' social closeness. Current LLMs portray a harsher social world: across six models, they overpredict negative sanctions where humans would expect inaction, and alignment with human judgments deteriorates as social distance increases. These findings suggest that AI systems in norm-sensitive domains from conflict mediation to policy simulation, may risk producing a distorted picture of social regulation: one that over-represents punishment and under-represents the tolerance, restraint, and relational calibration that characterize actual norm enforcement in real world. Tema degli esploratori: governance digitale e beni comuni (retro-catalogo arXiv: annunci del 2026-09-09 in cs.CY). Categorie arXiv: Artificial Intelligence (cs.AI) ; Computers and Society (cs.CY). Pagina del lavoro: https://arxiv.org/abs/2609.05437 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T13:05:53.938Z dalla pagina https://arxiv.org/catchup/cs.CY/2026-09-09?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).