Metraipolis › archive › dc_ddbf81de2939

Beyond Right and Wrong: Evaluating Second-order Social Reasoning in Large Language Models — arXiv:2609.05437

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.05437
License (as archived)
CC0-1.0
Archived
2026-10-16T13:23:49.327Z
SHA-256 of the archived text
d306fdc0f45938cb35a3508013c07b5e6307ce0f7ba410e011ded34ff17b0df6
Stable URL of this page
https://metraipolis.com/documento/dc_ddbf81de2939

How to cite

Beyond Right and Wrong: Evaluating Second-order Social Reasoning in Large Language Models — arXiv:2609.05437 — arXiv (en), https://arxiv.org/abs/2609.05437 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ddbf81de2939 (Metraipolis archive dc_ddbf81de2939, sha256 d306fdc0f45938cb35a3508013c07b5e6307ce0f7ba410e011ded34ff17b0df6)
BibTeX
@misc{dcddbf81de2939,
  title = {Beyond Right and Wrong: Evaluating Second-order Social Reasoning in Large Language Models — arXiv:2609.05437},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.05437},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ddbf81de2939; sha256 d306fdc0f45938cb35a3508013c07b5e6307ce0f7ba410e011ded34ff17b0df6},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.05437. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Previous AI alignment efforts have focused primarily on first-order social norms -- teaching models what is socially acceptable or unacceptable (e.g., `do not steal'). However, social intelligence depends not only on norm recognition, but also on anticipating who will enforce it and how (e.g., public shame or even imprisonment). These second-order expectations, known as metanorms, govern how people respond when social rules are broken. We introduce a novel framework for evaluating metanorm reasoning in Large Language Models (LLMs) along two dimensions: emotional appraisal and behavioral response, and propose new classification tasks, namely, predicting self-regulation in violators, and other-regulation in observers. We release a multi-perspective dataset, NormReact, of 450 norm violation scenarios, hand-annotated for emotions and behavioral responses across norm violators' gender and observers' social closeness. Current LLMs portray a harsher social world: across six models, they overpredict negative sanctions where humans would expect inaction, and alignment with human judgments deteriorates as social distance increases. These findings suggest that AI systems in norm-sensitive domains from conflict mediation to policy simulation, may risk producing a distorted picture of social regulation: one that over-represents punishment and under-represents the tolerance, restraint, and relational calibration that characterize actual norm enforcement in real world.

Tema degli esploratori: governance digitale e beni comuni (retro-catalogo arXiv: annunci del 2026-09-09 in cs.CY).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Computers and Society (cs.CY).
Pagina del lavoro: https://arxiv.org/abs/2609.05437 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T13:05:53.938Z dalla pagina https://arxiv.org/catchup/cs.CY/2026-09-09?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).