Metraipolis › archive › dc_e5cebdc37dbe
PerSo: Investigating Facets of LLMs' Social Intelligence in Real-World Persuasion Scenarios — arXiv:2610.20548
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.20548
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-15T20:03:03.608Z
- SHA-256 of the archived text
dfc748c9e569361b3966b4b45f7474be05702c4a2c913c88ae8ad0b1903924a2- Stable URL of this page
https://metraipolis.com/documento/dc_e5cebdc37dbe
How to cite
PerSo: Investigating Facets of LLMs' Social Intelligence in Real-World Persuasion Scenarios — arXiv:2610.20548 — arXiv (en), https://arxiv.org/abs/2610.20548 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e5cebdc37dbe (Metraipolis archive dc_e5cebdc37dbe, sha256 dfc748c9e569361b3966b4b45f7474be05702c4a2c913c88ae8ad0b1903924a2)
BibTeX
@misc{dce5cebdc37dbe,
title = {PerSo: Investigating Facets of LLMs' Social Intelligence in Real-World Persuasion Scenarios — arXiv:2610.20548},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.20548},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e5cebdc37dbe; sha256 dfc748c9e569361b3966b4b45f7474be05702c4a2c913c88ae8ad0b1903924a2},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.20548. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Understanding the social intelligence of large language models (LLMs) is increasingly important for applications involving human-AI interaction and multi-agent environments. Social intelligence comprises two aspects: cognitive intelligence, the ability to infer others' mental states, and behavioral intelligence, the ability to select appropriate social actions based on these inferences to achieve social goals. Persuasion provides a natural testbed in which both aspects are simultaneously at play, yet prior benchmarks typically evaluate them in isolation using synthetic scenarios. We introduce PerSo, a benchmark that evaluates both aspects on real-world persuasion dialogues from Reddit's ChangeMyView community, using an LLM-in-the-loop pipeline to construct the evaluation tasks, validated through human annotation. Our evaluation of diverse LLMs shows that performance generally scales with model size but varies across dimensions. The strongest LLM slightly surpasses the best observed human performance on the behavioral task, while the best human participant remains ahead on the cognitive task. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI); Social and Information Networks (cs.SI). Pagina del lavoro: https://arxiv.org/abs/2610.20548 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-15T19:35:48.430Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).