Metraipolis › archive › dc_77dad021a7b5

Mitigating Social Sycophancy via Pluralistic Preference Optimization — arXiv:2610.02568

Source
arXiv
Original
https://arxiv.org/abs/2610.02568
License (as archived)
CC0-1.0
Archived
2026-10-05T22:49:03.427Z
SHA-256 of the archived text
fce70e197755b9fd947356729c0acef39bd8ca715126bfea36e1fdd914da7b5b
Stable URL of this page
https://metraipolis.com/documento/dc_77dad021a7b5

How to cite

Mitigating Social Sycophancy via Pluralistic Preference Optimization — arXiv:2610.02568 — arXiv, https://arxiv.org/abs/2610.02568 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_77dad021a7b5 (Metraipolis archive dc_77dad021a7b5, sha256 fce70e197755b9fd947356729c0acef39bd8ca715126bfea36e1fdd914da7b5b)
BibTeX
@misc{dc77dad021a7b5,
  title = {Mitigating Social Sycophancy via Pluralistic Preference Optimization — arXiv:2610.02568},
  howpublished = {arXiv},
  url = {https://arxiv.org/abs/2610.02568},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_77dad021a7b5; sha256 fce70e197755b9fd947356729c0acef39bd8ca715126bfea36e1fdd914da7b5b},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv, https://arxiv.org/abs/2610.02568. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Personal advice, including relationship advice, now ranks among the most common uses of generative AI. But language models (LMs) exhibit sycophancy: they affirm users much more often than humans do, which can make people overconfident and less willing to repair their relationships after a conflict. Prior work on mitigating sycophancy has focused on factual settings where a response can be checked against a ground truth answer, while mitigations for social sycophancy (e.g., personal advice, where there is no ground truth) have relied on simple prompting and post-training methods with limited effectiveness. Our insight is that social sycophancy occurs in part because LMs overly center on the user and fail to consider the perspectives of other stakeholders impacted by the user's behavior. To address this problem we propose Pluralistic Preference Optimization (PlurPO): given inputs describing interpersonal conflicts, the LM identifies and simulates the relevant stakeholders, and is then trained to prefer and generate responses acceptable to all stakeholders. PlurPO uses only signals the model produces about its own outputs, without ground-truth labels. PlurPO substantially reduces social sycophancy across four datasets and four model families compared to prior methods. For example, on statements of intent to cause harm, where the users' actions should not be endorsed, PlurPO reduces the endorsement rate by 89% on average across four models. On general advice questions, where the target is to match the endorsement rate of human responses, it closes the gap by more than half, from 17.8% to 8.0% on average. The preference dataset constructed by PlurPO for an 8B model also effectively transfers to mitigating sycophancy in a larger (32B) model. Our results indicate that social sycophancy can be reduced by leveraging a model's own capabilities to simulate a plurality of relevant perspectives.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2610.02568 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-05T22:45:55.600Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).