Metraipolis › archive › dc_211b36b4b2fd
How User-AI Mistreatment Occurs and Matters in Conversational Systems? — arXiv:2609.13579
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.13579
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-15T22:46:53.956Z
- SHA-256 of the archived text
921c23dad92eb58c344dfe5d3c2821a4c51c7afc355df42f9a6006a4326d956c- Stable URL of this page
https://metraipolis.com/documento/dc_211b36b4b2fd
How to cite
How User-AI Mistreatment Occurs and Matters in Conversational Systems? — arXiv:2609.13579 — arXiv (en), https://arxiv.org/abs/2609.13579 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_211b36b4b2fd (Metraipolis archive dc_211b36b4b2fd, sha256 921c23dad92eb58c344dfe5d3c2821a4c51c7afc355df42f9a6006a4326d956c)
BibTeX
@misc{dc211b36b4b2fd,
title = {How User-AI Mistreatment Occurs and Matters in Conversational Systems? — arXiv:2609.13579},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.13579},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_211b36b4b2fd; sha256 921c23dad92eb58c344dfe5d3c2821a4c51c7afc355df42f9a6006a4326d956c},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.13579. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Safety research often focuses on model-generated harms, but users may also direct hostility, coercion, and adversarial pressure at models. Understanding how and when that occurs is essential for accurately interpreting model behaviour, alignment drift, and real-world deployment risks. In this paper, we audit 777K English LMSYS-Chat-1M conversations with two independent detectors: an eight-category lexicon for hostility directed at the model, and the dataset's moderation signal; and show that they capture different, weakly overlapping phenomena. The lexicon identifies insults, threats, and jailbreak coercion aimed at the assistant, while moderation flags are dominated by toxic-content solicitation rather than hostility at the model. Together, they mark about 5% of user turns; adjusting the narrower lexicon-harassment union for measured precision puts mistreatment aimed at the assistant at 0.90%. These absolute rates describe arena-style evaluation traffic and should not be read as deployment-wide base rates. We find that user hostility varies 13-fold across models, driven largely by who each model attracts rather than by model behaviour: first-turn hostility spreads far wider than post-response hostility, and more than fifteenfold separates the extremes even after deduplicating opening prompts. Within conversations, assistant apologies are consistently associated with higher odds of next-turn hostility under both detectors; the effect survives restricting to non-refused prior turns and to jailbreak-free conversations, and is positive in 20 of 23 models. Yet across models, more apologetic models receive less hostility overall. Finally, hostility also shows temporal structure, with coercive openings front-loading the first turn while affective hostility accumulates over a session. We release the lexicon, the detector cross-validation pipeline, and all derived tables. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-15 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI) ; Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC). Pagina del lavoro: https://arxiv.org/abs/2609.13579 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-15T22:29:03.092Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-15?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).