Metraipolis › archive › dc_adcd531473c4

You Shouldn't Have Asked: A Pragmatics-Inspired Taxonomy for Evaluating LLM Refusals — arXiv:2608.30856

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.30856
License (as archived)
CC0-1.0
Archived
2026-10-17T08:07:47.668Z
SHA-256 of the archived text
2bb9d4891170a4a2a5b53bcee6bd6519924847b1a2075a076ee2c40b9539e505
Stable URL of this page
https://metraipolis.com/documento/dc_adcd531473c4

How to cite

You Shouldn't Have Asked: A Pragmatics-Inspired Taxonomy for Evaluating LLM Refusals — arXiv:2608.30856 — arXiv (en), https://arxiv.org/abs/2608.30856 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_adcd531473c4 (Metraipolis archive dc_adcd531473c4, sha256 2bb9d4891170a4a2a5b53bcee6bd6519924847b1a2075a076ee2c40b9539e505)
BibTeX
@misc{dcadcd531473c4,
  title = {You Shouldn't Have Asked: A Pragmatics-Inspired Taxonomy for Evaluating LLM Refusals — arXiv:2608.30856},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.30856},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_adcd531473c4; sha256 2bb9d4891170a4a2a5b53bcee6bd6519924847b1a2075a076ee2c40b9539e505},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.30856. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Refusals are often treated as face-threatening acts in pragmatics because they can challenge the requester's socially claimed self-image. Large language models (LLMs) are increasingly trained to refuse unsafe and inappropriate requests, and these refusals may harm users when models fail to manage this interactional cost properly. While existing work has mainly approached LLM non-compliance as a safety-alignment outcome, it does not provide a way to evaluate whether LLMs refuse appropriately across different harmful contexts. To study this question, we propose (to our knowledge) the first taxonomy of LLM refusals that is grounded in pragmatic theory. Applying this taxonomy to responses from 16 modern LLMs across 14 harm categories, we find that although models differ in how they refuse, their refusals are overall explicit and strongly morally evaluative, with interactional repair occurring mainly through offering or providing safer alternatives instead of interpersonal facework. This pattern is especially consequential in sensitive harm contexts, where overuse of negative framing may make users feel shamed or provoked, undermining the purpose of safe non-compliance. We therefore call for alignment evaluation that considers not only whether models refuse harmful requests, but also whether they refuse in ways that are contextually adaptive and socially accountable for the interactional consequences of saying no.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-01 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL) ; Human-Computer Interaction (cs.HC).
Pagina del lavoro: https://arxiv.org/abs/2608.30856 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T07:47:52.861Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).