Metraipolis › archive › dc_cb46872ad4bd

Beyond Preference Following: Benchmarking Profile-Query Arbitration in Personalized Text Transformation — arXiv:2610.39550

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.39550
License (as archived)
CC0-1.0
Archived
2026-11-01T02:22:49.106Z
SHA-256 of the archived text
810c00e2c951da1844da6b19a4b5a548a5feefecca4d90bb240c8440e2bca10f
Stable URL of this page
https://metraipolis.com/documento/dc_cb46872ad4bd

How to cite

Beyond Preference Following: Benchmarking Profile-Query Arbitration in Personalized Text Transformation — arXiv:2610.39550 — arXiv (en), https://arxiv.org/abs/2610.39550 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_cb46872ad4bd (Metraipolis archive dc_cb46872ad4bd, sha256 810c00e2c951da1844da6b19a4b5a548a5feefecca4d90bb240c8440e2bca10f)
BibTeX
@misc{dccb46872ad4bd,
  title = {Beyond Preference Following: Benchmarking Profile-Query Arbitration in Personalized Text Transformation — arXiv:2610.39550},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.39550},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_cb46872ad4bd; sha256 810c00e2c951da1844da6b19a4b5a548a5feefecca4d90bb240c8440e2bca10f},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.39550. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Writing assistants use persistent preferences to personalize responses, but these can conflict with the current request. Responses can meet every requirement yet serve the task poorly, while task failures need not involve following a conflicting preference. We introduce Profile Conflict Arbitration (PCA-Bench), a benchmark of 64 rewriting tasks and 256 task-preference pairs. We construct these pairs by varying the profile preference for each fixed text and request, covering different relations between the preference and the request. We assess whether responses meet requirements, how well they achieve the request's goals, and whether they follow preferences. Across three LLMs, we find that when preferences compete with task goals, a higher success rate in meeting both requirements and preferences does not mean better responses: it can come with a greater quality loss compared with responses without a profile. Similar rates of preference following do not imply the same ability to meet the current task's requirements when preferences conflict with them.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.HC, nuovi lavori del giorno).
Categorie arXiv: Human-Computer Interaction (cs.HC).
Pagina del lavoro: https://arxiv.org/abs/2610.39550 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-01T02:12:28.276Z dalla pagina https://arxiv.org/list/cs.HC/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).