Metraipolis › archive › dc_cef2377c5201

Position: We Need Large Language Models Optimized For Our Well-Being — arXiv:2608.07505

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.07505
License (as archived)
CC0-1.0
Archived
2026-10-19T08:54:53.460Z
SHA-256 of the archived text
e971dbf82255070bba7b90d2204ba7ca3cba36316678ed872e12b4fb1897d2a8
Stable URL of this page
https://metraipolis.com/documento/dc_cef2377c5201

How to cite

Position: We Need Large Language Models Optimized For Our Well-Being — arXiv:2608.07505 — arXiv (en), https://arxiv.org/abs/2608.07505 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_cef2377c5201 (Metraipolis archive dc_cef2377c5201, sha256 e971dbf82255070bba7b90d2204ba7ca3cba36316678ed872e12b4fb1897d2a8)
BibTeX
@misc{dccef2377c5201,
  title = {Position: We Need Large Language Models Optimized For Our Well-Being — arXiv:2608.07505},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.07505},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_cef2377c5201; sha256 e971dbf82255070bba7b90d2204ba7ca3cba36316678ed872e12b4fb1897d2a8},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.07505. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large language models are useful because we taught them to give us what we want. This works when success can be judged immediately, but people increasingly bring these systems their relationships, hard decisions, and long-term goals, where what a user wants to hear and what serves them best are frequently different. We argue that LLM providers should offer at least one widely accessible, opt-in mode optimized and evaluated for long-term well-being rather than next-turn approval. This is a pressing need, as models have been found to endorse questionable framings well above human baselines, users take AI advice readily without their well-being improving, and sycophantic models raise dependence while lowering prosocial intent. The mentors, coaches, and therapists we trust with our long-term development earn that trust by being willing to say what we do not want to hear, and LLMs should do the same. We propose three principles---change the objective, give users explicit relational roles, avoid paternalism---and organize the design space around three choices the current objective makes implicitly: the horizon over which well-being is measured (When), whose interests it represents (Who), and what role the assistant plays (How).

Tema degli esploratori: governance digitale e beni comuni (retro-catalogo arXiv: annunci del 2026-08-11 in cs.CY).
Categorie arXiv: Computers and Society (cs.CY) ; Human-Computer Interaction (cs.HC).
Pagina del lavoro: https://arxiv.org/abs/2608.07505 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T08:51:53.726Z dalla pagina https://arxiv.org/catchup/cs.CY/2026-08-11?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).