Metraipolis › archive › dc_538a07660daf
Remembering Is Not Enough: Evaluating Timing and Omission in Longitudinal AI Mental Health Support — arXiv:2611.08721
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.08721
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-09T22:34:31.561Z
- SHA-256 of the archived text
8f9b8ab3681ead34553fd1d92f25b717497c93a1a89a2227470cbed6747a50ba- Stable URL of this page
https://metraipolis.com/documento/dc_538a07660daf
How to cite
Remembering Is Not Enough: Evaluating Timing and Omission in Longitudinal AI Mental Health Support — arXiv:2611.08721 — arXiv (en), https://arxiv.org/abs/2611.08721 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_538a07660daf (Metraipolis archive dc_538a07660daf, sha256 8f9b8ab3681ead34553fd1d92f25b717497c93a1a89a2227470cbed6747a50ba)
BibTeX
@misc{dc538a07660daf,
title = {Remembering Is Not Enough: Evaluating Timing and Omission in Longitudinal AI Mental Health Support — arXiv:2611.08721},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.08721},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_538a07660daf; sha256 8f9b8ab3681ead34553fd1d92f25b717497c93a1a89a2227470cbed6747a50ba},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.08721. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Evaluations of large language models (LLMs) for mental health support commonly focus on the clinical appropriateness of individual responses, potentially overlooking failures that emerge across extended interactions. As AI assistants accumulate memory of users' circumstances and prior disclosures, this raises an accountability question: Do AI chatbots provide appropriate support as users' needs evolve? We investigate by analyzing 14,256 longitudinal simulations grounded in donated chatbot histories from 22 users, examining how a memory-equipped assistant responds to suicidal ideation, self-harm, and anxiety crises across recovery trajectories and communication styles. We introduce the Context-Aware and Readiness-Evaluative (CARE) framework, developed with mental health professionals, to assess the timing and quality of advice, including omissions. Advice was less aligned with users' readiness after a crisis than in matched control stretches of the same conversation, largely because of premature recommendations, which were most common when recovery stalled. Revisiting a crisis reduced premature advice but not lagging advice, and users' communication style changed how often and when the assistant gave recommendations. Although explicitly unproductive advice was rare, the assistant frequently omitted clinician-expected support such as follow-up and planning for next steps. These findings show the limits of single response-level safety evaluation and the need to assess timing, omission, and consistency across users when holding AI systems accountable for longitudinal support. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Computers and Society (cs.CY) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2611.08721 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-09T22:30:47.304Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).