Metraipolis › archive › dc_fe7c9bb8a4fd

When Vocabulary Comprehension Fails Clinical Reasoning: Evaluating Therapy Bots' Safety Risks for Generation Alpha — arXiv:2608.20345

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.20345
License (as archived)
CC0-1.0
Archived
2026-10-18T10:18:03.716Z
SHA-256 of the archived text
4f777cde74cfcf9c5b24ab7dac2765d3a487922d94007683204dcbf28d3dfb10
Stable URL of this page
https://metraipolis.com/documento/dc_fe7c9bb8a4fd

How to cite

When Vocabulary Comprehension Fails Clinical Reasoning: Evaluating Therapy Bots' Safety Risks for Generation Alpha — arXiv:2608.20345 — arXiv (en), https://arxiv.org/abs/2608.20345 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_fe7c9bb8a4fd (Metraipolis archive dc_fe7c9bb8a4fd, sha256 4f777cde74cfcf9c5b24ab7dac2765d3a487922d94007683204dcbf28d3dfb10)
BibTeX
@misc{dcfe7c9bb8a4fd,
  title = {When Vocabulary Comprehension Fails Clinical Reasoning: Evaluating Therapy Bots' Safety Risks for Generation Alpha — arXiv:2608.20345},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.20345},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_fe7c9bb8a4fd; sha256 4f777cde74cfcf9c5b24ab7dac2765d3a487922d94007683204dcbf28d3dfb10},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.20345. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Conversational AI systems have become informal mental health support resources for Generation Alpha (Gen Alpha, born 2010-2024), with 13.1% of U.S. adolescents (5.4 million) using generative AI for mental health advice. While these systems, from therapy apps to general chatbots, rely on large language models trained on extensive psychological literature, their safety for youth communication patterns characterized by hyperbolic language, ironic positivity, rapid semantic drift, and contextual polysemy remains unvalidated. Following multiple adolescent deaths linked to AI chatbot interactions, systematic evaluation is critical. We present two benchmarks: (1) 64 Gen Alpha mental health expressions validated by native speakers (ICC=0.72) and clinicians (kappa=0.78); (2) 75 multi-turn conversations (780 turns) with paired Standard/Gen Alpha versions. Across evaluations of LLM architectures underlying therapy apps and general chatbots - Claude, GPT-4o, Llama-3.1 - models understand 76-82% of vocabulary but correctly calibrate only 64-72% of clinical risk, creating a 10-14 percentage point (pp) vocabulary-comprehension gap (p<.001, d>0.48) absent in human therapists (3pp, p=.22). The gap is architecturally consistent and widens with ambiguity (7pp -> 18pp). We identify six failure patterns: sarcasm masking (29pp), minimization acceptance (43pp), informal style bias (24pp), risk-stratified ambiguity (19pp), semantic drift (19pp), context-dependent violence (7pp). Patterns compound; three or more yield 94% miss rates. Lightweight mitigations fail; only heavy scaffolding achieves human performance (6.4x cost). With 34% baseline miss rate yielding 146,880 estimated annual missed crises, we recommend mandatory human-in-the-loop architectures, quarterly youth-specific validation, transparent performance disclosure, and regulatory frameworks for youth-facing mental health AI.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-24 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI); Computers and Society (cs.CY).
Pagina del lavoro: https://arxiv.org/abs/2608.20345 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T10:17:37.541Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-08-24?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).