Metraipolis › archive › dc_91fda4cd888f

Reading Anxiety or Reading the Label? Comparing Fine-Tuned and Frontier Models for Anxiety Detection on Social Media — arXiv:2609.20847

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.20847
License (as archived)
CC0-1.0
Archived
2026-10-10T01:27:04.704Z
SHA-256 of the archived text
f90e59679df0f1c312821cdb4d1bb9e82f8d800aae97b8af2b8439c9f9582a24
Stable URL of this page
https://metraipolis.com/documento/dc_91fda4cd888f

How to cite

Reading Anxiety or Reading the Label? Comparing Fine-Tuned and Frontier Models for Anxiety Detection on Social Media — arXiv:2609.20847 — arXiv (en), https://arxiv.org/abs/2609.20847 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_91fda4cd888f (Metraipolis archive dc_91fda4cd888f, sha256 f90e59679df0f1c312821cdb4d1bb9e82f8d800aae97b8af2b8439c9f9582a24)
BibTeX
@misc{dc91fda4cd888f,
  title = {Reading Anxiety or Reading the Label? Comparing Fine-Tuned and Frontier Models for Anxiety Detection on Social Media — arXiv:2609.20847},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.20847},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_91fda4cd888f; sha256 f90e59679df0f1c312821cdb4d1bb9e82f8d800aae97b8af2b8439c9f9582a24},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.20847. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Anxiety is among the most common mental health conditions, and people often write about it online well before seeking clinical help. Practitioners building detection tools face a concrete choice: call a frontier commercial model, fine-tune a smaller model in-house, or deploy a conventional classifier. We compare six conditions spanning all three on a held-out Reddit test set under a single controlled protocol. We also identify a confound in how this task is evaluated. In the corpus used here, 69.3% of anxiety-labelled posts contain the word "anxiety" or a variant, roughly twice the rate of comparable conditions, so a classifier can score well by keyword matching rather than by modelling the language of the condition. We therefore evaluate every model twice, on original text and with those terms deleted, and report the difference as lexical dependence. A frontier model leads on anxiety F1 (0.846), but a 110M-parameter domain-adapted encoder reaches 0.831 with no external API dependency, and mental-health domain pretraining accounts for only 0.7 of those points. Lexical dependence spans 8.6 to 25.4 points and does not track model capability: the LoRA fine-tuned 3B model is the most keyword-dependent condition tested, above even a TF-IDF classifier, while the frontier zero-shot model is the least. Published figures on this corpus are therefore upper bounds, and the inflation is largest for the fine-tuned models such figures typically report.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-21 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL) ; Social and Information Networks (cs.SI).
Pagina del lavoro: https://arxiv.org/abs/2609.20847 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-10T01:00:30.258Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-21?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).