Metraipolis › archive › dc_21206d166dc6

Conversational Interaction for LLM-Based Clinical Text-to-SQL: A User Study with Healthcare Professionals — arXiv:2611.00605

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.00605
License (as archived)
CC0-1.0
Archived
2026-11-03T18:12:05.745Z
SHA-256 of the archived text
e0e30fdc28f332c42558cd97a50581977ab0488770e8aba5d5235894d8686374
Stable URL of this page
https://metraipolis.com/documento/dc_21206d166dc6

How to cite

Conversational Interaction for LLM-Based Clinical Text-to-SQL: A User Study with Healthcare Professionals — arXiv:2611.00605 — arXiv (en), https://arxiv.org/abs/2611.00605 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_21206d166dc6 (Metraipolis archive dc_21206d166dc6, sha256 e0e30fdc28f332c42558cd97a50581977ab0488770e8aba5d5235894d8686374)
BibTeX
@misc{dc21206d166dc6,
  title = {Conversational Interaction for LLM-Based Clinical Text-to-SQL: A User Study with Healthcare Professionals — arXiv:2611.00605},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.00605},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_21206d166dc6; sha256 e0e30fdc28f332c42558cd97a50581977ab0488770e8aba5d5235894d8686374},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.00605. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Conversational text-to-SQL interfaces could give healthcare professionals natural-language access to electronic health record (EHR) data, but evidence for their real-world usability remains limited: prior evaluations have relied largely on curated benchmarks with fully specified questions or on simulated users. We report a user study in which 14 physicians who regularly work with EHR data used both a single-turn and a conversational multi-turn text-to-SQL interface over the MIMIC-IV database in a within-subjects design; dialogue analyses additionally drew on interaction logs from 21 healthcare professionals across the main study and two pilot studies. The conversational interface was consistently favored: mean System Usability Scale scores rose from 68.2, near the industry average, to 85.9 (p<0.001), with significant advantages across technology-acceptance constructs including performance expectancy, effort expectancy, self-efficacy, and behavioral intention. In post-study forced-choice comparisons, 93% of participants reported greater overall satisfaction with the conversational interface, 86% preferred it for real-world adoption, and 71% trusted its results more; no participant preferred or trusted the single-turn interface more. Turn-level analysis of 425 logged user turns showed that freely composed queries triggered clarification requests in 24.8% of cases versus 1.8% for predefined, fully specified questions, and 64.3% of clarification episodes stemmed from EHR- or clinical-domain knowledge. Conversational interaction is a practical prerequisite, rather than a convenience, for natural-language EHR access. The frequent need for clarification in realistic clinical queries further underscores the importance of conversational interfaces, while benchmark-style evaluation can substantially underrepresent the ambiguity of real clinical use.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Human-Computer Interaction (cs.HC).
Pagina del lavoro: https://arxiv.org/abs/2611.00605 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T18:09:53.299Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).