Metraipolis › archive › dc_2ce9003560dc

TALK-Dem: Benchmarking Embodied Task Planning under Dementia-Associated Communication Patterns — arXiv:2609.38371

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.38371
License (as archived)
CC0-1.0
Archived
2026-10-07T13:14:16.173Z
SHA-256 of the archived text
61c043c7108ac58eb8103b56ceb68d41b898a0a9c173fc389df4a2e09b06e68b
Stable URL of this page
https://metraipolis.com/documento/dc_2ce9003560dc

How to cite

TALK-Dem: Benchmarking Embodied Task Planning under Dementia-Associated Communication Patterns — arXiv:2609.38371 — arXiv (en), https://arxiv.org/abs/2609.38371 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_2ce9003560dc (Metraipolis archive dc_2ce9003560dc, sha256 61c043c7108ac58eb8103b56ceb68d41b898a0a9c173fc389df4a2e09b06e68b)
BibTeX
@misc{dc2ce9003560dc,
  title = {TALK-Dem: Benchmarking Embodied Task Planning under Dementia-Associated Communication Patterns — arXiv:2609.38371},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.38371},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_2ce9003560dc; sha256 61c043c7108ac58eb8103b56ceb68d41b898a0a9c173fc389df4a2e09b06e68b},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.38371. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Existing LLM-driven robot task planners rely on a taken-for-granted assumption of an ideal user whose instructions are clear, complete, and task-focused. However, when interacting with real-world users, especially those experiencing cognitive impairments, such as people living with dementia (PLWD), the planners often make mistakes and even pose physical safety risks. We proposed TALK-Dem (Talking Attributes and Linguistic Knowledge in Dementia), the first benchmark for evaluating LLM-driven robot task planning under dementia-associated verbal communication. TALK-Dem contains 4,800 instructions and covers five typical communication patterns, including Referential Imprecision, Object Substitution, Empty Speech, Topic Drift, and Intrusion, at three intensity levels. Experiments across six open-weight LLMs reveal a substantial robustness gap. Across communication patterns, open-weight models exhibited performance drops of up to 22.3 percentage points compared to ideal instructions. This revealed a critical gap and even danger for real-world applications, especially in assistive robotics, where locally deployable models are necessary due to privacy concerns and connectivity constraints. To mitigate this issue, we proposed the Context-Aware Retrieval from Experience (CARE) method, which retrieves relevant previously resolved tasks to provide task-specific interpretation and planning context. CARE generally outperformed standard prompting baselines across the six open-weight models, improving average task success by 18.1 percentage points over the vanilla prompt. These results highlighted the importance of both evaluating communication robustness and developing effective adaptation strategies for locally deployable assistive robots. The TALK-Dem dataset is publicly available at this https URL .

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-10-01 in cs.CL).
Categorie arXiv: Robotics (cs.RO) ; Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2609.38371 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T12:44:51.924Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-10-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).