Metraipolis › archive › dc_f7bc028c0052
Thinking Inertia: LLMs Keep Thinking When Told Not To — arXiv:2610.11765
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.11765
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-09T06:13:17.397Z
- SHA-256 of the archived text
6a4c0685dd2ef31c7ac581ae8aaba89a5345547a26f83010f7184c7c71f0ec43- Stable URL of this page
https://metraipolis.com/documento/dc_f7bc028c0052
How to cite
Thinking Inertia: LLMs Keep Thinking When Told Not To — arXiv:2610.11765 — arXiv (en), https://arxiv.org/abs/2610.11765 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f7bc028c0052 (Metraipolis archive dc_f7bc028c0052, sha256 6a4c0685dd2ef31c7ac581ae8aaba89a5345547a26f83010f7184c7c71f0ec43)
BibTeX
@misc{dcf7bc028c0052,
title = {Thinking Inertia: LLMs Keep Thinking When Told Not To — arXiv:2610.11765},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.11765},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f7bc028c0052; sha256 6a4c0685dd2ef31c7ac581ae8aaba89a5345547a26f83010f7184c7c71f0ec43},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.11765. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Large Language Models (LLMs) increasingly ship with explicit "thinking modes", yet their counterpart, "no-thinking", has received far less attention. We study LLMs' no-thinking behavior along two axes. a. How to measure no-thinking? Prior work typically defines no-thinking through proxies such as a disabled thinking mode or the absence of long traces. These proxies are unreliable: disabled thinking modes may still emit reasoning, while long traces may contain filler rather than genuine inference. We instead normalize each response into a pre-answer trace and final answer, and evaluate it at three levels: (i) Empty-Thinking Rate for strict answer-only compliance; (ii) instruction-aware Question-Pre-answer Relevance for similarity between the question and pre-answer trace; and (iii) LLM-as-judge Explicit Inference Rate for visible explicit inference. Together, these metrics distinguish answer-only output, relevant but non-inferential text, and explicit inference. b. How does no-thinking vary across tasks and models? We evaluate six prompting interventions on six LLMs across Boolean, multiple-choice, and open-ended questions. We find that explicit no-think controls cannot reliably eliminate visible inference. Models instead exhibit "Thinking Inertia": explicit inference persists even under strict controls and becomes more prevalent as the answer space opens. Accuracy remains stable on Boolean and multiple-choice tasks, whereas open-ended tasks reveal a trade-off between answer-only compliance and task accuracy. Rewriting the same questions across answer spaces shows that supplying candidate answers makes answer-only responses easier to produce. These findings establish no-thinking as a non-trivial capability: stopping explicit reasoning cannot be assumed from model settings or instructions alone and deserves systematic evaluation alongside reasoning ability. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.CL, nuovi lavori del giorno). Categorie arXiv: Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2610.11765 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-09T05:47:15.293Z dalla pagina https://arxiv.org/list/cs.CL/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).