Metraipolis › archive › dc_dd47a46799fe
Explaining Textual Entailment with Lexical Entailments: Using LLMs to Supply Lexical Relations for Formal Proofs — arXiv:2609.32491
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.32491
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T21:00:16.435Z
- SHA-256 of the archived text
ff7b1f3a158e6600df5d8fb98442dd96b600b3076e9d9f17c523364745127f9b- Stable URL of this page
https://metraipolis.com/documento/dc_dd47a46799fe
How to cite
Explaining Textual Entailment with Lexical Entailments: Using LLMs to Supply Lexical Relations for Formal Proofs — arXiv:2609.32491 — arXiv (en), https://arxiv.org/abs/2609.32491 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_dd47a46799fe (Metraipolis archive dc_dd47a46799fe, sha256 ff7b1f3a158e6600df5d8fb98442dd96b600b3076e9d9f17c523364745127f9b)
BibTeX
@misc{dcdd47a46799fe,
title = {Explaining Textual Entailment with Lexical Entailments: Using LLMs to Supply Lexical Relations for Formal Proofs — arXiv:2609.32491},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.32491},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_dd47a46799fe; sha256 ff7b1f3a158e6600df5d8fb98442dd96b600b3076e9d9f17c523364745127f9b},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.32491. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Large Language Models (LLMs) are highly capable of natural language reasoning and appear to store a great deal of lexical knowledge, but it is still unclear how much of this knowledge they actually use when reasoning, and whether they use it in the right way. On the other hand, logic-based Natural Language Inference (NLI) systems provide transparent and formally grounded reasoning, but they need to be supplied with rich lexical knowledge to prove inferences beyond purely logical ones. In this paper, we evaluate whether LLMs can identify all lexical knowledge needed to solve NLI problems and how much this knowledge contributes to proof search in a logic-based NLI system. Our research focuses exclusively on structured lexical entailments (e.g., chinchilla$\sqsubseteq$small animal) as a proxy for structured explanations for NLI problems with an entailment label. First, we curate a dataset for a new task of explaining sentential entailments with a set of lexical entailments. The dataset is used to intrinsically evaluate LLMs on generating structured lexical explanations. Then, we use NLI as an extrinsic evaluation in a simple neuro-symbolic setting, assessing whether LLMs can supply sufficient lexical relations to LangPro, a natural-logic theorem prover for natural language. The results show that the proposed task remains challenging even for hosted proprietary LLMs, and that their contribution to theorem proving is moderate: generated relations are often only partially sound and may be tailored to the specific NLI problem rather than representing generally valid lexical knowledge. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.AI). Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2609.32491 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T20:29:02.349Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).