Metraipolis › archive › dc_2ffb3877ec38

TriageRAG: Failure-Aware Self-Training for Adapting Retrieval-Augmented Language Models to Specialized Domains — arXiv:2610.33776

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.33776
License (as archived)
CC0-1.0
Archived
2026-10-27T08:00:28.808Z
SHA-256 of the archived text
a6a71322ed4deff1e395579e850703473e2ed39ec5f9f91e9994404d6b7af0a0
Stable URL of this page
https://metraipolis.com/documento/dc_2ffb3877ec38

How to cite

TriageRAG: Failure-Aware Self-Training for Adapting Retrieval-Augmented Language Models to Specialized Domains — arXiv:2610.33776 — arXiv (en), https://arxiv.org/abs/2610.33776 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_2ffb3877ec38 (Metraipolis archive dc_2ffb3877ec38, sha256 a6a71322ed4deff1e395579e850703473e2ed39ec5f9f91e9994404d6b7af0a0)
BibTeX
@misc{dc2ffb3877ec38,
  title = {TriageRAG: Failure-Aware Self-Training for Adapting Retrieval-Augmented Language Models to Specialized Domains — arXiv:2610.33776},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.33776},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_2ffb3877ec38; sha256 a6a71322ed4deff1e395579e850703473e2ed39ec5f9f91e9994404d6b7af0a0},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.33776. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Retrieval-augmented generation (RAG) lets large language models (LLMs) answer knowledge-intensive questions from retrieved evidence, but adapting a general-purpose RAG system to a specialized domain such as medicine is difficult when only an unlabeled corpus is available. Self-training approaches such as SimRAG address this by letting the LLM write its own question-answer pairs from domain passages and fine-tuning on the pairs that survive a round-trip consistency filter. We observe that these approaches treat every retained example identically: they never ask whether the student already knows the answer, already extracts it correctly from the retrieved context, or fails - and if so, whether the failure lies with the reader or with the retriever. To tackle this, we propose TriageRAG, a failure-aware self-training approach that probes the student on each self-generated question with and without retrieved context, triages it into one of four categories (known, solved, context-failure, retrieval-failure), and routes each category to the training signal that addresses it, including a parametric route that teaches the reader to answer when retrieval misses. Probing is cheap and repeated every round, so the training mixture follows the student, and the triage histogram doubles as a label-free diagnostic of where the domain gap lies. Experiments on 11 datasets spanning three domains with a Qwen3-4B backbone, and on CS-Bench with Qwen3-8B, demonstrate that TriageRAG outperforms a budget-matched SimRAG by 1.2-6.4 points and is the only method that recovers the closed-book level in every case where retrieval hurts the base model. A single ablation identifies the mechanism: round-trip filtering removes every training context that lacks the evidence, and a reader that never sees such contexts learns to over-trust noisy retrieval.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2610.33776 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-27T07:55:30.851Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).