Metraipolis › archive › dc_8ce83da50787
Tool-Augmented On-Policy Distillation for LLM Domain Adaptation in Sequence-Based Omics Tasks — arXiv:2609.23435
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.23435
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-09T06:50:35.186Z
- SHA-256 of the archived text
53c6b8314535fef8a3e8cba25d475593f095c49e06b89287f317c60ed0412df9- Stable URL of this page
https://metraipolis.com/documento/dc_8ce83da50787
How to cite
Tool-Augmented On-Policy Distillation for LLM Domain Adaptation in Sequence-Based Omics Tasks — arXiv:2609.23435 — arXiv (en), https://arxiv.org/abs/2609.23435 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_8ce83da50787 (Metraipolis archive dc_8ce83da50787, sha256 53c6b8314535fef8a3e8cba25d475593f095c49e06b89287f317c60ed0412df9)
BibTeX
@misc{dc8ce83da50787,
title = {Tool-Augmented On-Policy Distillation for LLM Domain Adaptation in Sequence-Based Omics Tasks — arXiv:2609.23435},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.23435},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_8ce83da50787; sha256 53c6b8314535fef8a3e8cba25d475593f095c49e06b89287f317c60ed0412df9},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.23435. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Multi-omics sequences contain complex biological patterns, yet deciphering their mechanisms for automated scientific discovery remains challenging. As large language models (LLMs) interpret these sequences, evaluating both predictions and scientific reasoning is critical. However, existing benchmarks for multi-omics sequence tasks rely on classification and regression metrics, neglecting whether models grasp the underlying biological evidence. We introduce OmicsBench, the first reasoning benchmark for multi-omics sequences, comprising 1,160 expert-validated questions across six tasks spanning DNA regulation, RNA processing, and protein function. OmicsBench requires traceable evidence chains, evaluated using instance-specific rubrics developed with domain experts. Evaluating 17 LLMs reveals an inverse relationship: while scientific LLMs outperform general-purpose LLMs in sequence classification accuracy, they fail to provide valid evidence to support their predictions. One plausible interpretation is shortcut learning: specialized models may rely on statistical patterns rather than the biological mechanisms needed for scientific discovery. Motivated by this finding, we introduce tool-augmented on-policy distillation (TA-OPD), a post-training method to align sequence prediction with evidence-grounded biological reasoning. Across five Qwen3.5 models spanning 0.8B to 27B parameters, TA-OPD consistently strengthens biological evidence grounding while improving predictive performance on most tasks. These gains persist across model scales, indicating that stronger sequence reasoning does not arise solely from increased model capacity, but can be improved through evidence-aware training. Together, OmicsBench and TA-OPD provide a framework for diagnosing reasoning failures in multi-omics LLMs and a path toward models whose predictions are better grounded in biologically meaningful evidence. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-22 in cs.CL). Categorie arXiv: Machine Learning (cs.LG) ; Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2609.23435 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-09T06:48:45.122Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-22?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).