Metraipolis › archive › dc_2efc816dd793

VetScore: Risk-Weighted Fact Verification for Veterinary Long-Form QA with Citations — arXiv:2608.03675

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.03675
License (as archived)
CC0-1.0
Archived
2026-10-31T12:31:09.771Z
SHA-256 of the archived text
3f24f4b5638c0ec8c2be9e1b6d54f685445adb86807625ddbf03c55f32f29c63
Stable URL of this page
https://metraipolis.com/documento/dc_2efc816dd793

How to cite

VetScore: Risk-Weighted Fact Verification for Veterinary Long-Form QA with Citations — arXiv:2608.03675 — arXiv (en), https://arxiv.org/abs/2608.03675 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_2efc816dd793 (Metraipolis archive dc_2efc816dd793, sha256 3f24f4b5638c0ec8c2be9e1b6d54f685445adb86807625ddbf03c55f32f29c63)
BibTeX
@misc{dc2efc816dd793,
  title = {VetScore: Risk-Weighted Fact Verification for Veterinary Long-Form QA with Citations — arXiv:2608.03675},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.03675},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_2efc816dd793; sha256 3f24f4b5638c0ec8c2be9e1b6d54f685445adb86807625ddbf03c55f32f29c63},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.03675. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Citation excerpts can be used to increase the reliability of generated outputs and their faithfulness to cited sources, which is especially important in high-stakes domains such as human and veterinary medicine. However, this does not guarantee that generated claims are faithful to the provided excerpts. We present VetScore, a multi-step evaluation method for veterinary long-form question answering, designed to assess how well are generated claims supported by the provided excerpts, weighing this information by each claim's harm potential. VetScore first segments the output and decomposes it into individual claims, then scores each claim with respect to its harm potential and evaluates its faithfulness to source excerpts, and finally calculates the overall risk-adjusted score. We collect an expert-annotated meta-evaluation dataset, evaluate our approach with a range of judge models, and show that it achieves high correlations with veterinary experts even with small judge models, while offering explainability across multiple dimensions.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-05 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2608.03675 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-31T12:17:37.776Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-08-05?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).