Metraipolis › archive › dc_eb0d484aa922
Dhārā Bench: An Evidence-Oriented Retrieval Benchmark for Indian Knowledge Systems — arXiv:2611.03196
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.03196
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T11:11:56.628Z
- SHA-256 of the archived text
73bb3c0bfcb495a2b0e14943e10aed43ad66f5cbb8a2050c459a355c4b02e09b- Stable URL of this page
https://metraipolis.com/documento/dc_eb0d484aa922
How to cite
Dhārā Bench: An Evidence-Oriented Retrieval Benchmark for Indian Knowledge Systems — arXiv:2611.03196 — arXiv (en), https://arxiv.org/abs/2611.03196 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_eb0d484aa922 (Metraipolis archive dc_eb0d484aa922, sha256 73bb3c0bfcb495a2b0e14943e10aed43ad66f5cbb8a2050c459a355c4b02e09b)
BibTeX
@misc{dceb0d484aa922,
title = {Dhārā Bench: An Evidence-Oriented Retrieval Benchmark for Indian Knowledge Systems — arXiv:2611.03196},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.03196},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_eb0d484aa922; sha256 73bb3c0bfcb495a2b0e14943e10aed43ad66f5cbb8a2050c459a355c4b02e09b},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.03196. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Dhārā Bench is a retrieval benchmark for Indian Knowledge Systems (IKS), with 325 questions in 12 categories and 60,121 text chunks from 15 source groups. The categories were developed based on 4,500 questions submitted to the Dhārā application; the evaluation set combines corpus-aligned application queries with expert-contributed questions. The annotations comprise 7,578 question-chunk relevance links involving 6,847 distinct corpus chunks. For 34 composite and multi-hop questions, 401 conjugate groups specify alternative sets of passages that jointly support each question. Chunk identifiers and hierarchical references connect the judgments to their source texts. The paper describes corpus preparation, annotation, and validation, and reports a fixed BM25 baseline implemented with Pyserini with $k_1=0.9$ and $b=0.4$. Across all questions, BM25 achieves MRR@20 of 0.315, Recall@10 of 0.182, and nDCG@10 of 0.205. On the group-annotated subset, complete-evidence scores are CE_Recall@20 = 0.294 and CE_MRR@20 = 0.141. The category results expose particularly weak verse retrieval, while group scores reveal gaps between finding individual passages and completing their support. The corpus and evaluation code are available at this https URL . Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.CL, nuovi lavori del giorno). Categorie arXiv: Information Retrieval (cs.IR) ; Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2611.03196 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T10:59:52.427Z dalla pagina https://arxiv.org/list/cs.CL/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).