Metraipolis › archive › dc_8f4e96a91d69

RAG Deserves an Index: Why Ingest-Time Compilation Beats Query-Time Interpretation — arXiv:2608.20845

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.20845
License (as archived)
CC0-1.0
Archived
2026-10-18T10:48:05.878Z
SHA-256 of the archived text
e4db0aa836f9508e952ddb34b3ab2191356c8a7d3fc2506ee08f1da4f49c2b8c
Stable URL of this page
https://metraipolis.com/documento/dc_8f4e96a91d69

How to cite

RAG Deserves an Index: Why Ingest-Time Compilation Beats Query-Time Interpretation — arXiv:2608.20845 — arXiv (en), https://arxiv.org/abs/2608.20845 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_8f4e96a91d69 (Metraipolis archive dc_8f4e96a91d69, sha256 e4db0aa836f9508e952ddb34b3ab2191356c8a7d3fc2506ee08f1da4f49c2b8c)
BibTeX
@misc{dc8f4e96a91d69,
  title = {RAG Deserves an Index: Why Ingest-Time Compilation Beats Query-Time Interpretation — arXiv:2608.20845},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.20845},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_8f4e96a91d69; sha256 e4db0aa836f9508e952ddb34b3ab2191356c8a7d3fc2506ee08f1da4f49c2b8c},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.20845. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Nearly every retrieval-augmented question-answering system in production ships with a hidden interpreter: on each query a language model re-derives the meaning of raw corpus text and then throws that work away. Cheaper models do not close the gap: per-token prices have fallen by orders of magnitude while inference spend has risen, because context volume grows faster than prices fall. This is the modern equivalent of the full-table scan, and the remedy is the one databases found fifty years ago: do the expensive work once, at write time, into a maintained structure that makes reads cheap. A corpus whose read pattern is known before it ever meets a user can and should be indexed too. We call the paradigm ingest-time semantic compilation (ISC): compile a corpus's meaning into a queryable substrate with two coupled layers - incrementally maintained embeddings, and atomic claims whose provenance is validated at compile time - and treat that substrate as a first-class database object with its own DDL, maintenance contract, migration contract, and cost model. Two existence proofs support it. Substrate upkeep scales with change rather than corpus size: incremental updates run 33.7x cheaper than reconstruction while tracking it to floating-point precision. And on a held-out sample of 500 broadcast-interview transcripts, compiled claims as the retrieval payload win all 32 budget-by-model cells: 85.2% correct from roughly 2.2k reader tokens against 72.5% from 16.3k for the best chunk configuration anywhere. The only baseline that keeps pace is a contextualized-chunk pipeline with hybrid retrieval and reranking, statistically indistinguishable from compiled claims at roughly twenty-one times the query-path tokens - and it reaches that parity, we argue, precisely because it has itself begun to compile. We close with the systems agenda this opens, from compilation planners to read planning.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-08-24 in cs.IR).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Databases (cs.DB); Information Retrieval (cs.IR).
Pagina del lavoro: https://arxiv.org/abs/2608.20845 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T10:47:39.579Z dalla pagina https://arxiv.org/catchup/cs.IR/2026-08-24?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).