Metraipolis › archive › dc_fdc49559ddff

Federated Vector Retrieval across Heterogeneous VectorDBs — arXiv:2611.01514

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.01514
License (as archived)
CC0-1.0
Archived
2026-11-03T18:52:49.112Z
SHA-256 of the archived text
3cbba33566a5123ca6d7fab3b54147ead67f688bf62566be3055c0d1bc074a1b
Stable URL of this page
https://metraipolis.com/documento/dc_fdc49559ddff

How to cite

Federated Vector Retrieval across Heterogeneous VectorDBs — arXiv:2611.01514 — arXiv (en), https://arxiv.org/abs/2611.01514 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_fdc49559ddff (Metraipolis archive dc_fdc49559ddff, sha256 3cbba33566a5123ca6d7fab3b54147ead67f688bf62566be3055c0d1bc074a1b)
BibTeX
@misc{dcfdc49559ddff,
  title = {Federated Vector Retrieval across Heterogeneous VectorDBs — arXiv:2611.01514},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.01514},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_fdc49559ddff; sha256 3cbba33566a5123ca6d7fab3b54147ead67f688bf62566be3055c0d1bc074a1b},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.01514. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Vector databases are now core infrastructure for AI retrieval systems, yet many real deployments must serve queries over multiple independently constructed vectorDBs built with different embedding models. This creates a systems problem of federated retrieval over heterogeneous vectorDBs: vectors and similarity scores are not directly comparable across embedding spaces, while fully resolving this incompatibility through corpus-wide re-embedding and re-indexing is often operationally prohibitive. Existing methods therefore face a difficult trade-off between retrieval quality, construction cost, and query throughput. We present HVMap, a lightweight compatibility layer for federated retrieval across heterogeneous vectorDBs. Instead of rebuilding databases into a unified space, HVMap learns bidirectional mappings between embedding spaces using a fuzzy contrastive loss, enabling calibrated cross-database scoring without corpus migration or index reconstruction. HVMap is system-agnostic and further scales to multi-vectorDB settings while preserving ranking fidelity through a hub-based architecture. We evaluate HVMap in open-domain, cross-domain, and scale-out settings, and also construct a new benchmark for heterogeneous cross-domain federation. Across these settings, HVMap consistently achieves a better quality--cost--throughput trade-off than baselines, achieving up to 3.59X higher nDCG@10, up to 2.01X higher query throughput, and construction time as low as 0.3% of baseline methods. These results show that HVMap makes heterogeneous vectorDB federation practical at scale.

Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.IR, nuovi lavori del giorno).
Categorie arXiv: Databases (cs.DB) ; Information Retrieval (cs.IR).
Pagina del lavoro: https://arxiv.org/abs/2611.01514 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T18:16:37.722Z dalla pagina https://arxiv.org/list/cs.IR/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).