Metraipolis › archive › dc_41bf46a1a482

Hoss: Fast Oblivious Semantic Search with Heterogeneous GPU-CPU-TEE Architecture — arXiv:2609.04522

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.04522
License (as archived)
CC0-1.0
Archived
2026-10-16T22:51:15.242Z
SHA-256 of the archived text
fe0bcd7c23ec57a951c18ef6493448d515dd2406e538dfb564b0db6fbe3723ef
Stable URL of this page
https://metraipolis.com/documento/dc_41bf46a1a482

How to cite

Hoss: Fast Oblivious Semantic Search with Heterogeneous GPU-CPU-TEE Architecture — arXiv:2609.04522 — arXiv (en), https://arxiv.org/abs/2609.04522 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_41bf46a1a482 (Metraipolis archive dc_41bf46a1a482, sha256 fe0bcd7c23ec57a951c18ef6493448d515dd2406e538dfb564b0db6fbe3723ef)
BibTeX
@misc{dc41bf46a1a482,
  title = {Hoss: Fast Oblivious Semantic Search with Heterogeneous GPU-CPU-TEE Architecture — arXiv:2609.04522},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.04522},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_41bf46a1a482; sha256 fe0bcd7c23ec57a951c18ef6493448d515dd2406e538dfb564b0db6fbe3723ef},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.04522. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Semantic search is widely deployed in modern AI systems, but protecting both data contents and access patterns remains challenging. The current state-of-the-art system, Compass, achieves oblivious semantic search by building an optimized ORAM over HNSW graphs. However, even with aggressive optimizations, it still incurs large overheads. Closing this performance gap is fundamentally difficult: Compass has already removed most cryptographic overheads, leaving ORAM accesses as the dominant cost, which are constrained by well-known Omega(log N) bandwidth lower bounds. Our key insight is that traditional ORAM overhead stems from the assumption of limited private memory, whereas modern GPU TEEs provide large private memory (Pmem) that blinds internal access patterns (Hunt et al., NSDI '23). This shift opens a new design space. We therefore propose Hoss, a first-of-its-kind oblivious semantic search system with a heterogeneous CPU-GPU TEE architecture that supports fast, scalable search with low cost of ownership. In Hoss, the GPU TEE's large Pmem hosts the hot-path HNSW traversal, while the lower layers of the graph, if they exceed GPU capacity, are offloaded to CPU TEEs. The system invokes oblivious primitives only when accessing these lower layers. The availability of large Pmem also enables new optimization opportunities. For example, Hoss features a host-access ORAM mechanism that goes beyond traditional performance constraints and incorporates several data-dependent optimizations that are not possible in prior designs. We implement a prototype of Hoss and benchmark it against Compass. Our results show that Hoss achieves up to 67x speedup while maintaining high recall, with larger gains at scale.

Tema degli esploratori: fiducia digitale e crittografia (retro-catalogo arXiv: annunci del 2026-09-07 in cs.CR).
Categorie arXiv: Cryptography and Security (cs.CR).
Pagina del lavoro: https://arxiv.org/abs/2609.04522 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T22:30:54.305Z dalla pagina https://arxiv.org/catchup/cs.CR/2026-09-07?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).