Metraipolis › archive › dc_3387df4da854
CacheRouter: A Dual-Path Tool Routing Architecture with Cache-Preserving Main-Model Isolation for Long-Tail Tool Discovery — arXiv:2608.22708
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.22708
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-18T07:41:35.008Z
- SHA-256 of the archived text
220123d71dda39ea2a6ff2b3eb4b236c6d1003dd2e16fc47542b2e7b43e82ae1- Stable URL of this page
https://metraipolis.com/documento/dc_3387df4da854
How to cite
CacheRouter: A Dual-Path Tool Routing Architecture with Cache-Preserving Main-Model Isolation for Long-Tail Tool Discovery — arXiv:2608.22708 — arXiv (en), https://arxiv.org/abs/2608.22708 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_3387df4da854 (Metraipolis archive dc_3387df4da854, sha256 220123d71dda39ea2a6ff2b3eb4b236c6d1003dd2e16fc47542b2e7b43e82ae1)
BibTeX
@misc{dc3387df4da854,
title = {CacheRouter: A Dual-Path Tool Routing Architecture with Cache-Preserving Main-Model Isolation for Long-Tail Tool Discovery — arXiv:2608.22708},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.22708},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_3387df4da854; sha256 220123d71dda39ea2a6ff2b3eb4b236c6d1003dd2e16fc47542b2e7b43e82ae1},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.22708. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Tool use in LLM systems faces a structural trade-off. Progressive disclosure keeps the prompt small by showing only the tools relevant to the current task, while prompt caching rewards a request prefix that stays fixed across calls; every change to the visible tool list invalidates the cached prefix. This paper treats the trade-off as a problem of request architecture and proposes a dual-path routing design that assigns tool selection and tool delivery to separate channels. The main model always sees a small, fixed set of core tools, so the head of its request is unchanged across calls; all other tools are reached through an independent routing channel, in which a router sub-model searches the full tool list, selects one tool, executes it, and returns the result. Tool registration is automated from source code and supports runtime updates, so the tool set can grow without modifying the main model's request prefix. The design generalizes progressive disclosure: capabilities are disclosed through the routing channel, and the main model's prefix stays stable. A prototype implementation was exercised on 55 functional queries and a 30-turn dialogue; token-level cache hit rates reached 90.99% and 95.2%, cutting input cost to about 12.0% and 8.0% of a no-cache baseline under DeepSeek's pricing, where cache-hit input tokens cost roughly 1/30 of cache-miss tokens. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-25 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2608.22708 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-18T07:37:52.736Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-25?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).