Metraipolis › archive › dc_d062fa59549b
AsymSpec: Efficient Cloud-Edge Speculative Decoding over Asymmetric Networks — arXiv:2608.04974
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.04974
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-31T11:25:37.096Z
- SHA-256 of the archived text
fc06b2a1a2d835e3ee56a44a550d8675315378c1eb82a183284b3ba949518164- Stable URL of this page
https://metraipolis.com/documento/dc_d062fa59549b
How to cite
AsymSpec: Efficient Cloud-Edge Speculative Decoding over Asymmetric Networks — arXiv:2608.04974 — arXiv (en), https://arxiv.org/abs/2608.04974 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d062fa59549b (Metraipolis archive dc_d062fa59549b, sha256 fc06b2a1a2d835e3ee56a44a550d8675315378c1eb82a183284b3ba949518164)
BibTeX
@misc{dcd062fa59549b,
title = {AsymSpec: Efficient Cloud-Edge Speculative Decoding over Asymmetric Networks — arXiv:2608.04974},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.04974},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d062fa59549b; sha256 fc06b2a1a2d835e3ee56a44a550d8675315378c1eb82a183284b3ba949518164},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.04974. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Cloud-edge speculative decoding places a lightweight draft model at an edge gateway and a higher-quality target model in the cloud, but inserts communication into every speculative block. Under a constrained uplink, candidate messages may queue while the verifier is idle. Stop-and-wait scheduling leaves edge compute underutilized; optimistic same-request runahead can waste work when a rejection or an unexpected bonus token invalidates dependent drafts. We present AsymSpec, which addresses uplink-gated verification and invalid dependent work with two corresponding mechanisms. Its asymmetric verification protocol keeps the common-path acceptance upload compact and moves richer, rejection-only correction information to the downlink. A total-variation (TV) certificate for the residual distribution determines whether a small target top-K response suffices; if not, the protocol progressively escalates through proposal-based exact recovery before falling back to the full distribution. Its confirmed-prefix pipeline exposes only independent, valid requests to the edge scheduler and lets the cloud re-batch arrived blocks, hiding verification waits when another confirmed-prefix request is ready without using same-request runahead. Across three draft-target pairs, two workloads, and three asymmetric network profiles, our end-to-end evaluation shows that AsymSpec delivers 2.82-28.03$\times$ the output-token throughput of the strongest baseline. Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-08-06 in cs.DC). Categorie arXiv: Distributed, Parallel, and Cluster Computing (cs.DC). Pagina del lavoro: https://arxiv.org/abs/2608.04974 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-31T11:14:26.133Z dalla pagina https://arxiv.org/catchup/cs.DC/2026-08-06?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).