Metraipolis › archive › dc_4c16557807ff

Scalable datacenter replication with mostly-synchronous consensus on hardware — arXiv:2608.24622

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.24622
License (as archived)
CC0-1.0
Archived
2026-10-18T06:21:56.873Z
SHA-256 of the archived text
08f627c4ca0aa062d33816d2120ceb78ec2bb3bc6a8d0602b404a5d858f56d4f
Stable URL of this page
https://metraipolis.com/documento/dc_4c16557807ff

How to cite

Scalable datacenter replication with mostly-synchronous consensus on hardware — arXiv:2608.24622 — arXiv (en), https://arxiv.org/abs/2608.24622 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_4c16557807ff (Metraipolis archive dc_4c16557807ff, sha256 08f627c4ca0aa062d33816d2120ceb78ec2bb3bc6a8d0602b404a5d858f56d4f)
BibTeX
@misc{dc4c16557807ff,
  title = {Scalable datacenter replication with mostly-synchronous consensus on hardware — arXiv:2608.24622},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.24622},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_4c16557807ff; sha256 08f627c4ca0aa062d33816d2120ceb78ec2bb3bc6a8d0602b404a5d858f56d4f},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.24622. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Consistent replication of data among distributed processes -- a task involving the well-known consensus problem -- is notoriously expensive and hard to scale, affecting especially datacenter services with stringent performance requirements. To mitigate this problem, we introduce scalable replication in-hardware ( scarHW ): a network card design that improves throughput and latency of consistent replication even when increasing the number of replicas, whereas current systems operate at a small scale or with relaxed consistency guarantees. At the heart of scarHW is our novel POPUC consensus algorithm, implemented in an FPGA smartNIC to take full advantage of the "mostly synchronous" behavior of programmable network devices in the datacenter. Unlike widely-adopted "mostly asynchronous" coordination protocols such as Paxos or leaderless alternatives, POPUC implements a generalized variant of consensus dubbed collaborative consensus which allows for several simultaneous decisions, achieving great scalability without compromising availability. POPUC preserves safety guarantees in the presence of process crash-stop and message send/receive omission failures (capturing incidental asynchrony) and has been formally specified and verified in TLA+. Our FPGA prototype improves throughput and latency of widely-used services Redis and Zookeeper by up to two orders of magnitude compared to the state of the art. scarHW-based services also achieve zero downtime upon failure of a minority of replicas, offering a highly-robust, wire-speed, scalable replication system.

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-08-26 in cs.DC).
Categorie arXiv: Distributed, Parallel, and Cluster Computing (cs.DC).
Pagina del lavoro: https://arxiv.org/abs/2608.24622 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T06:17:57.833Z dalla pagina https://arxiv.org/catchup/cs.DC/2026-08-26?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).