Metraipolis › archive › dc_fa343634a199

A Resource-centric Analysis and Optimization of NoSQL Workloads using Distressed Resource Volume Metric — arXiv:2608.09173

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.09173
License (as archived)
CC0-1.0
Archived
2026-10-19T08:52:39.273Z
SHA-256 of the archived text
a97c007a249176641b282da6509ee62596bc8c4773149701b917489c904cd50a
Stable URL of this page
https://metraipolis.com/documento/dc_fa343634a199

How to cite

A Resource-centric Analysis and Optimization of NoSQL Workloads using Distressed Resource Volume Metric — arXiv:2608.09173 — arXiv (en), https://arxiv.org/abs/2608.09173 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_fa343634a199 (Metraipolis archive dc_fa343634a199, sha256 a97c007a249176641b282da6509ee62596bc8c4773149701b917489c904cd50a)
BibTeX
@misc{dcfa343634a199,
  title = {A Resource-centric Analysis and Optimization of NoSQL Workloads using Distressed Resource Volume Metric — arXiv:2608.09173},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.09173},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_fa343634a199; sha256 a97c007a249176641b282da6509ee62596bc8c4773149701b917489c904cd50a},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.09173. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large-scale managed cloud databases leverage sophisticated load Packing and Migration (PAM) algorithms, which provide the efficiencies necessary for running these services at scale on cloud resources. Research into optimizing the resources and reliability of cloud databases at massive scales is limited by a lack of public NoSQL workloads. We address this in the context of Cosmos DB, Microsoft's flagship cloud-hosted NoSQL database. We first propose open-source NoSQL workloads from real Cosmos DB clusters, and analyze these traces to derive a novel reliability metric, Distressed Resource Volume (DRV), which captures the quality of service experienced by the end user. We then develop an open-source policy simulation framework, LoadStar, powered by a non-parametric statistical model of estimating the QoS of real traffic patterns. These form a reusable benchmark pipeline for validating policies for resource-centric NoSQL workloads. We then define a resource optimization problem for placing Cosmos DB replicas onto VM nodes, develop the Luna model for forecasting future load distributions, and the Orbit PAM algorithm that uses these forecasts to trigger and rebalance stressed replicas, to reduce tail-errors. Our experiments, validated using LoadStar for these workloads, demonstrate Orbit's benefits over the existing Cosmos DB policy and a worst-fit optimized baseline, with higher load delivered at lower error rates and up to $35\%$ reduction in resources. These have been deployed in production, with potential savings of $\$100M$s/yr while improving service reliability for millions of customers.

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-08-11 in cs.DC).
Categorie arXiv: Distributed, Parallel, and Cluster Computing (cs.DC) ; Databases (cs.DB); Systems and Control (eess.SY).
Pagina del lavoro: https://arxiv.org/abs/2608.09173 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T08:50:23.746Z dalla pagina https://arxiv.org/catchup/cs.DC/2026-08-11?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).