Metraipolis › archive › dc_6296aa33ceac
The Polyglot's Dilemma: Conformance Testing a Dozen Specs in as Many Languages — arXiv:2608.18039
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.18039
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-18T14:55:31.403Z
- SHA-256 of the archived text
b5917ef9bdb126c3be84df8bb580d4710057e298049253ab6f20deb74be3018c- Stable URL of this page
https://metraipolis.com/documento/dc_6296aa33ceac
How to cite
The Polyglot's Dilemma: Conformance Testing a Dozen Specs in as Many Languages — arXiv:2608.18039 — arXiv (en), https://arxiv.org/abs/2608.18039 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_6296aa33ceac (Metraipolis archive dc_6296aa33ceac, sha256 b5917ef9bdb126c3be84df8bb580d4710057e298049253ab6f20deb74be3018c)
BibTeX
@misc{dc6296aa33ceac,
title = {The Polyglot's Dilemma: Conformance Testing a Dozen Specs in as Many Languages — arXiv:2608.18039},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.18039},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_6296aa33ceac; sha256 b5917ef9bdb126c3be84df8bb580d4710057e298049253ab6f20deb74be3018c},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.18039. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
MongoDB maintains client libraries in a dozen programming languages, used by tens of thousands of organizations and millions of developers. Most are implemented natively rather than as wrappers around a shared core. Ensuring consistent behavior across these libraries, comprising millions of lines of code, is hard but essential. Over eleven years, we developed a specification-based testing approach: tests are written once in YAML and executed by language-specific interpreters for each library. We describe the evolution from many ad-hoc formats to a Unified Test Format, which allowed us to delete over 22,000 lines of test code. The rate of nonconformance bugs fell up to 86% in drivers that adopted YAML tests (though results varied). We report lessons learned about declarative test design, test architecture, schema evolution, and the limits of unification. Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-08-19 in cs.SE). Categorie arXiv: Software Engineering (cs.SE). Pagina del lavoro: https://arxiv.org/abs/2608.18039 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-18T14:48:24.138Z dalla pagina https://arxiv.org/catchup/cs.SE/2026-08-19?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).