Metraipolis › archive › dc_d1ceccc3205f
Proof-Gated Publication: Verify-Before-Commit Content Integrity for Serverless Data-Mesh Lakehouses — arXiv:2608.14643
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.14643
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-18T19:34:05.091Z
- SHA-256 of the archived text
8d648db4b5721c4d501eba0873206f639cb6eee62a362ef462f2033bfe4f64cc- Stable URL of this page
https://metraipolis.com/documento/dc_d1ceccc3205f
How to cite
Proof-Gated Publication: Verify-Before-Commit Content Integrity for Serverless Data-Mesh Lakehouses — arXiv:2608.14643 — arXiv (en), https://arxiv.org/abs/2608.14643 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d1ceccc3205f (Metraipolis archive dc_d1ceccc3205f, sha256 8d648db4b5721c4d501eba0873206f639cb6eee62a362ef462f2033bfe4f64cc)
BibTeX
@misc{dcd1ceccc3205f,
title = {Proof-Gated Publication: Verify-Before-Commit Content Integrity for Serverless Data-Mesh Lakehouses — arXiv:2608.14643},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.14643},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d1ceccc3205f; sha256 8d648db4b5721c4d501eba0873206f639cb6eee62a362ef462f2033bfe4f64cc},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.14643. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Federated data meshes give domain teams ownership of their data products, and serverless compute is an attractive substrate for domain-owned writes. Both trends weaken correctness at publication. Open table formats such as Apache Iceberg and Delta Lake guarantee that a commit is atomic and that readers see an isolated snapshot, but not that the rows persisted equal the rows the job intended to write; publication is decided from the writer's exit status. A serverless job that silently drops a partition, truncates a file on retry, or duplicates a chunk still produces a valid, atomic, isolated, and wrong snapshot. This paper presents PVDM, a proof-gated publication protocol with four phases: Physical (write to rollbackable staging), Verify (a keyed multiset proof that written content equals declared intent, stored by an independent notary), Durable (replay completed chunks across serverless retries), and Metadata (commit the catalog last, only if the proof passed). Metadata commits only if the proof passes, so a failing proof yields no consumer-visible snapshot. The verification primitive is a keyed, incremental multiset hash over identity and content projections, telling missing or duplicated rows apart from corrupted values. A dependency-free reference gate, a thirty-case adversarial suite, and a reproducible benchmark catch eight thousand of eight thousand injected faults up to one million rows with no false blocks. We also run PVDM end-to-end on Apache Spark 4.0 and Apache Iceberg 1.11 at up to one hundred million rows, where every injected fault is blocked on the real commit path, the gated publish costs about seventeen milliseconds regardless of table size, and verification overhead is about a fifth of the write. The primitives are prior art; the contribution is composing them into a fail-closed, notarized, verify-before-commit protocol for serverless federated writes. Tema degli esploratori: fiducia digitale e crittografia (retro-catalogo arXiv: annunci del 2026-08-18 in cs.CR). Categorie arXiv: Databases (cs.DB) ; Cryptography and Security (cs.CR). Pagina del lavoro: https://arxiv.org/abs/2608.14643 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-18T19:01:59.139Z dalla pagina https://arxiv.org/catchup/cs.CR/2026-08-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).