Metraipolis › archive › dc_7f50e02cd5fb

PhotonZip: Lifecycle-Aware Compression for HDF5-Based Synchrotron Workflows — arXiv:2611.04138

Source: arXiv (en)
Original: https://arxiv.org/abs/2611.04138
License (as archived): CC0-1.0
Archived: 2026-11-04T12:34:44.929Z
SHA-256 of the archived text: 087256478b911b703dc9bb243c8cbc9ce8b26744760c78ab0e9bb8f44c7b5677
Stable URL of this page: https://metraipolis.com/documento/dc_7f50e02cd5fb

How to cite

PhotonZip: Lifecycle-Aware Compression for HDF5-Based Synchrotron Workflows — arXiv:2611.04138 — arXiv (en), https://arxiv.org/abs/2611.04138 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_7f50e02cd5fb (Metraipolis archive dc_7f50e02cd5fb, sha256 087256478b911b703dc9bb243c8cbc9ce8b26744760c78ab0e9bb8f44c7b5677)

BibTeX

@misc{dc7f50e02cd5fb,
  title = {PhotonZip: Lifecycle-Aware Compression for HDF5-Based Synchrotron Workflows — arXiv:2611.04138},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.04138},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_7f50e02cd5fb; sha256 087256478b911b703dc9bb243c8cbc9ce8b26744760c78ab0e9bb8f44c7b5677},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.04138. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Synchrotron detectors generate data at rates that challenge storage and I/O systems. Compression can reduce data movement, but codec-only measurements do not capture the end-to-end behavior of HDF5 workflows. We present PhotonZip, a lifecycle-aware compression framework that tests candidate modes through a common HDF5 path and selects among eligible measured configurations according to either compression ratio or round-trip throughput. Its modular filters preserve standard HDF5 access when the required plugin is available. Across four beamline-derived datasets, PhotonZip reaches lossless compression ratios up to 1.629$\times$ and HDF5 write throughput up to 3.40GB/s write and 7.75GB/s read. The throughput-oriented configuration achieves 1.529$\times$ lossless data reduction while improving HDF5 write and read throughput by 21.2\% and 15.0\%, respectively. Lossy preview modes provide up to 16$\times$ data reduction and reduce preview latency by up to 8.35~s in the evaluated file-per-rank HDF5 configuration.

Tema degli esploratori: calcolo e infrastrutture (elenco arXiv cs.DC, nuovi lavori del giorno).
Categorie arXiv: Distributed, Parallel, and Cluster Computing (cs.DC).
Pagina del lavoro: https://arxiv.org/abs/2611.04138 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-04T12:27:16.998Z dalla pagina https://arxiv.org/list/cs.DC/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).