Metraipolis › archive › dc_f2292cbdee43

Performance Evaluation of RED-ONION: A High-Speed Disk-to-Disk Transfer System — arXiv:2608.29053

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.29053
License (as archived)
CC0-1.0
Archived
2026-10-17T08:19:00.571Z
SHA-256 of the archived text
d94fe918b10982706bc32f571dd1f1eb6df91b2a32c457cc590f61ae6135081c
Stable URL of this page
https://metraipolis.com/documento/dc_f2292cbdee43

How to cite

Performance Evaluation of RED-ONION: A High-Speed Disk-to-Disk Transfer System — arXiv:2608.29053 — arXiv (en), https://arxiv.org/abs/2608.29053 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f2292cbdee43 (Metraipolis archive dc_f2292cbdee43, sha256 d94fe918b10982706bc32f571dd1f1eb6df91b2a32c457cc590f61ae6135081c)
BibTeX
@misc{dcf2292cbdee43,
  title = {Performance Evaluation of RED-ONION: A High-Speed Disk-to-Disk Transfer System — arXiv:2608.29053},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.29053},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f2292cbdee43; sha256 d94fe918b10982706bc32f571dd1f1eb6df91b2a32c457cc590f61ae6135081c},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.29053. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Modern experimental instruments produce data faster than general-purpose file transfer interfaces can move it, so delivery to the computing infrastructure has become a bottleneck in the research process. At many universities and research institutes, moreover, the instruments that generate research data and the high-performance computing systems that analyze it are separated both geographically and organizationally, because each demands its own expertise and installation environment. Connecting the two seamlessly is a pressing challenge for data-driven science. This article presents RED-ONION, a high-speed disk-to-disk transfer system that connects research facilities, on campus and beyond, to a computing center. The system combines data transfer nodes, a dedicated high-bandwidth network, an all-flash parallel file system, and multi-threaded transfer software that parallelizes network transmission and storage access. The design targets the wire rate both along the entire path, from the read on the sender storage to the write on the receiver storage, and for a single file between one pair of nodes rather than only in aggregate over many files or nodes. We describe the end-to-end optimizations across the transfer software, the operating system, and the storage that this requires. We evaluate a prototype deployed over a 100 Gbps transpacific path between Atlanta and Tokyo with a 150 ms round-trip time, on which a single 1 TB file transfer reached 90 Gbps, delivering a terabyte in approximately 95 s. Moving a dataset of this size therefore becomes a routine step, and the computing center serves an instrument as if the two were co-located.

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-09-01 in cs.DC).
Categorie arXiv: Distributed, Parallel, and Cluster Computing (cs.DC) ; Networking and Internet Architecture (cs.NI).
Pagina del lavoro: https://arxiv.org/abs/2608.29053 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T08:07:11.111Z dalla pagina https://arxiv.org/catchup/cs.DC/2026-09-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).