arXiv Open Access 2023

A Ceph S3 Object Data Store for HEP

Nick Smith Bo Jayatilaka David Mason Oliver Gutsche Alison Peisker +2 lainnya

Lihat Sumber

Abstrak

We present a novel data format design that obviates the need for data tiers by storing individual event data products in column objects. The objects are stored and retrieved through Ceph S3 technology, with a layout designed to minimize metadata volume and maximize data processing parallelism. Performance benchmarks of data storage and retrieval are presented.

Topik & Kata Kunci

physics.data-an hep-ex

Penulis (7)

Nick Smith

Bo Jayatilaka

David Mason

Oliver Gutsche

Alison Peisker

Robert Illingworth

Chris Jones

Format Sitasi

APA MLA BibTeX

Smith, N., Jayatilaka, B., Mason, D., Gutsche, O., Peisker, A., Illingworth, R. et al. (2023). A Ceph S3 Object Data Store for HEP. https://arxiv.org/abs/2311.16321

Akses Cepat

Lihat di Sumber

Informasi Jurnal

Tahun Terbit: 2023
Bahasa: en
Sumber Database: arXiv
Akses: Open Access ✓