USCMS Researcher: Nick Smith
Postdoc dates: Jan 2022 - Jan 2024
Home Institution: Fermilab
Project: Object Storage for CMS in the HL-LHC era
Demonstrate feasability of using Ceph object store technology to store and retrieve CMS event data products at a finer granularity than file-level. Benchmark storage usage and analysis access performance and compare to traditional file-level storage solutions.More information: My project proposal
Mentors:
-
Bo Jayatilaka (Fermilab)
-
David Mason (Fermilab)
- 8 Nov 2023 - "Object Stores for CMS data", Nick Smith, S&C Blueprint Meeting - USCMS Storage R&D
- 9 May 2023 - "A Ceph S3 Object Data Store for HEP", Nick Smith, CHEP 2023
- 27 Oct 2022 - "Ceph S3 Object Storage for CMS data", Nick Smith, ACAT 2022
- 22 Feb 2022 - "Object Stores for CMS data: initial presentation", Nick Smith, HL-LHC R&D Initiative Meeting
Current Status
In progress. Single- and multi-client scaling tests of the Ceph object service were presented at CHEP, proceedings to be posted. Now working with CMSSW Core Framework team and RNTuple developers to integrate RNTuple into CMSSW, to leverage RNTuple object storage backend capabilities rather than writing a custom implementation. An automated data ingestion system demonstrator is being developed, where FTS transfers files directly to the S3 endpoint, which then triggers a conversion routine to explode the files into the object data format.
Contact me: