USCMS Researcher: Yao Yao



Postdoc dates: Oct 2023 - Sep 2024

Home Institution: Purdue University


Project: Automating algorithm loading and executing on GPUs for SONIC

Automating the process of loading and executing algorithms on GPUs is an essential aspect of the SONIC project. SONIC, short for Services for Optimized Network Inference on Coprocessors, aims to optimize computing resource utilization for large-scale data processing involving the use of ML and non-ML algorithms to identify and categorize reconstructed particles from collisions.

More information: My project proposal

Mentors:

  • Miaoyuan Liu (Purdue University)

Presentations
Current Status
  • Progress Report
    • Learned to run SONIC miniAOD workflow at Purdue Tier2 cluster.
    • Learned to measure throughput and latency with the tools provided to measure miniAOD workflow for both GPU triton server and CPU direct inference, and interpret the performance.
    • Wrote the sonic-nized producer of particle transformer for B-jet tagging in Run 3 miniAOD workflow. Tested its performance for both GPU triton server and CPU direct inference with CMSSW_14_1_0_pre0 and a 2023 TTbar MC sample.
  • Next Steps
    • Integrate the sonic-nized producer to official CMSSW release.
    • Understand Patatrack-as-a-service as an example of using non-NL algorithm on GPU server.
    • After getting Triton server to work with the linux system that CMSSW is working on, will start to discuss with SONIC team about how to implement automation on algorithm loading and execution.


Contact me: