Parallel i/o evaluation techniques and emerging hpc workloads: A perspective

S Neuwirth, AK Paul - 2021 IEEE International Conference on …, 2021 - ieeexplore.ieee.org
Emerging workloads such as artificial intelligence, big data analytics and complex multi-step
workflows alongside future exascale applications are anticipated future HPC workloads …

DFTracer: An Analysis-Friendly Data Flow Tracer for AI-Driven Workflows

H Devarajan, L Pottier, K Velusamy… - … Conference for High …, 2024 - ieeexplore.ieee.org
Modern HPC workflows involve intricate coupling of simulation, data analytics, and artificial
intelligence (AI) applications to improve time to scientific insight. These workflows require a …

DFMan: A graph-based optimization of dataflow scheduling on high-performance computing systems

F Chowdhury, F Di Natale, A Moody… - 2022 IEEE …, 2022 - ieeexplore.ieee.org
Scientific research and development campaigns are materialized by workflows of
applications executing on high-performance computing (HPC) systems. These applications …

Extracting and characterizing I/O behavior of HPC workloads

H Devarajan, K Mohror - 2022 IEEE International Conference …, 2022 - ieeexplore.ieee.org
System administrators set default storage-system configuration parameters with the goal of
providing high per-formance for their system's I/O workloads. However, this gener-alized …

H5Intent: Autotuning HDF5 with User Intent

H Devarajan, G Heber, K Mohror - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
The complexity of data management in HPC systems stems from the diversity in I/O behavior
exhibited by new workloads, multistage workflows, and multitiered storage systems. The …

TailorFS: An Adaptive file system to support dynamic I/O requirements of HPC workloads

H Devarajan, K Mohror - 2024 IEEE 36th International …, 2024 - ieeexplore.ieee.org
High-Performance Computing (HPC) systems typically provide a global storage system to
support large-scale workload's I/O requirements. However, these workloads have diversified …

Report for the ASCR Workshop on the Management and Storage of Scientific Data

S Byna, S Idreos, T Jones, K Mohror, R Ross, F Rusu - 2022 - osti.gov
The purpose of this workshop is to identify priority research directions in the area of data
management for high-performance and scientific computing above and beyond HPC's …

Mimir: Extending I/O Interfaces to Express User Intent for Complex Workloads in HPC

H Devarajan, K Mohror - 2023 IEEE International Parallel and …, 2023 - ieeexplore.ieee.org
The complexity of data management in HPC systems stems from the diversity in I/O behavior
exhibited by new workloads, multistage workflows, and the presence of multitiered storage …

An Empirical Method for Processing I/O Traces to Analyze the Performance of DL Applications

E Parraga, B Leon, S Mendez, D Rexachs… - Conference on Cloud …, 2024 - Springer
The exponential growth of data handled by Deep Learning (DL) applications has led to an
unprecedented demand for computational resources, necessitating their execution on High …

[图书][B] Characterization and Optimization of the I/O Software Stack in Complex Applications and Workflows

FT Chowdhury - 2023 - search.proquest.com
Researchers and scientists regularly work on solving complex real-world problems in
medical science, environmental science, astrophysics, etc., to achieve mission-critical …