Hello ADIOS: the challenges and lessons of developing leadership class I/O frameworks

Q Liu, J Logan, Y Tian, H Abbasi… - Concurrency and …, 2014 - Wiley Online Library
Applications running on leadership platforms are more and more bottlenecked by storage
input/output (I/O). In an effort to combat the increasing disparity between I/O throughput and …

Compressing the incompressible with ISABELA: In-situ reduction of spatio-temporal data

S Lakshminarasimhan, N Shah, S Ethier… - Euro-Par 2011 Parallel …, 2011 - Springer
Modern large-scale scientific simulations running on HPC systems generate data in the
order of terabytes during a single run. To lessen the I/O load during a simulation run …

PreDatA–preparatory data analytics on peta-scale machines

F Zheng, H Abbasi, C Docan, J Lofstead… - … on Parallel & …, 2010 - ieeexplore.ieee.org
Peta-scale scientific applications running on High End Computing (HEC) platforms can
generate large volumes of data. For high performance storage and in order to be useful to …

DAOS and friends: a proposal for an exascale storage system

J Lofstead, I Jimenez, C Maltzahn… - SC'16: Proceedings …, 2016 - ieeexplore.ieee.org
The DOE Extreme-Scale Technology Acceleration Fast Forward Storage and IO Stack
project is going to have significant impact on storage systems design within and beyond the …

ISABELA for effective in situ compression of scientific data

S Lakshminarasimhan, N Shah, S Ethier… - Concurrency and …, 2013 - Wiley Online Library
Exploding dataset sizes from extreme‐scale scientific simulations necessitates efficient data
management and reduction schemes to mitigate I/O costs. With the discrepancy between I/O …

In-situ feature extraction of large scale combustion simulations using segmented merge trees

AG Landge, V Pascucci, A Gyulassy… - SC'14: Proceedings …, 2014 - ieeexplore.ieee.org
The ever increasing amount of data generated by scientific simulations coupled with system
I/O constraints are fueling a need for in-situ analysis techniques. Of particular interest are …

Functional partitioning to optimize end-to-end performance on many-core architectures

M Li, SS Vazhkudai, AR Butt, F Meng… - SC'10: Proceedings …, 2010 - ieeexplore.ieee.org
Scaling computations on emerging massive-core supercomputers is a daunting task, which
coupled with the significantly lagging system I/O capabilities exacerbates applications' end …

A 1 PB/s file system to checkpoint three million MPI tasks

R Rajachandrasekar, A Moody, K Mohror… - Proceedings of the 22nd …, 2013 - dl.acm.org
With the massive scale of high-performance computing systems, long-running scientific
parallel applications periodically save the state of their execution to files called checkpoints …

High-performance computing for earth system modeling

D Wang, F Yuan - High Performance Computing for Geospatial …, 2020 - Springer
High-performance computing (HPC) plays an important role during the development of Earth
system models. This chapter reviews HPC efforts related to Earth system models, including …

Scalable in situ scientific data encoding for analytical query processing

S Lakshminarasimhan, DA Boyuka… - Proceedings of the …, 2013 - dl.acm.org
The process of scientific data analysis in high-performance computing environments has
been evolving along with the advancement of computing capabilities. With the onset of …