I/o access patterns in hpc applications: A 360-degree survey

JL Bez, S Byna, S Ibrahim - ACM Computing Surveys, 2023 - dl.acm.org
The high-performance computing I/O stack has been complex due to multiple software
layers, the inter-dependencies among these layers, and the different performance tuning …

PreDatA–preparatory data analytics on peta-scale machines

F Zheng, H Abbasi, C Docan, J Lofstead… - … on Parallel & …, 2010 - ieeexplore.ieee.org
Peta-scale scientific applications running on High End Computing (HEC) platforms can
generate large volumes of data. For high performance storage and in order to be useful to …

IOrchestrator: Improving the performance of multi-node I/O systems via inter-server coordination

X Zhang, K Davis, S Jiang - SC'10: Proceedings of the 2010 …, 2010 - ieeexplore.ieee.org
A cluster of data servers and a parallel file system are often used to provide high-throughput
I/O service to parallel programs running on a compute cluster. To exploit I/O parallelism …

Pattern-direct and layout-aware replication scheme for parallel I/O systems

Y Yin, J Li, J He, XH Sun… - 2013 IEEE 27th …, 2013 - ieeexplore.ieee.org
The performance gap between computing power and the I/O system is ever increasing, and
in the meantime more and more High Performance Computing (HPC) applications are …

A cost-intelligent application-specific data layout scheme for parallel file systems

H Song, Y Yin, Y Chen, XH Sun - … of the 20th international symposium on …, 2011 - dl.acm.org
I/O data access is a recognized performance bottleneck of high-end computing. Several
commercial and research parallel file systems have been developed in recent years to ease …

Automatically selecting the number of aggregators for collective I/O operations

M Chaarawi, E Gabriel - 2011 IEEE International Conference …, 2011 - ieeexplore.ieee.org
Optimizing collective I/O operations is of paramount importance for many data intensive high
performance computing applications. Despite the large number of algorithms published in …

LACIO: A new collective I/O strategy for parallel I/O systems

Y Chen, XH Sun, R Thakur, PC Roth… - … International Parallel & …, 2011 - ieeexplore.ieee.org
Parallel applications benefit considerably from the rapid advance of processor architectures
and the available massive computational capability, but their performance suffers from large …

Enhancing checkpoint performance with staging io and ssd

X Ouyang, S Marcarelli… - … International Workshop on …, 2010 - ieeexplore.ieee.org
With the ever-growing size of computer clusters and applications, system failures are
becoming inevitable. Checkpointing, a strategy to ensure fault tolerance, has become …

Improving collective I/O performance using non-volatile memory devices

G Congiu, S Narasimhamurthy, T Süß… - … on Cluster Computing …, 2016 - ieeexplore.ieee.org
Collective I/O is a parallel I/O technique designed to deliver high performance data access to
scientific applications running on high-end computing clusters. In collective I/O, write …

MLOC: Multi-level layout optimization framework for compressed scientific data exploration with heterogeneous access patterns

Z Gong, T Rogers, J Jenkins, H Kolla… - 2012 41st …, 2012 - ieeexplore.ieee.org
The size and scope of cutting-edge scientific simulations are growing much faster than the
I/O and storage capabilities of their runtime environments. The growing gap gets …