I/o access patterns in hpc applications: A 360-degree survey
The high-performance computing I/O stack has been complex due to multiple software
layers, the inter-dependencies among these layers, and the different performance tuning …
layers, the inter-dependencies among these layers, and the different performance tuning …
PreDatA–preparatory data analytics on peta-scale machines
Peta-scale scientific applications running on High End Computing (HEC) platforms can
generate large volumes of data. For high performance storage and in order to be useful to …
generate large volumes of data. For high performance storage and in order to be useful to …
IOrchestrator: Improving the performance of multi-node I/O systems via inter-server coordination
A cluster of data servers and a parallel file system are often used to provide high-throughput
I/O service to parallel programs running on a compute cluster. To exploit I/O parallelism …
I/O service to parallel programs running on a compute cluster. To exploit I/O parallelism …
Pattern-direct and layout-aware replication scheme for parallel I/O systems
The performance gap between computing power and the I/O system is ever increasing, and
in the meantime more and more High Performance Computing (HPC) applications are …
in the meantime more and more High Performance Computing (HPC) applications are …
A cost-intelligent application-specific data layout scheme for parallel file systems
I/O data access is a recognized performance bottleneck of high-end computing. Several
commercial and research parallel file systems have been developed in recent years to ease …
commercial and research parallel file systems have been developed in recent years to ease …
Automatically selecting the number of aggregators for collective I/O operations
M Chaarawi, E Gabriel - 2011 IEEE International Conference …, 2011 - ieeexplore.ieee.org
Optimizing collective I/O operations is of paramount importance for many data intensive high
performance computing applications. Despite the large number of algorithms published in …
performance computing applications. Despite the large number of algorithms published in …
LACIO: A new collective I/O strategy for parallel I/O systems
Parallel applications benefit considerably from the rapid advance of processor architectures
and the available massive computational capability, but their performance suffers from large …
and the available massive computational capability, but their performance suffers from large …
Enhancing checkpoint performance with staging io and ssd
X Ouyang, S Marcarelli… - … International Workshop on …, 2010 - ieeexplore.ieee.org
With the ever-growing size of computer clusters and applications, system failures are
becoming inevitable. Checkpointing, a strategy to ensure fault tolerance, has become …
becoming inevitable. Checkpointing, a strategy to ensure fault tolerance, has become …
Improving collective I/O performance using non-volatile memory devices
G Congiu, S Narasimhamurthy, T Süß… - … on Cluster Computing …, 2016 - ieeexplore.ieee.org
Collective I/O is a parallel I/O technique designed to deliver high performance data access to
scientific applications running on high-end computing clusters. In collective I/O, write …
scientific applications running on high-end computing clusters. In collective I/O, write …
MLOC: Multi-level layout optimization framework for compressed scientific data exploration with heterogeneous access patterns
The size and scope of cutting-edge scientific simulations are growing much faster than the
I/O and storage capabilities of their runtime environments. The growing gap gets …
I/O and storage capabilities of their runtime environments. The growing gap gets …