Clarisse: A middleware for data-staging coordination and control on large-scale hpc platforms

F Isaila, J Carretero, R Ross - 2016 16th IEEE/ACM …, 2016 - ieeexplore.ieee.org
On current large-scale HPC platforms the data path from compute nodes to final storage
passes through several networks interconnecting a distributed hierarchy of nodes serving as …

Automatically selecting the number of aggregators for collective I/O operations

M Chaarawi, E Gabriel - 2011 IEEE International Conference …, 2011 - ieeexplore.ieee.org
Optimizing collective I/O operations is of paramount importance for many data intensive high
performance computing applications. Despite the large number of algorithms published in …

LACIO: A new collective I/O strategy for parallel I/O systems

Y Chen, XH Sun, R Thakur, PC Roth… - … International Parallel & …, 2011 - ieeexplore.ieee.org
Parallel applications benefit considerably from the rapid advance of processor architectures
and the available massive computational capability, but their performance suffers from large …

Tracking humans from a moving platform

L Davis, V Philomin… - … Conference on Pattern …, 2000 - ieeexplore.ieee.org
Research at the Computer Vision Laboratory at the University of Maryland has focussed on
developing algorithms and systems that can look at humans and recognize their activities in …

Design and evaluation of multiple-level data staging for blue gene systems

F Isaila, J Blas, J Carretero, R Latham… - IEEE Transactions on …, 2010 - ieeexplore.ieee.org
Parallel applications currently suffer from a significant imbalance between computational
power and available I/O bandwidth. Additionally, the hierarchical organization of current …

Improving parallel I/O performance with data layout awareness

Y Chen, XH Sun, R Thakur, H Song… - 2010 IEEE International …, 2010 - ieeexplore.ieee.org
Parallel applications can benefit greatly from massive computational capability, but their
performance suffers from large latency of I/O accesses. The poor I/O performance has been …

Multithreaded two-phase i/o: Improving collective mpi-io performance on a lustre file system

Y Tsujita, K Yoshinaga, A Hori, M Sato… - … , and Network-Based …, 2014 - ieeexplore.ieee.org
ROMIO, a representative MPI-IO implementation, has been widely used in recent large-scale
parallel computations. The two-phase I/O optimization scheme of ROMIO improves I/O …

Improving collective MPI-IO using topology-aware stepwise data aggregation with I/O throttling

Y Tsujita, A Hori, T Kameyama, A Uno, F Shoji… - Proceedings of the …, 2018 - dl.acm.org
MPI-IO has been used in an internal I/O interface layer of HDF5 or PnetCDF, where
collective MPI-IO plays a big role in parallel I/O to manage a huge scale of scientific data …

Improving collective I/O performance by pipelining request aggregation and file access

S Sehrish, SW Son, W Liao, A Choudhary… - Proceedings of the 20th …, 2013 - dl.acm.org
In this paper, we propose a multi-buffer pipelining approach to improve collective I/O
performance by overlapping the dominant request aggregation phases with the I/O phase in …

Improving collective i/o performance using pipelined two-phase i/o

Y Tsujita, H Muguruma, K Yoshinaga, A Hori… - Proceedings of the …, 2012 - dl.acm.org
In a large scale of parallel computing, parallel-I/O libraries have an important role to operate
huge scale of file accesses from many clients. ROMIO, which is one of the MPI-IO libraries …