A checkpoint of research on parallel i/o for high-performance computing
We present a comprehensive survey on parallel I/O in the high-performance computing
(HPC) context. This is an important field for HPC because of the historic gap between …
(HPC) context. This is an important field for HPC because of the historic gap between …
Improving collective I/O performance using non-volatile memory devices
G Congiu, S Narasimhamurthy, T Süß… - … on Cluster Computing …, 2016 - ieeexplore.ieee.org
Collective I/O is a parallel I/O technique designed to deliver high performance data access to
scientific applications running on high-end computing clusters. In collective I/O, write …
scientific applications running on high-end computing clusters. In collective I/O, write …
Detecting i/o access patterns of hpc workloads at runtime
In this paper, we seek to guide optimization and tuning strategies by identifying the
application's I/O access pattern. We evaluate three machine learning techniques to …
application's I/O access pattern. We evaluate three machine learning techniques to …
Automatic I/O scheduling algorithm selection for parallel file systems
FZ Boito, RV Kassick, POA Navaux… - Concurrency and …, 2016 - Wiley Online Library
This article presents our approach to provide input/output (I/O) scheduling with double
adaptivity: to applications and devices. In high‐performance computing environments …
adaptivity: to applications and devices. In high‐performance computing environments …
Twins: Server access coordination in the I/O forwarding layer
This paper presents a study of I/O scheduling techniques applied to the I/O forwarding layer.
In high-performance computing environments, applications rely on parallel file systems …
In high-performance computing environments, applications rely on parallel file systems …
On server-side file access pattern matching
In this paper, we propose a pattern matching approach for server-side access pattern
detection for the HPC I/O stack. More specifically, our proposal concerns file-level accesses …
detection for the HPC I/O stack. More specifically, our proposal concerns file-level accesses …
Metaheuristics in big data: An approach to railway engineering
SG Nunez, N Attoh-Okine - … conference on big data (big data), 2014 - ieeexplore.ieee.org
Big data is becoming increasingly important in various fields; railway engineering is no
exception. The use of advanced analysis tools will lead to improved reliability and safety in …
exception. The use of advanced analysis tools will lead to improved reliability and safety in …
Capturing Periodic I/O Using Frequency Techniques
Many HPC applications perform their I/O in bursts that follow a periodic pattern. This allows
for making predictions as to when a burst occurs. System providers can take advantage of …
for making predictions as to when a burst occurs. System providers can take advantage of …
Hierarchical collective i/o scheduling for high-performance computing
The non-contiguous access pattern of many scientific applications results in a large number
of I/O requests, which can seriously limit the data-access performance. Collective I/O has …
of I/O requests, which can seriously limit the data-access performance. Collective I/O has …
Iteration based collective I/O strategy for parallel I/O systems
MPI collective I/O is a widely used I/O method that helps data-intensive scientific applications
gain better I/O performance. However, it has been observed that existing collective I/O …
gain better I/O performance. However, it has been observed that existing collective I/O …