An efficient transformation scheme for lossy data compression with point-wise relative error bound
Because of the ever-increasing execution scale of scientific applications, how to store the
extremely large volume of data efficiently is becoming a serious issue. A significant …
extremely large volume of data efficiently is becoming a serious issue. A significant …
Hpc storage service autotuning using variational-autoencoder-guided asynchronous bayesian optimization
Distributed data storage services tailored to specific applications have grown popular in the
high-performance computing (HPC) community as a way to address I/O and storage …
high-performance computing (HPC) community as a way to address I/O and storage …
{GIFT}: A coupon based {Throttle-and-Reward} mechanism for fair and efficient {I/O} bandwidth management on parallel storage systems
Large-scale parallel applications are highly data-intensive and perform terabytes of I/O
routinely. Unfortunately, on a large-scale system where multiple applications run …
routinely. Unfortunately, on a large-scale system where multiple applications run …
Performance characterization of scientific workflows for the optimal use of burst buffers
Scientific discoveries are increasingly dependent upon the analysis of large volumes of data
from observations and simulations of complex phenomena. Scientists compose the complex …
from observations and simulations of complex phenomena. Scientists compose the complex …
Hcompress: Hierarchical data compression for multi-tiered storage environments
Modern scientific applications read and write massive amounts of data through simulations,
observations, and analysis. These applications spend the majority of their runtime in …
observations, and analysis. These applications spend the majority of their runtime in …
Accelerating a burst buffer via user-level i/o isolation
Burst buffers tolerate I/O spikes in High-Performance Computing environments by using a
non-volatile flash technology. Burst buffers are commonly located between parallel file …
non-volatile flash technology. Burst buffers are commonly located between parallel file …
Big Computing: Where are we heading?
This paper presents the overview of the current trends of Big data against the computing
scenario from different aspects. Some of the important aspect includes the Exascale, the …
scenario from different aspects. Some of the important aspect includes the Exascale, the …
[PDF][PDF] A BeeGFS-based caching file system for data-intensive parallel computing
D Abramson, C Jin, J Luong… - Asian Conference on …, 2020 - library.oapen.org
Modern high-performance computing (HPC) systems are increasingly using large amounts
of fast storage, such as solid-state drives (SSD), to accelerate disk access times. This …
of fast storage, such as solid-state drives (SSD), to accelerate disk access times. This …
EMPRESS: Accelerating Scientific Discovery through Descriptive Metadata Management
M Lawson, W Gropp, J Lofstead - ACM Transactions on Storage, 2022 - dl.acm.org
High-performance computing scientists are producing unprecedented volumes of data that
take a long time to load for analysis. However, many analyses only require loading in the …
take a long time to load for analysis. However, many analyses only require loading in the …
ML-based Modeling to Predict I/O Performance on Different Storage Sub-systems
Y Xu, P Sivaraman, H Devarajan, K Mohror… - arXiv preprint arXiv …, 2023 - arxiv.org
Parallel applications can spend a significant amount of time performing I/O on large-scale
supercomputers. Fast near-compute storage accelerators called burst buffers can reduce the …
supercomputers. Fast near-compute storage accelerators called burst buffers can reduce the …