Combining in-situ and in-transit processing to enable extreme-scale scientific analysis
With the onset of extreme-scale computing, I/O constraints make it increasingly difficult for
scientists to save a sufficient amount of raw simulation data to persistent storage. One …
scientists to save a sufficient amount of raw simulation data to persistent storage. One …
CALCioM: Mitigating I/O interference in HPC systems through cross-application coordination
Unmatched computation and storage performance in new HPC systems have led to a
plethora of I/O optimizations ranging from application-side collective I/O to network and disk …
plethora of I/O optimizations ranging from application-side collective I/O to network and disk …
Damaris: How to efficiently leverage multicore parallelism to achieve scalable, jitter-free I/O
With exascale computing on the horizon, the performance variability of I/O systems
represents a key challenge in sustaining high performance. In many HPC applications, I/O is …
represents a key challenge in sustaining high performance. In many HPC applications, I/O is …
An analysis of system balance and architectural trends based on top500 supercomputers
Supercomputer design is a complex, multi-dimensional optimization process, wherein
several subsystems need to be reconciled to meet a desired figure of merit performance for …
several subsystems need to be reconciled to meet a desired figure of merit performance for …
Goldrush: Resource efficient in situ scientific data analytics using fine-grained interference aware execution
Severe I/O bottlenecks on High End Computing platforms call for running data analytics in
situ. Demonstrating that there exist considerable resources in compute nodes un-used by …
situ. Demonstrating that there exist considerable resources in compute nodes un-used by …
Damaris/viz: a nonintrusive, adaptable and user-friendly in situ visualization framework
Reducing the amount of data stored by simulations will be of utmost importance for the next
generation of large-scale computing. Accordingly, there is active research to shift analysis …
generation of large-scale computing. Accordingly, there is active research to shift analysis …
FlexIO: I/O middleware for location-flexible scientific data analytics
F Zheng, H Zou, G Eisenhauer… - 2013 IEEE 27th …, 2013 - ieeexplore.ieee.org
Increasingly severe I/O bottlenecks on High-End Computing machines are prompting
scientists to process simulation output data online while simulations are running and before …
scientists to process simulation output data online while simulations are running and before …
Workload characterization of a leadership class storage cluster
Y Kim, R Gunasekaran, GM Shipman… - 2010 5th Petascale …, 2010 - ieeexplore.ieee.org
Understanding workload characteristics is critical for optimizing and improving the
performance of current systems and software, and architecting new storage systems based …
performance of current systems and software, and architecting new storage systems based …
NVMalloc: Exposing an aggregate SSD store as a memory partition in extreme-scale machines
DRAM is a precious resource in extreme-scale machines and is increasingly becoming
scarce, mainly due to the growing number of cores per node. On future multi-petaflop and …
scarce, mainly due to the growing number of cores per node. On future multi-petaflop and …
FlexAnalytics: a flexible data analytics framework for big data applications with I/O performance improvement
H Zou, Y Yu, W Tang, HWM Chen - Big Data Research, 2014 - Elsevier
Increasingly larger scale applications are generating an unprecedented amount of data.
However, the increasing gap between computation and I/O capacity on High End Computing …
However, the increasing gap between computation and I/O capacity on High End Computing …