Combining in-situ and in-transit processing to enable extreme-scale scientific analysis

JC Bennett, H Abbasi, PT Bremer… - SC'12: Proceedings …, 2012 - ieeexplore.ieee.org
With the onset of extreme-scale computing, I/O constraints make it increasingly difficult for
scientists to save a sufficient amount of raw simulation data to persistent storage. One …

CALCioM: Mitigating I/O interference in HPC systems through cross-application coordination

M Dorier, G Antoniu, R Ross, D Kimpe… - 2014 IEEE 28th …, 2014 - ieeexplore.ieee.org
Unmatched computation and storage performance in new HPC systems have led to a
plethora of I/O optimizations ranging from application-side collective I/O to network and disk …

Damaris: How to efficiently leverage multicore parallelism to achieve scalable, jitter-free I/O

M Dorier, G Antoniu, F Cappello… - 2012 IEEE International …, 2012 - ieeexplore.ieee.org
With exascale computing on the horizon, the performance variability of I/O systems
represents a key challenge in sustaining high performance. In many HPC applications, I/O is …

An analysis of system balance and architectural trends based on top500 supercomputers

A Khan, H Sim, SS Vazhkudai, AR Butt… - … Conference on High …, 2021 - dl.acm.org
Supercomputer design is a complex, multi-dimensional optimization process, wherein
several subsystems need to be reconciled to meet a desired figure of merit performance for …

Goldrush: Resource efficient in situ scientific data analytics using fine-grained interference aware execution

F Zheng, H Yu, C Hantas, M Wolf… - Proceedings of the …, 2013 - dl.acm.org
Severe I/O bottlenecks on High End Computing platforms call for running data analytics in
situ. Demonstrating that there exist considerable resources in compute nodes un-used by …

Damaris/viz: a nonintrusive, adaptable and user-friendly in situ visualization framework

M Dorier, R Sisneros, T Peterka… - … IEEE Symposium on …, 2013 - ieeexplore.ieee.org
Reducing the amount of data stored by simulations will be of utmost importance for the next
generation of large-scale computing. Accordingly, there is active research to shift analysis …

FlexIO: I/O middleware for location-flexible scientific data analytics

F Zheng, H Zou, G Eisenhauer… - 2013 IEEE 27th …, 2013 - ieeexplore.ieee.org
Increasingly severe I/O bottlenecks on High-End Computing machines are prompting
scientists to process simulation output data online while simulations are running and before …

Workload characterization of a leadership class storage cluster

Y Kim, R Gunasekaran, GM Shipman… - 2010 5th Petascale …, 2010 - ieeexplore.ieee.org
Understanding workload characteristics is critical for optimizing and improving the
performance of current systems and software, and architecting new storage systems based …

NVMalloc: Exposing an aggregate SSD store as a memory partition in extreme-scale machines

C Wang, SS Vazhkudai, X Ma, F Meng… - 2012 IEEE 26th …, 2012 - ieeexplore.ieee.org
DRAM is a precious resource in extreme-scale machines and is increasingly becoming
scarce, mainly due to the growing number of cores per node. On future multi-petaflop and …

FlexAnalytics: a flexible data analytics framework for big data applications with I/O performance improvement

H Zou, Y Yu, W Tang, HWM Chen - Big Data Research, 2014 - Elsevier
Increasingly larger scale applications are generating an unprecedented amount of data.
However, the increasing gap between computation and I/O capacity on High End Computing …