In Situ Methods, Infrastructures, and Applications on High Performance Computing Platforms

AC Bauer, H Abbasi, J Ahrens, H Childs… - Computer Graphics …, 2016 - Wiley Online Library
The considerable interest in the high performance computing (HPC) community regarding
analyzing and visualization data without first writing to disk, ie, in situ processing, is due to …

Adaptive data placement for staging-based coupled scientific workflows

Q Sun, T Jin, M Romanus, H Bui, F Zhang… - Proceedings of the …, 2015 - dl.acm.org
Data staging and in-situ/in-transit data processing are emerging as attractive approaches for
supporting extreme scale scientific workflows. These approaches improve end-to-end …

Loosely coupled in situ visualization: A perspective on why it's here to stay

J Kress, S Klasky, N Podhorszki, J Choi… - Proceedings of the First …, 2015 - dl.acm.org
In this position paper, we argue that the loosely coupled in situ processing paradigm will
play an important role in high performance computing for the foreseeable future. Loosely …

CoREC: Scalable and resilient in-memory data staging for in-situ workflows

S Duan, P Subedi, P Davis, K Teranishi… - ACM Transactions on …, 2020 - dl.acm.org
The dramatic increase in the scale of current and planned high-end HPC systems is leading
new challenges, such as the growing costs of data movement and IO, and the reduced mean …

Scalable algorithms for MPI intergroup Allgather and Allgatherv

Q Kang, JL Träff, R Al-Bahrani, A Agrawal… - Parallel Computing, 2019 - Elsevier
MPI intergroup collective communication defines message transfer patterns between two
disjoint groups of MPI processes. Such patterns occur in coupled applications, and in …

Automatic communication refinement for system level design

S Abdi, D Shin, D Gajski - Proceedings of the 40th annual Design …, 2003 - dl.acm.org
This paper presents a methodology and algorithms for automatic communication refinement.
The communication refinement task in system-level synthesis transforms abstract data …

Scalable data resilience for in-memory data staging

S Duan, P Subedi, K Teranishi, P Davis… - 2018 IEEE …, 2018 - ieeexplore.ieee.org
The dramatic increase in the scale of current and planned high-end HPC systems is leading
new challenges, such as the growing costs of data movement and IO, and the reduced mean …

Addressing data resiliency for staging based scientific workflows

S Duan, P Subedi, PE Davis, M Parashar - Proceedings of the …, 2019 - dl.acm.org
As applications move towards extreme scales, data-related challenges are becoming
significant concerns, and in-situ workflows based on data staging and in-situ/in-transit data …

Staging based task execution for data-driven, in-situ scientific workflows

Z Wang, P Subedi, M Dorier, PE Davis… - … on Cluster Computing …, 2020 - ieeexplore.ieee.org
As scientific workflows increasingly use extreme-scale resources, the imbalance between
higher computational capabilities, generated data volumes, and available I/O bandwidth is …

Leveraging machine learning for anticipatory data delivery in extreme scale in-situ workflows

P Subedi, PE Davis, M Parashar - 2019 IEEE International …, 2019 - ieeexplore.ieee.org
Extreme scale scientific workflows are composed of multiple applications that exchange data
at runtime. Several data-related challenges are limiting the potential impact of such …