An ephemeral burst-buffer file system for scientific applications

T Wang, K Mohror, A Moody, K Sato… - SC'16: Proceedings of …, 2016 - ieeexplore.ieee.org
Burst buffers are becoming an indispensable hardware resource on large-scale
supercomputers to buffer the bursty I/O from scientific applications. However, there is a lack …

On the composition of secure systems

H Mantel - Proceedings 2002 IEEE Symposium on Security and …, 2002 - ieeexplore.ieee.org
When complex systems are constructed from simpler components it is important to know
how properties of the components behave under composition. We present various …

Data elevator: Low-contention data movement in hierarchical storage system

B Dong, S Byna, K Wu, H Johansen… - 2016 IEEE 23rd …, 2016 - ieeexplore.ieee.org
Hierarchical storage subsystems that include multiple layers of burst buffers (BB) and disk-
based parallel file systems (PFS), are becoming an essential part of HPC systems to …

Stacker: an autonomic data movement engine for extreme-scale data staging-based in-situ workflows

P Subedi, P Davis, S Duan, S Klasky… - … Conference for High …, 2018 - ieeexplore.ieee.org
Data staging and in-situ workflows are being explored extensively as an approach to
address data-related costs at very large scales. However, the impact of emerging storage …

Ad hoc file systems for high-performance computing

A Brinkmann, K Mohror, W Yu, P Carns… - Journal of Computer …, 2020 - Springer
Storage backends of parallel compute clusters are still based mostly on magnetic disks,
while newer and faster storage technologies such as flash-based SSDs or non-volatile …

Someta: Scalable object-centric metadata management for high performance computing

H Tang, S Byna, B Dong, J Liu… - 2017 IEEE International …, 2017 - ieeexplore.ieee.org
Scientific data sets, which grow rapidly in volume, are often attached with plentiful metadata,
such as their associated experiment or simulation information. Thus, it becomes difficult for …

UniviStor: Integrated hierarchical and distributed storage for HPC

T Wang, S Byna, B Dong, H Tang - 2018 IEEE International …, 2018 - ieeexplore.ieee.org
High performance computing (HPC) architectures have been adding new layers of storage,
such as burst buffers, to tolerate latency between memory and disk-based file systems …

The role of machine learning in scientific workflows

E Deelman, A Mandal, M Jiang… - … Journal of High …, 2019 - journals.sagepub.com
Machine learning (ML) is being applied in a number of everyday contexts from image
recognition, to natural language processing, to autonomous vehicles, to product …

Leveraging burst buffer coordination to prevent I/O interference

A Kougkas, M Dorier, R Latham… - 2016 IEEE 12th …, 2016 - ieeexplore.ieee.org
Concurrent accesses to the shared storage resources in current HPC machines lead to
severe performance degradation caused by I/O contention. In this study, we identify some …

Managing I/O interference in a shared burst buffer system

S Thapaliya, P Bangalore, J Lofstead… - 2016 45th …, 2016 - ieeexplore.ieee.org
In this work, we investigate the problem of inter-application interference in a shared Burst
Buffer (BB) system. A BB is a new storage technology for HPC architectures that acts as an …