Remote sensing big data computing: Challenges and opportunities

Y Ma, H Wu, L Wang, B Huang, R Ranjan… - Future Generation …, 2015 - Elsevier
As we have entered an era of high resolution earth observation, the RS data are undergoing
an explosive growth. The proliferation of data also give rise to the increasing complexity of …

2022 review of data-driven plasma science

R Anirudh, R Archibald, MS Asif… - … on Plasma Science, 2023 - ieeexplore.ieee.org
Data-driven science and technology offer transformative tools and methods to science. This
review article highlights the latest development and progress in the interdisciplinary field of …

[HTML][HTML] Adios 2: The adaptable input output system. a framework for high-performance data management

WF Godoy, N Podhorszki, R Wang, C Atkins… - SoftwareX, 2020 - Elsevier
We present ADIOS 2, the latest version of the Adaptable Input Output (I/O) System. ADIOS 2
addresses scientific data management needs ranging from scalable I/O in supercomputers …

The future of scientific workflows

E Deelman, T Peterka, I Altintas… - … Journal of High …, 2018 - journals.sagepub.com
Today's computational, experimental, and observational sciences rely on computations that
involve many related tasks. The success of a scientific mission often hinges on the computer …

In Situ Methods, Infrastructures, and Applications on High Performance Computing Platforms

AC Bauer, H Abbasi, J Ahrens, H Childs… - Computer Graphics …, 2016 - Wiley Online Library
The considerable interest in the high performance computing (HPC) community regarding
analyzing and visualization data without first writing to disk, ie, in situ processing, is due to …

Hello ADIOS: the challenges and lessons of developing leadership class I/O frameworks

Q Liu, J Logan, Y Tian, H Abbasi… - Concurrency and …, 2014 - Wiley Online Library
Applications running on leadership platforms are more and more bottlenecked by storage
input/output (I/O). In an effort to combat the increasing disparity between I/O throughput and …

PLFS: A checkpoint filesystem for parallel applications

J Bent, G Gibson, G Grider, B McClelland… - Proceedings of the …, 2009 - dl.acm.org
Parallel applications running across thousands of processors must protect themselves from
inevitable system failures. Many applications insulate themselves from failures by …

The paraview coprocessing library: A scalable, general purpose in situ visualization library

N Fabian, K Moreland, D Thompson… - … IEEE symposium on …, 2011 - ieeexplore.ieee.org
As high performance computing approaches exascale, CPU capability far outpaces disk
write speed, and in situ visualization becomes an essential part of an analyst's workflow. In …

A characterization of workflow management systems for extreme-scale applications

RF Da Silva, R Filgueira, I Pietri, M Jiang… - Future Generation …, 2017 - Elsevier
Automation of the execution of computational tasks is at the heart of improving scientific
productivity. Over the last years, scientific workflows have been established as an important …

MG-RAST version 4—lessons learned from a decade of low-budget ultra-high-throughput metagenome analysis

F Meyer, S Bagchi, S Chaterji, W Gerlach… - Briefings in …, 2019 - academic.oup.com
As technologies change, MG-RAST is adapting. Newly available software is being included
to improve accuracy and performance. As a computational service constantly running large …