Workflow provenance in the lifecycle of scientific machine learning

R Souza, LG Azevedo, V Lourenço… - Concurrency and …, 2022 - Wiley Online Library
… In this work, we leverage workflow provenance techniques to build a holistic view to
support the lifecycle of scientific ML. We contribute with (i) characterization of the lifecycle and …

Computational reproducibility of scientific workflows at extreme scales

L Pouchard, S Baldwin, T Elsethagen… - … Journal of High …, 2019 - journals.sagepub.com
… the provenance and performance data of these workflows, we … captures provenance and
enables detailed single workflow … of both workflows—biomolecular and high-energy physics—…

Data preservation in high energy physics

T Basaglia, M Bellis, J Blomer, J Boyd, C Bozzi… - The European Physical …, 2023 - Springer
… assisted by carefully documenting the data provenance and the data validation principles. …
new models the full software stack implementing the entire ALEPH workflow is still necessary. …

Evaluating scientific workflow engines for data and compute intensive discoveries

R Singh, JA Graves, V Anantharaj… - … Conference on Big …, 2019 - ieeexplore.ieee.org
… In this paper, we survey workflow engines used in data-… such as astronomy, high energy
physics, earth system science, … the provenance of the workflow execution results and workflow

CF-PROV: A content-rich and fine-grained scientific workflow provenance model

Q Sun, Y Liu, W Tian, Y Guo - IEEE Access, 2019 - ieeexplore.ieee.org
… Therefore, we illustrate our provenance model by using the workflow presented in the
previous section as an example, demonstrating the logical … 0.394 high-energy physics 0.395 …

[PDF][PDF] Data management and processing workflow for the Materials Physics and Engineering group beamlines at the Advanced Photon Source

JS Park, C Horn, P Ramanathan… - Journal of Synchrotron …, 2019 - journals.iucr.org
high-energy X-rays are hosted. The experimental techniques include high-energy diffraction
microscopy and high-energy … text file for debugging or data provenance needs. The reduced …

Designing for reproducibility: A qualitative study of challenges and opportunities in high energy physics

SS Feger, S Dallmeier-Tiessen, A Schmidt… - Proceedings of the …, 2019 - dl.acm.org
… make use of prevalent workflow structures. Researchers pointed … that closely map research
workflows to preservation templates. … , automation of common workflow steps can increase …

Big PanDa Workflow Management on Titan for High Energy and Nuclear Physics and for Future Extreme Scale Scientific Application

K De, A Klimentov, S Jha, JC Wells - 2021 - osti.gov
High Energy Physics (HEP) and Nuclear Physics (NP). … built and pushed into the OpenShift
Origin system deployed at ORNL. … on network configuration within Origin system and the next …

Towards Lightweight Data Integration Using Multi-Workflow Provenance and Data Observability

R Santos Souza, T Skluzacek, S Wilkinson, M Ziatdinov… - 2023 - osti.gov
… as Oil & Gas, High-energy Physics, and Healthcare [3]–[5]. … workflow provenance
schema is not a goal in this paper, we reuse a provenance schema that can establish multi-workflow

The data-driven future of high-energy-density physics

PW Hatfield, JA Gaffney, GJ Anderson, S Ali… - Nature, 2021 - nature.com
… It is now time for ‘multi-provenance’ astronomy; integrating … have described into a fully
developed workflow similar to what is … fields, such as high-energy physics 108 and astronomy 109 …