A survey on collecting, managing, and analyzing provenance from scripts

JF Pimentel, J Freire, L Murta… - ACM Computing Surveys …, 2019 - dl.acm.org
Scripts are widely used to design and run scientific experiments. Scripting languages are
easy to learn and use, and they allow complex tasks to be specified and executed in fewer …

noWorkflow: capturing and analyzing provenance of scripts

L Murta, V Braganholo, F Chirigati, D Koop… - … and Annotation of Data …, 2015 - Springer
We propose noWorkflow, a tool that transparently captures provenance of scripts and
enables reproducibility. Unlike existing approaches, noWorkflow is non-intrusive and does …

YesWorkflow: a user-oriented, language-independent tool for recovering workflow information from scripts

T McPhillips, T Song, T Kolisnik, S Aulenbach… - arXiv preprint arXiv …, 2015 - arxiv.org
Scientific workflow management systems offer features for composing complex
computational pipelines from modular building blocks, for executing the resulting automated …

[PDF][PDF] The Sacred Infrastructure for Computational Research.

K Greff, A Klein, M Chovanec, F Hutter… - …, 2017 - ml.informatik.uni-freiburg.de
A major part of machine learning research typically involves a significant number of
computational experiments run with many different hyperparameter settings. This process …

[PDF][PDF] noWorkflow: a tool for collecting, analyzing, and managing provenance from python scripts

JF Pimentel, L Murta, V Braganholo… - Proceedings of the VLDB …, 2017 - par.nsf.gov
We present noWorkflow, an open-source tool that systematically and transparently collects
provenance from Python scripts, including data about the script execution and how the script …

Reflective communication to improve problem-solving pathways: Key issues illustrated for an integrated environmental modelling case study

F Zare, JHA Guillaume, AJ Jakeman… - Environmental Modelling & …, 2020 - Elsevier
The pathway of a modelling project is commonly described as an adaptively adjusted chain
of steps at which various decisions are made. Communication and documentation about …

Collecting and Analyzing Provenance on Interactive Notebooks: When {IPython} Meets {noWorkflow}

JFN Pimentel, V Braganholo, L Murta… - 7th USENIX workshop on …, 2015 - usenix.org
Interactive notebooks help users explore code, run simulations, visualize results, and share
them with other people. While these notebooks have been widely adopted in teaching as …

Towards integration of data-driven agronomic experiments with data provenance

SMS da Cruz, JAP do Nascimento - Computers and Electronics in …, 2019 - Elsevier
With improvements in computing and communications, the amount of scientific data in
agriculture has been exploding. Thus, researchers must rely on computational simulations to …

Linking prospective and retrospective provenance in scripts

S Dey, K Belhajjame, D Koop, M Raul… - 7th USENIX Workshop …, 2015 - usenix.org
Scripting languages like Python, R, andMATLAB have seen significant use across a variety
of scientific domains. To assist scientists in the analysis of script executions, a number of …

Tracking and analyzing the evolution of provenance from scripts

JF Pimentel, J Freire, V Braganholo, L Murta - … McLean, VA, USA, June 7-8 …, 2016 - Springer
Script languages are powerful tools for scientists. Scientists use them to process data,
invoke programs, and link program outputs/inputs. During the life cycle of scientific …