Lotaru: Locally predicting workflow task runtimes for resource management on heterogeneous infrastructures
Many resource management techniques for task scheduling, energy and carbon efficiency,
and cost optimization in workflows rely on a-priori task runtime knowledge. Building runtime …
and cost optimization in workflows rely on a-priori task runtime knowledge. Building runtime …
Big data scientific workflows in the cloud: Challenges and future prospects
The concept of workflows was implemented to mitigate the complexities involved in tasks
related to scientific computing and business analytics. With time, they have found …
related to scientific computing and business analytics. With time, they have found …
How workflow engines should talk to resource managers: A proposal for a common workflow scheduling interface
Scientific workflow management systems (SWMSs) and resource managers together ensure
that tasks are scheduled on provisioned resources so that all dependencies are obeyed …
that tasks are scheduled on provisioned resources so that all dependencies are obeyed …
Lotaru: Locally estimating runtimes of scientific workflow tasks in heterogeneous clusters
Many scientific workflow scheduling algorithms need to be informed about task runtimes a-
priori to conduct efficient scheduling. In heterogeneous cluster infrastructures, this problem …
priori to conduct efficient scheduling. In heterogeneous cluster infrastructures, this problem …
Sweep: Accelerating scientific research through scalable serverless workflows
Scientific and commercial applications are increasingly being executed in the cloud, but the
difficulties associated with cluster management render on-demand resources inaccessible …
difficulties associated with cluster management render on-demand resources inaccessible …
Feedback-based resource allocation for batch scheduling of scientific workflows
A scientific workflow is a set of interdependent compute tasks orchestrating large scale data
analyses or in-silico experiments. Workflows often comprise thousands of tasks with …
analyses or in-silico experiments. Workflows often comprise thousands of tasks with …
Sizey: Memory-efficient execution of scientific workflow tasks
As the amount of available data continues to grow in fields as diverse as bioinformatics,
physics, and remote sensing, the importance of scientific workflows in the design and …
physics, and remote sensing, the importance of scientific workflows in the design and …
Computation semantics of the functional scientific workflow language Cuneiform
Cuneiform is a minimal functional programming language for large-scale scientific data
analysis. Implementing a strict black-box view on external operators and data, it allows the …
analysis. Implementing a strict black-box view on external operators and data, it allows the …
Portability of scientific workflows in ngs data analysis: a case study
The analysis of next-generation sequencing (NGS) data requires complex computational
workflows consisting of dozens of autonomously developed yet interdependent processing …
workflows consisting of dozens of autonomously developed yet interdependent processing …
Ponder: Online Prediction of Task Memory Requirements for Scientific Workflows
Scientific workflows are used to analyze large amounts of data. These workflows comprise
numerous tasks, many of which are executed repeatedly, running the same custom program …
numerous tasks, many of which are executed repeatedly, running the same custom program …