Scripting distributed scientific workflows using Weaver

P Bui, L Yu, A Thrasher, R Carmichael… - Concurrency and …, 2012 - Wiley Online Library
Weaver is a high‐level distributed computing framework that enables researchers to
construct scalable scientific data‐processing workflows. Instead of developing a new …

[图书][B] A compiler toolchain for distributed data intensive scientific workflows

P Bui - 2012 - search.proquest.com
With the growing amount of computational resources available to researchers today and the
explosion of scientific data in modern research, it is imperative that scientists be able to …

Balancing push and pull in Confuga, an active storage cluster file system for scientific workflows

P Donnelly, D Thain - Concurrency and Computation: Practice …, 2017 - Wiley Online Library
Most big‐data analysis systems require users to adopt restricted abstractions to achieve
scaling and system stability. While highly effective at establishing data locality and …

[图书][B] Data locality techniques in an active cluster file system designed for scientific workflows

PJ Donnelly - 2016 - search.proquest.com
The continued exponential growth of storage capacity has catalyzed the broad acquisition of
scientific data which must be processed. While today's large data analysis systems are …