Big Data (BD) platforms have a long tradition of leveraging trends and technologies from the
broader computer network and communication community. For several years, dedicated …

Apache's Hadoop 1 as of now is pretty good but there are scopes of extensions and
enhancements. A large number of improvements are proposed to Hadoop which is an open …

Abstract Galaxy (homepage: https://galaxyproject. org, main public server: https://usegalaxy.
org) is a web-based scientific analysis platform used by tens of thousands of scientists …

To comply with the increasing number of government regulations about data placement and
processing, and to protect themselves against major cloud outages, many users want the …

We describe the design and implementation of Protean--the Microsoft Azure service
responsible for allocating Virtual Machines (VMs) to millions of servers around the globe. A …

Modern science often requires the execution of large-scale, multi-stage simulation and data
analysis pipelines to enable the study of complex systems. The amount of computation and …

The initial design of Apache Hadoop [1] was tightly focused on running massive,
MapReduce jobs to process a web crawl. For increasingly diverse companies, Hadoop has …

This paper introduces FireWorks, a workflow software for running high‐throughput
calculation workflows at supercomputing centers. FireWorks has been used to complete …

We introduce new modules in the open-source PyCBC gravitational-wave astronomy toolkit
that implement Bayesian inference for compact-object binary mergers. We review the …

In arthropods, evolution has created a remarkably sophisticated class of imaging systems,
with a wide-angle field of view, low aberrations, high acuity to motion and an infinite depth of …