To achieve scalability with today's heterogeneous HPC resources, we need a dramatic shift
in our thinking; MPI+ X is not enough. Asynchronous Many Task (AMT) runtime systems …

MPI defines a one-to-one relationship between MPI processes and ranks. This model
captures many use cases effectively; however, it also limits communication concurrency and …

Many-core architectures, such as the Intel Xeon Phi, provide dozens of cores and hundreds
of hardware threads. To utilize such architectures, application programmers are increasingly …

Modern high-speed interconnection networks are designed with capabilities to support
communication from multiple processor cores. The MPI endpoints extension has been …

This paper provides an in-depth analysis of the software overheads in the MPI performance-
critical path and exposes mandatory performance overheads that are unavoidable based on …

MPI+ threads is gaining prominence as an alternative to the traditional" MPI everywhere"
model in order to better handle the disproportionate increase in the number of cores …

Hybrid MPI+ threads programming is gaining prominence, but, in practice, applications
perform slower with it compared to the MPI everywhere model. The most critical challenge to …

Asynchronous programming models (APM) are gaining more and more traction, allowing
applications to expose the available concurrency to a runtime system tasked with …

The two most common parallel execution models for many-core CPUs today are
multiprocess (eg, MPI) and multithread (eg, OpenMP). The multiprocess model allows each …

Asynchronous many-task runtime systems and MPI+ X hybrid parallelism approaches have
shown promise for helping manage the increasing complexity of nodes in current and …