Current generations of NUMA node clusters feature multicore or manycore processors.
Programming such architectures efficiently is a challenge because numerous hardware …

The multiplication of cores in today's architectures raises the importance of intra-node
communication in modern clusters and their impact on the overall parallel application …

Collective algorithms are an essential part of MPI, allowing application programmers to
utilize underlying optimizations of common distributed operations. The MPI_Allgather …

In recent years, GPU-enhanced clusters have become more prevalent in High-Performance
Computing (HPC), leading to a demand for more efficient multi-GPU communication. This …

As we move toward the Exascale era, HPC systems are becoming more complex,
introducing increasing levels of heterogeneity in communication channels. This leads to …

The MPI_Allreduce collective operation is a core kernel of many parallel codebases,
particularly for reductions over a single value per process. The commonly used allreduce …

GPU accelerators have successfully established themselves in modern HPC clusters due to
their high performance and energy efficiency. To increase the GPU computational power in …

Multicore Clusters, which have become the most prominent form of High Performance
Computing (HPC) systems, challenge the performance of MPI applications with non uniform …

The continuous growth of supercomputers is accompanied by increased complexity of the
intra‐node level and the interconnection topology. Consequently, the whole software stack …

Collective communication operations are considered critical for improving the performance
of exascale-ready and high-performance computing applications. On this work we focus on …