Intralayer communication for tree-based overlay networks

T Hilbrich, J Protze, BR De Supinski… - 2013 42nd …, 2013 - ieeexplore.ieee.org
2013 42nd International Conference on Parallel Processing, 2013ieeexplore.ieee.org
While various HPC tools use Tree-Based Overlay Networks (TBONs) to increase their
scalability, some use cases do not map well to a tree-based hierarchy. We provide the
concept of intralayer communication to improve this situation, where nodes in a specific
hierarchy layer may exchange messages directly with each other. This concept targets data
preprocessing that allows tool developers to avoid load imbalances in higher hierarchy
levels. We implement intralayer communication within the Generic Tools Infrastructure (GTI) …
While various HPC tools use Tree-Based Overlay Networks (TBONs) to increase their scalability, some use cases do not map well to a tree-based hierarchy. We provide the concept of intralayer communication to improve this situation, where nodes in a specific hierarchy layer may exchange messages directly with each other. This concept targets data preprocessing that allows tool developers to avoid load imbalances in higher hierarchy levels. We implement intralayer communication within the Generic Tools Infrastructure (GTI) that provides TBON services, as well as a high-level abstraction to ease the creation of scalable runtime tools. An extension of GTI's abstractions allows simple and efficient use of intralayer communication. We demonstrate this capability with a runtime message matching tool for MPI's point-to-point communication, which we evaluate in an application study with up to 16,384 processes. Low overheads for two benchmark suites show the applicability of our approach, while a stress test demonstrates close to constant overheads across scales. The stress test measurements demonstrate that intralayer communication reduces application slowdown by two orders of magnitude at 2,048 processes, compared to a previous TBON-based implementation.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果