Partitioning trillion-edge graphs in minutes

GM Slota, S Rajamanickam, K Devine… - 2017 IEEE …, 2017 - ieeexplore.ieee.org
2017 IEEE International Parallel and Distributed Processing …, 2017ieeexplore.ieee.org
We introduce XtraPuLP, a new distributed-memory graph partitioner designed to process
trillion-edge graphs. XtraPuLP is based on the scalable label propagation community
detection technique, which has been demonstrated as a viable means to produce high
quality partitions with minimal computation time. On a collection of large sparse graphs, we
show that XtraPuLP partitioning quality is comparable to state-of-the-art partitioning
methods. We also demonstrate that XtraPuLP can produce partitions of real-world graphs …
We introduce XtraPuLP, a new distributed-memory graph partitioner designed to process trillion-edge graphs. XtraPuLP is based on the scalable label propagation community detection technique, which has been demonstrated as a viable means to produce high quality partitions with minimal computation time. On a collection of large sparse graphs, we show that XtraPuLP partitioning quality is comparable to state-of-the-art partitioning methods. We also demonstrate that XtraPuLP can produce partitions of real-world graphs with billion+ vertices in minutes. Further, we show that using XtraPuLP partitions for distributed-memory graph analytics leads to significant end-to-end execution time reduction.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果