Performance comparison of graph BFS implemented in MapReduce and PGAS programming models

M Ryczkowska, M Nowicki - … , PPAM 2017, Lublin, Poland, September 10 …, 2018 - Springer
M Ryczkowska, M Nowicki
Parallel Processing and Applied Mathematics: 12th International Conference …, 2018Springer
Computations based on graphs are very common problems but complexity, increasing size
of analyzed graphs and a huge amount of communication make this analysis a challenging
task. In this paper, we present a comparison of two parallel BFS (Breath-First Search)
implementations: MapReduce run on Hadoop infrastructure and in PGAS (Partitioned Global
Address Space) model. The latter implementation has been developed with the help of the
PCJ (Parallel Computations in Java)-a library for parallel and distributed computations in …
Abstract
Computations based on graphs are very common problems but complexity, increasing size of analyzed graphs and a huge amount of communication make this analysis a challenging task. In this paper, we present a comparison of two parallel BFS (Breath-First Search) implementations: MapReduce run on Hadoop infrastructure and in PGAS (Partitioned Global Address Space) model. The latter implementation has been developed with the help of the PCJ (Parallel Computations in Java) - a library for parallel and distributed computations in Java. Both implementations realize the level synchronous strategy - Hadoop algorithm assumes iterative MapReduce jobs, whereas PCJ uses explicit synchronization after each level. The scalability of both solutions is similar. However, the PCJ implementation is much faster (about 100 times) than the MapReduce Hadoop solution.
Springer
以上显示的是最相近的搜索结果。 查看全部搜索结果