Compressgraph: Efficient parallel graph analytics with rule-based compression

Z Chen, F Zhang, JW Guan, J Zhai, X Shen… - Proceedings of the …, 2023 - dl.acm.org
Proceedings of the ACM on Management of Data, 2023dl.acm.org
Modern graphs exert colossal time and space pressure on graph analytics applications. In
2022, Facebook social graph reaches 2.91 billion users with trillions of edges. Many
compression algorithms have been developed to support direct processing on compressed
graphs to address this challenge. However, previous graph compression algorithms do not
focus on leveraging redundancy in repeated neighbor sequences, so they do not save the
amount of computation for graph analytics. We develop CompressGraph, an efficient rule …
Modern graphs exert colossal time and space pressure on graph analytics applications. In 2022, Facebook social graph reaches 2.91 billion users with trillions of edges. Many compression algorithms have been developed to support direct processing on compressed graphs to address this challenge. However, previous graph compression algorithms do not focus on leveraging redundancy in repeated neighbor sequences, so they do not save the amount of computation for graph analytics. We develop CompressGraph, an efficient rule-based graph analytics engine that leverages data redundancy in graphs to achieve both performance boost and space reduction for common graph applications. CompressGraph has three advantages over previous works. First, the rule-based abstraction of CompressGraph supports the reuse of intermediate results during graph traversal, thus saving time. Second, CompressGraph has intense expressiveness to support a wide range of graph applications. Third, CompressGraph scales well under high parallelism because the context-free rules have few dependencies. Experiments show that CompressGraph provides significant performance and space benefits on both CPUs and GPUs. On evaluating six typical graph applications, CompressGraph can achieve 1.97× speedup on the CPU, while 3.95× speedup on the GPU, compared to the state-of-the-art CPU and GPU methods, respectively. Moreover, CompressGraph can save an average of 71.27% memory savings on CPU and 70.36 on GPU.
ACM Digital Library
以上显示的是最相近的搜索结果。 查看全部搜索结果