Fast GPU-Based Generation of Large Graph Networks From Degree Distributions
Synthetically generated, large graph networks serve as useful proxies to real-world networks for many graph-based applications. The ability to generate such networks helps overcome several limitations of real-world networks regarding their number, availability, and access. Here, we present the desig...
Guardado en:
Autores principales: | , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/9cb02a73b2c641a2a2ecea3c22b844aa |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:9cb02a73b2c641a2a2ecea3c22b844aa |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:9cb02a73b2c641a2a2ecea3c22b844aa2021-12-01T08:40:04ZFast GPU-Based Generation of Large Graph Networks From Degree Distributions2624-909X10.3389/fdata.2021.737963https://doaj.org/article/9cb02a73b2c641a2a2ecea3c22b844aa2021-11-01T00:00:00Zhttps://www.frontiersin.org/articles/10.3389/fdata.2021.737963/fullhttps://doaj.org/toc/2624-909XSynthetically generated, large graph networks serve as useful proxies to real-world networks for many graph-based applications. The ability to generate such networks helps overcome several limitations of real-world networks regarding their number, availability, and access. Here, we present the design, implementation, and performance study of a novel network generator that can produce very large graph networks conforming to any desired degree distribution. The generator is designed and implemented for efficient execution on modern graphics processing units (GPUs). Given an array of desired vertex degrees and number of vertices for each desired degree, our algorithm generates the edges of a random graph that satisfies the input degree distribution. Multiple runtime variants are implemented and tested: 1) a uniform static work assignment using a fixed thread launch scheme, 2) a load-balanced static work assignment also with fixed thread launch but with cost-aware task-to-thread mapping, and 3) a dynamic scheme with multiple GPU kernels asynchronously launched from the CPU. The generation is tested on a range of popular networks such as Twitter and Facebook, representing different scales and skews in degree distributions. Results show that, using our algorithm on a single modern GPU (NVIDIA Volta V100), it is possible to generate large-scale graph networks at rates exceeding 50 billion edges per second for a 69 billion-edge network. GPU profiling confirms high utilization and low branching divergence of our implementation from small to large network sizes. For networks with scattered distributions, we provide a coarsening method that further increases the GPU-based generation speed by up to a factor of 4 on tested input networks with over 45 billion edges.Maksudul AlamKalyan PerumallaFrontiers Media S.A.articleSIMT architecturesgraph generationGPU (graphic processing unit)random networklarge graphInformation technologyT58.5-58.64ENFrontiers in Big Data, Vol 4 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
SIMT architectures graph generation GPU (graphic processing unit) random network large graph Information technology T58.5-58.64 |
spellingShingle |
SIMT architectures graph generation GPU (graphic processing unit) random network large graph Information technology T58.5-58.64 Maksudul Alam Kalyan Perumalla Fast GPU-Based Generation of Large Graph Networks From Degree Distributions |
description |
Synthetically generated, large graph networks serve as useful proxies to real-world networks for many graph-based applications. The ability to generate such networks helps overcome several limitations of real-world networks regarding their number, availability, and access. Here, we present the design, implementation, and performance study of a novel network generator that can produce very large graph networks conforming to any desired degree distribution. The generator is designed and implemented for efficient execution on modern graphics processing units (GPUs). Given an array of desired vertex degrees and number of vertices for each desired degree, our algorithm generates the edges of a random graph that satisfies the input degree distribution. Multiple runtime variants are implemented and tested: 1) a uniform static work assignment using a fixed thread launch scheme, 2) a load-balanced static work assignment also with fixed thread launch but with cost-aware task-to-thread mapping, and 3) a dynamic scheme with multiple GPU kernels asynchronously launched from the CPU. The generation is tested on a range of popular networks such as Twitter and Facebook, representing different scales and skews in degree distributions. Results show that, using our algorithm on a single modern GPU (NVIDIA Volta V100), it is possible to generate large-scale graph networks at rates exceeding 50 billion edges per second for a 69 billion-edge network. GPU profiling confirms high utilization and low branching divergence of our implementation from small to large network sizes. For networks with scattered distributions, we provide a coarsening method that further increases the GPU-based generation speed by up to a factor of 4 on tested input networks with over 45 billion edges. |
format |
article |
author |
Maksudul Alam Kalyan Perumalla |
author_facet |
Maksudul Alam Kalyan Perumalla |
author_sort |
Maksudul Alam |
title |
Fast GPU-Based Generation of Large Graph Networks From Degree Distributions |
title_short |
Fast GPU-Based Generation of Large Graph Networks From Degree Distributions |
title_full |
Fast GPU-Based Generation of Large Graph Networks From Degree Distributions |
title_fullStr |
Fast GPU-Based Generation of Large Graph Networks From Degree Distributions |
title_full_unstemmed |
Fast GPU-Based Generation of Large Graph Networks From Degree Distributions |
title_sort |
fast gpu-based generation of large graph networks from degree distributions |
publisher |
Frontiers Media S.A. |
publishDate |
2021 |
url |
https://doaj.org/article/9cb02a73b2c641a2a2ecea3c22b844aa |
work_keys_str_mv |
AT maksudulalam fastgpubasedgenerationoflargegraphnetworksfromdegreedistributions AT kalyanperumalla fastgpubasedgenerationoflargegraphnetworksfromdegreedistributions |
_version_ |
1718405370803650560 |