We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.DC

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Distributed, Parallel, and Cluster Computing

Title: Benchmarking Graph Data Management and Processing Systems: A Survey

Abstract: The development of scalable, representative, and widely adopted benchmarks for graph data systems have been a question for which answers has been sought for decades. We conduct an in-depth study of the existing literature on benchmarks for graph data management and processing, covering 20 different benchmarks developed during the last 15 years. We categorize the benchmarks into three areas focusing on benchmarks for graph processing systems, graph database benchmarks, and bigdata benchmarks with graph processing workloads. This systematic approach allows us to identify multiple issues existing in this area, including i) few benchmarks exist which can produce high workload scenarios, ii) no significant work done on benchmarking graph stream processing as well as graph based machine learning, iii) benchmarks tend to use conventional metrics despite new meaningful metrics have been around for years, iv) increasing number of big data benchmarks appear with graph processing workloads. Following these observations, we conclude the survey by describing key challenges for future research on graph data systems benchmarking.
Comments: 26 pages, 5 figures
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Databases (cs.DB); Performance (cs.PF); Social and Information Networks (cs.SI)
ACM classes: A.1; E.1; H.2
Cite as: arXiv:2005.12873 [cs.DC]
  (or arXiv:2005.12873v4 [cs.DC] for this version)

Submission history

From: Miyuru Dayarathna [view email]
[v1] Tue, 26 May 2020 17:07:29 GMT (272kb,D)
[v2] Mon, 1 Jun 2020 17:35:16 GMT (272kb,D)
[v3] Sun, 7 Jun 2020 17:17:53 GMT (274kb,D)
[v4] Wed, 22 Sep 2021 17:23:51 GMT (273kb,D)

Link back to: arXiv, form interface, contact.