We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.DC

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Distributed, Parallel, and Cluster Computing

Title: MapReduce and Streaming Algorithms for Diversity Maximization in Metric Spaces of Bounded Doubling Dimension

Abstract: Given a dataset of points in a metric space and an integer $k$, a diversity maximization problem requires determining a subset of $k$ points maximizing some diversity objective measure, e.g., the minimum or the average distance between a pair of points in the subset. Diversity maximization problems are computationally hard, hence only approximate solutions can be hoped for. Although its applications are mostly in massive data analysis, most of the past research on diversity maximization has concentrated on the standard sequential setting. Thus, there is a need for efficient algorithms in computational settings that can handle very large datasets, such as those at the base of the MapReduce and the Streaming models. In this work we provide algorithms for these models in the special case of metric spaces of bounded doubling dimension, which include the important family of Euclidean spaces of constant dimension. Our results show that despite the inherent space-constraints of the two models, for a variety of diversity objective functions, we can achieve efficient MapReduce or Streaming algorithms yielding an $(\alpha+\epsilon)$-approximation ratio, for any constant $\epsilon>0$, where $\alpha$ the is best approximation ratio achieved by a standard polynomial-time, linear-space sequential algorithm for the same diversity criterion. As for other approaches in the literature, our algorithms revolve upon the determination of a high-quality core-set, that is, a (much) smaller subset of the input dataset which contains a good approximation to the optimal solution for the whole dataset.
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
Cite as: arXiv:1605.05590 [cs.DC]
  (or arXiv:1605.05590v1 [cs.DC] for this version)

Submission history

From: Matteo Ceccarello [view email]
[v1] Wed, 18 May 2016 14:11:31 GMT (25kb)
[v2] Mon, 20 Jun 2016 12:55:52 GMT (25kb)
[v3] Sun, 16 Oct 2016 13:04:51 GMT (411kb,D)
[v4] Mon, 23 Jan 2017 16:10:19 GMT (562kb,D)

Link back to: arXiv, form interface, contact.