We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Stream Clipper: Scalable Submodular Maximization on Stream

Abstract: Applying submodular maximization in the streaming setting is nontrivial because the commonly used greedy algorithm exceeds the fixed memory and computational limits typically needed during stream processing. We introduce a new algorithm, called stream clipper, that uses two thresholds to select elements either into a solution set $S$ or an extra buffer $B$. The output is achieved by a greedy algorithm that starts from $S$ and then, if needed, greedily adds elements from $B$. Swapping elements out of $S$ may also be triggered lazily for further improvements, and elements may also be removed from $B$ (and corresponding thresholds adjusted) in order to keep memory use bounded by a constant. Although the worst-case approximation factor does not outperform the previous worst-case of $1/2$, stream clipper can perform better than $1/2$ depending on the order of the elements in the stream. We develop the idea of an "order complexity" to characterize orders on which an approximation factor of $1-\alpha$ can be achieved. In news and video summarization tasks, stream clipper significantly outperforms other streaming methods. It shows similar performance to the greedy algorithm but with less computation and memory costs.
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Combinatorics (math.CO)
Cite as: arXiv:1606.00389 [stat.ML]
  (or arXiv:1606.00389v1 [stat.ML] for this version)

Submission history

From: Tianyi Zhou [view email]
[v1] Wed, 1 Jun 2016 18:43:13 GMT (4422kb,D)
[v2] Sat, 10 Feb 2018 22:36:44 GMT (4455kb,D)
[v3] Tue, 13 Feb 2018 01:50:38 GMT (4456kb,D)

Link back to: arXiv, form interface, contact.