We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: Multi-Stream Dynamic Video Summarization

Abstract: With vast amounts of video content being uploaded to the Internet every minute, video summarization becomes critical for efficient browsing, searching, and indexing of visual content. Nonetheless, the spread of social and egocentric cameras creates an abundance of sparse scenarios captured by several devices, and ultimately required to be jointly summarized. In this paper, we discuss the problem of summarizing videos recorded independently by several dynamic cameras that intermittently share the field of view. We present a robust framework that (a) identifies a diverse set of important events among moving cameras that often are not capturing the same scene, and (b) selects the most representative view(s) at each event to be included in a universal summary. Due to the lack of an applicable alternative, we collected a new multi-view egocentric dataset, Multi-Ego. Our dataset is recorded simultaneously by three cameras, covering a wide variety of real-life scenarios. The footage is annotated by multiple individuals under various summarization configurations, with a consensus analysis ensuring a reliable ground truth. We conduct extensive experiments on the compiled dataset in addition to three other standard benchmarks that show the robustness and the advantage of our approach in both supervised and unsupervised settings. Additionally, we show that our approach learns collectively from data of varied number-of-views and orthogonal to other summarization methods, deeming it scalable and generic.
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:1812.00108 [cs.CV]
  (or arXiv:1812.00108v4 [cs.CV] for this version)

Submission history

From: Mohamed Elfeki [view email]
[v1] Sat, 1 Dec 2018 00:44:12 GMT (921kb,D)
[v2] Mon, 25 Nov 2019 01:30:10 GMT (1130kb,D)
[v3] Tue, 26 Nov 2019 21:21:41 GMT (1204kb,D)
[v4] Thu, 14 Oct 2021 21:52:40 GMT (1136kb,D)

Link back to: arXiv, form interface, contact.