We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: Needle In A Haystack, Fast: Benchmarking Image Perceptual Similarity Metrics At Scale

Abstract: The advent of the internet, followed shortly by the social media made it ubiquitous in consuming and sharing information between anyone with access to it. The evolution in the consumption of media driven by this change, led to the emergence of images as means to express oneself, convey information and convince others efficiently. With computer vision algorithms progressing radically over the last decade, it is become easier and easier to study at scale the role of images in the flow of information online. While the research questions and overall pipelines differ radically, almost all start with a crucial first step - evaluation of global perceptual similarity between different images. That initial step is crucial for overall pipeline performance and processes most images. A number of algorithms are available and currently used to perform it, but so far no comprehensive review was available to guide the choice of researchers as to the choice of an algorithm best suited to their question, assumptions and computational resources. With this paper we aim to fill this gap, showing that classical computer vision methods are not necessarily the best approach, whereas a pair of relatively little used methods - Dhash perceptual hash and SimCLR v2 ResNets achieve excellent performance, scale well and are computationally efficient.
Comments: 26 pages, 10 figures
Subjects: Computer Vision and Pattern Recognition (cs.CV); Performance (cs.PF)
ACM classes: H.3.1; I.4.10; I.4.7; I.5.5; I.5.4; K.4
Cite as: arXiv:2206.00282 [cs.CV]
  (or arXiv:2206.00282v1 [cs.CV] for this version)

Submission history

From: Andrei Kucharavy [view email]
[v1] Wed, 1 Jun 2022 07:36:14 GMT (13799kb,D)

Link back to: arXiv, form interface, contact.