References & Citations
Computer Science > Machine Learning
Title: SLOSH: Set LOcality Sensitive Hashing via Sliced-Wasserstein Embeddings
(Submitted on 11 Dec 2021 (this version), latest version 8 Feb 2022 (v2))
Abstract: Learning from set-structured data is an essential problem with many applications in machine learning and computer vision. This paper focuses on non-parametric and data-independent learning from set-structured data using approximate nearest neighbor (ANN) solutions, particularly locality-sensitive hashing. We consider the problem of set retrieval from an input set query. Such retrieval problem requires: 1) an efficient mechanism to calculate the distances/dissimilarities between sets, and 2) an appropriate data structure for fast nearest neighbor search. To that end, we propose Sliced-Wasserstein set embedding as a computationally efficient "set-2-vector" mechanism that enables downstream ANN, with theoretical guarantees. The set elements are treated as samples from an unknown underlying distribution, and the Sliced-Wasserstein distance is used to compare sets. We demonstrate the effectiveness of our algorithm, denoted as Set-LOcality Sensitive Hashing (SLOSH), on various set retrieval datasets and compare our proposed embedding with standard set embedding approaches, including Generalized Mean (GeM) embedding/pooling, Featurewise Sort Pooling (FSPool), and Covariance Pooling and show consistent improvement in retrieval results. The code for replicating our results is available here: \href{https://github.com/mint-vu/SLOSH}{this https URL}.
Submission history
From: Soheil Kolouri [view email][v1] Sat, 11 Dec 2021 00:10:05 GMT (2272kb,D)
[v2] Tue, 8 Feb 2022 19:03:37 GMT (2273kb,D)
Link back to: arXiv, form interface, contact.