We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: Towards Protecting Face Embeddings in Mobile Face Verification Scenarios

Abstract: This paper proposes PolyProtect, a method for protecting the sensitive face embeddings that are used to represent people's faces in neural-network-based face verification systems. PolyProtect transforms a face embedding to a more secure template, using a mapping based on multivariate polynomials parameterised by user-specific coefficients and exponents. In this work, PolyProtect is evaluated on two open-source face recognition systems in a cooperative-user mobile face verification context, under the toughest threat model that assumes a fully-informed attacker with complete knowledge of the system and all its parameters. Results indicate that PolyProtect can be tuned to achieve a satisfactory trade-off between the recognition accuracy of the PolyProtected face verification system and the irreversibility of the PolyProtected templates. Furthermore, PolyProtected templates are shown to be effectively unlinkable, especially if the user-specific parameters employed in the PolyProtect mapping are selected in a non-naive manner. The evaluation is conducted using practical methodologies with tangible results, to present realistic insight into the method's robustness as a face embedding protection scheme in practice. This work is fully reproducible using the publicly available code at: this https URL
Comments: This (third) version of the paper corresponds to the manuscript accepted for publication in IEEE T-BIOM. Consists of: 18 pages, 7 figures, 5 tables
Subjects: Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR)
Journal reference: V. Krivoku\'ca Hahn and S. Marcel, "Towards Protecting Face Embeddings in Mobile Face Verification Scenarios," in IEEE Transactions on Biometrics, Behavior, and Identity Science, doi: 10.1109/TBIOM.2022.3140472
DOI: 10.1109/TBIOM.2022.3140472
Cite as: arXiv:2110.00434 [cs.CV]
  (or arXiv:2110.00434v3 [cs.CV] for this version)

Submission history

From: Vedrana Krivokuća Hahn [view email]
[v1] Fri, 1 Oct 2021 14:13:23 GMT (4178kb,D)
[v2] Fri, 26 Nov 2021 11:01:32 GMT (4390kb,D)
[v3] Thu, 27 Jan 2022 10:40:36 GMT (4796kb,D)

Link back to: arXiv, form interface, contact.