Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Deepfake Caricatures: Amplifying attention to artifacts increases deepfake detection by humans and machines
(Submitted on 1 Jun 2022 (this version), latest version 10 Apr 2023 (v3))
Abstract: Deepfakes pose a serious threat to our digital society by fueling the spread of misinformation. It is essential to develop techniques that both detect them, and effectively alert the human user to their presence. Here, we introduce a novel deepfake detection framework that meets both of these needs. Our approach learns to generate attention maps of video artifacts, semi-supervised on human annotations. These maps make two contributions. First, they improve the accuracy and generalizability of a deepfake classifier, demonstrated across several deepfake detection datasets. Second, they allow us to generate an intuitive signal for the human user, in the form of "Deepfake Caricatures": transformations of the original deepfake video where attended artifacts are exacerbated to improve human recognition. Our approach, based on a mixture of human and artificial supervision, aims to further the development of countermeasures against fake visual content, and grants humans the ability to make their own judgment when presented with dubious visual media.
Submission history
From: Emilie Josephs [view email][v1] Wed, 1 Jun 2022 14:43:49 GMT (6137kb,D)
[v2] Thu, 2 Jun 2022 14:43:19 GMT (7330kb,D)
[v3] Mon, 10 Apr 2023 17:14:43 GMT (11478kb,D)
Link back to: arXiv, form interface, contact.