Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Identifying individual facial expressions by deconstructing a neural network
(Submitted on 23 Jun 2016 (v1), last revised 26 Jun 2016 (this version, v2))
Abstract: This paper focuses on the problem of explaining predictions of psychological attributes such as attractiveness, happiness, confidence and intelligence from face photographs using deep neural networks. Since psychological attribute datasets typically suffer from small sample sizes, we apply transfer learning with two base models to avoid overfitting. These models were trained on an age and gender prediction task, respectively. Using a novel explanation method we extract heatmaps that highlight the parts of the image most responsible for the prediction. We further observe that the explanation method provides important insights into the nature of features of the base model, which allow one to assess the aptitude of the base model for a given transfer learning task. Finally, we observe that the multiclass model is more feature rich than its binary counterpart. The experimental evaluation is performed on the 2222 images from the 10k US faces dataset containing psychological attribute labels as well as on a subset of KDEF images.
Submission history
From: Wojciech Samek [view email][v1] Thu, 23 Jun 2016 12:24:45 GMT (2554kb,D)
[v2] Sun, 26 Jun 2016 00:41:35 GMT (2554kb,D)
Link back to: arXiv, form interface, contact.