References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Contrastive Representation Learning for Hand Shape Estimation
(Submitted on 8 Jun 2021 (v1), last revised 2 Jul 2021 (this version, v2))
Abstract: This work presents improvements in monocular hand shape estimation by building on top of recent advances in unsupervised learning. We extend momentum contrastive learning and contribute a structured collection of hand images, well suited for visual representation learning, which we call HanCo. We find that the representation learned by established contrastive learning methods can be improved significantly by exploiting advanced background removal techniques and multi-view information. These allow us to generate more diverse instance pairs than those obtained by augmentations commonly used in exemplar based approaches. Our method leads to a more suitable representation for the hand shape estimation task and shows a 4.7% reduction in mesh error and a 3.6% improvement in F-score compared to an ImageNet pretrained baseline. We make our benchmark dataset publicly available, to encourage further research into this direction.
Submission history
From: Christian Zimmermann [view email][v1] Tue, 8 Jun 2021 13:31:58 GMT (12147kb,D)
[v2] Fri, 2 Jul 2021 07:06:44 GMT (12406kb,D)
Link back to: arXiv, form interface, contact.