References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Pose Augmentation: Class-agnostic Object Pose Transformation for Object Recognition
(Submitted on 19 Mar 2020 (v1), last revised 14 Jan 2021 (this version, v4))
Abstract: Object pose increases intraclass object variance which makes object recognition from 2D images harder. To render a classifier robust to pose variations, most deep neural networks try to eliminate the influence of pose by using large datasets with many poses for each class. Here, we propose a different approach: a class-agnostic object pose transformation network (OPT-Net) can transform an image along 3D yaw and pitch axes to synthesize additional poses continuously. Synthesized images lead to better training of an object classifier. We design a novel eliminate-add structure to explicitly disentangle pose from object identity: first eliminate pose information of the input image and then add target pose information (regularized as continuous variables) to synthesize any target pose. We trained OPT-Net on images of toy vehicles shot on a turntable from the iLab-20M dataset. After training on unbalanced discrete poses (5 classes with 6 poses per object instance, plus 5 classes with only 2 poses), we show that OPT-Net can synthesize balanced continuous new poses along yaw and pitch axes with high quality. Training a ResNet-18 classifier with original plus synthesized poses improves mAP accuracy by 9% overtraining on original poses only. Further, the pre-trained OPT-Net can generalize to new object classes, which we demonstrate on both iLab-20M and RGB-D. We also show that the learned features can generalize to ImageNet.
Submission history
From: Yunhao Ge [view email][v1] Thu, 19 Mar 2020 00:39:37 GMT (3128kb,D)
[v2] Sun, 2 Aug 2020 05:19:29 GMT (8022kb,D)
[v3] Wed, 13 Jan 2021 03:29:28 GMT (6731kb,D)
[v4] Thu, 14 Jan 2021 02:03:09 GMT (7757kb,D)
Link back to: arXiv, form interface, contact.