References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Towards Using Clothes Style Transfer for Scenario-aware Person Video Generation
(Submitted on 14 Oct 2021 (v1), last revised 25 Oct 2021 (this version, v2))
Abstract: Clothes style transfer for person video generation is a challenging task, due to drastic variations of intra-person appearance and video scenarios. To tackle this problem, most recent AdaIN-based architectures are proposed to extract clothes and scenario features for generation. However, these approaches suffer from being short of fine-grained details and are prone to distort the origin person. To further improve the generation performance, we propose a novel framework with disentangled multi-branch encoders and a shared decoder. Moreover, to pursue the strong video spatio-temporal consistency, an inner-frame discriminator is delicately designed with input being cross-frame difference. Besides, the proposed framework possesses the property of scenario adaptation. Extensive experiments on the TEDXPeople benchmark demonstrate the superiority of our method over state-of-the-art approaches in terms of image quality and video coherence.
Submission history
From: Benlai Tang [view email][v1] Thu, 14 Oct 2021 07:49:00 GMT (998kb,D)
[v2] Mon, 25 Oct 2021 03:59:02 GMT (2002kb,D)
Link back to: arXiv, form interface, contact.