Please use this identifier to cite or link to this item:
Title: Weakly-supervised 3D hand pose estimation from monocular RGB images
Authors: Cai, Yujun
Ge, Liuhao
Cai, Jianfei
Yuan, Junsong
Keywords: Engineering::Computer science and engineering
Issue Date: 2018
Source: Cai, Y., Ge, L., Cai, J., & Yuan, J. (2018). Weakly-supervised 3D hand pose estimation from monocular RGB images. European Conference on Computer Vision (ECCV) 2018, 678-694. doi:10.1007/978-3-030-01231-1_41
Project: MOE2016-T2-2-065
Abstract: Compared with depth-based 3D hand pose estimation, it is more challenging to infer 3D hand pose from monocular RGB images, due to substantial depth ambiguity and the difficulty of obtaining fully-annotated training data. Different from existing learning-based monocular RGB-input approaches that require accurate 3D annotations for training, we propose to leverage the depth images that can be easily obtained from commodity RGB-D cameras during training, while during testing we take only RGB inputs for 3D joint predictions. In this way, we alleviate the burden of the costly 3D annotations in real-world dataset. Particularly, we propose a weakly-supervised method, adaptating from fully-annotated synthetic dataset to weakly-labeled real-world dataset with the aid of a depth regularizer, which generates depth maps from predicted 3D pose and serves as weak supervision for 3D pose regression. Extensive experiments on benchmark datasets validate the effectiveness of the proposed depth regularizer in both weakly-supervised and fully-supervised settings.
DOI: 10.1007/978-3-030-01231-1_41
Rights: © 2018 Springer Nature Switzerland AG. All rights reserved. This paper was published in European Conference on Computer Vision (ECCV) 2018 and is made available with permission of Springer Nature Switzerland AG.
Fulltext Permission: open
Fulltext Availability: With Fulltext
Appears in Collections:IMI Conference Papers

Files in This Item:
File Description SizeFormat 
Weakly-supervised 3D Hand Pose Estimation from Monocular RGB Images.pdf2.39 MBAdobe PDFThumbnail

Citations 20

Updated on Jul 13, 2020

Citations 20

Updated on Mar 9, 2021

Page view(s)

Updated on May 14, 2021


Updated on May 14, 2021

Google ScholarTM




Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.