A Simple, Fast and Highly-Accurate Algorithm to Recover 3D Shape from 2D Landmarks on a Single Image

Three-dimensional shape reconstruction of 2D landmark points on a single image is a hallmark of human vision, but is a task that has been proven difficult for computer vision algorithms. We define a feed-forward deep neural network algorithm that can reconstruct 3D shapes from 2D landmark points alm...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 40(2018), 12 vom: 28. Dez., Seite 3059-3066
1. Verfasser: Zhao, Ruiqi (VerfasserIn)
Weitere Verfasser: Wang, Yan, Martinez, Aleix M
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2018
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article Research Support, N.I.H., Extramural Research Support, Non-U.S. Gov't
LEADER 01000naa a22002652 4500
001 NLM286326930
003 DE-627
005 20231225051441.0
007 cr uuu---uuuuu
008 231225s2018 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2017.2772922  |2 doi 
028 5 2 |a pubmed24n0954.xml 
035 |a (DE-627)NLM286326930 
035 |a (NLM)29990100 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Zhao, Ruiqi  |e verfasserin  |4 aut 
245 1 2 |a A Simple, Fast and Highly-Accurate Algorithm to Recover 3D Shape from 2D Landmarks on a Single Image 
264 1 |c 2018 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 16.09.2019 
500 |a Date Revised 10.12.2019 
500 |a published: Print-Electronic 
500 |a Citation Status MEDLINE 
520 |a Three-dimensional shape reconstruction of 2D landmark points on a single image is a hallmark of human vision, but is a task that has been proven difficult for computer vision algorithms. We define a feed-forward deep neural network algorithm that can reconstruct 3D shapes from 2D landmark points almost perfectly (i.e., with extremely small reconstruction errors), even when these 2D landmarks are from a single image. Our experimental results show an improvement of up to two-fold over state-of-the-art computer vision algorithms; 3D shape reconstruction error (measured as the Procrustes distance between the reconstructed shape and the ground-truth) of human faces is , cars is .0022, human bodies is .022, and highly-deformable flags is .0004. Our algorithm was also a top performer at the 2016 3D Face Alignment in the Wild Challenge competition (done in conjunction with the European Conference on Computer Vision, ECCV) that required the reconstruction of 3D face shape from a single image. The derived algorithm can be trained in a couple hours and testing runs at more than 1,000 frames/s on an i7 desktop. We also present an innovative data augmentation approach that allows us to train the system efficiently with small number of samples. And the system is robust to noise (e.g., imprecise landmark points) and missing data (e.g., occluded or undetected landmark points) 
650 4 |a Journal Article 
650 4 |a Research Support, N.I.H., Extramural 
650 4 |a Research Support, Non-U.S. Gov't 
700 1 |a Wang, Yan  |e verfasserin  |4 aut 
700 1 |a Martinez, Aleix M  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 40(2018), 12 vom: 28. Dez., Seite 3059-3066  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:40  |g year:2018  |g number:12  |g day:28  |g month:12  |g pages:3059-3066 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2017.2772922  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 40  |j 2018  |e 12  |b 28  |c 12  |h 3059-3066