Fast joint estimation of silhouettes and dense 3D geometry from multiple images

We propose a probabilistic formulation of joint silhouette extraction and 3D reconstruction given a series of calibrated 2D images. Instead of segmenting each image separately in order to construct a 3D surface consistent with the estimated silhouettes, we compute the most probable 3D shape that giv...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 34(2012), 3 vom: 23. März, Seite 493-505
1. Verfasser: Kolev, Kalin (VerfasserIn)
Weitere Verfasser: Brox, Thomas, Cremers, Daniel
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2012
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM210429062
003 DE-627
005 20231224011635.0
007 cr uuu---uuuuu
008 231224s2012 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2011.150  |2 doi 
028 5 2 |a pubmed24n0701.xml 
035 |a (DE-627)NLM210429062 
035 |a (NLM)21808082 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Kolev, Kalin  |e verfasserin  |4 aut 
245 1 0 |a Fast joint estimation of silhouettes and dense 3D geometry from multiple images 
264 1 |c 2012 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 03.07.2012 
500 |a Date Revised 02.04.2012 
500 |a published: Print 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a We propose a probabilistic formulation of joint silhouette extraction and 3D reconstruction given a series of calibrated 2D images. Instead of segmenting each image separately in order to construct a 3D surface consistent with the estimated silhouettes, we compute the most probable 3D shape that gives rise to the observed color information. The probabilistic framework, based on Bayesian inference, enables robust 3D reconstruction by optimally taking into account the contribution of all views. We solve the arising maximum a posteriori shape inference in a globally optimal manner by convex relaxation techniques in a spatially continuous representation. For an interactively provided user input in the form of scribbles specifying foreground and background regions, we build corresponding color distributions as multivariate Gaussians and find a volume occupancy that best fits to this data in a variational sense. Compared to classical methods for silhouette-based multiview reconstruction, the proposed approach does not depend on initialization and enjoys significant resilience to violations of the model assumptions due to background clutter, specular reflections, and camera sensor perturbations. In experiments on several real-world data sets, we show that exploiting a silhouette coherency criterion in a multiview setting allows for dramatic improvements of silhouette quality over independent 2D segmentations without any significant increase of computational efforts. This results in more accurate visual hull estimation, needed by a multitude of image-based modeling approaches. We made use of recent advances in parallel computing with a GPU implementation of the proposed method generating reconstructions on volume grids of more than 20 million voxels in up to 4.41 seconds 
650 4 |a Journal Article 
700 1 |a Brox, Thomas  |e verfasserin  |4 aut 
700 1 |a Cremers, Daniel  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 34(2012), 3 vom: 23. März, Seite 493-505  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:34  |g year:2012  |g number:3  |g day:23  |g month:03  |g pages:493-505 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2011.150  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 34  |j 2012  |e 3  |b 23  |c 03  |h 493-505