Structure From Motion on XSlit Cameras

We present a structure-from-motion (SfM) framework based on a special type of multi-perspective camera called the cross-slit or XSlit camera. Traditional perspective camera based SfM suffers from the scale ambiguity which is inherent to the pinhole camera geometry. In contrast, an XSlit camera captu...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 43(2021), 5 vom: 01. Mai, Seite 1691-1704
1. Verfasser: Yang, Wei (VerfasserIn)
Weitere Verfasser: Zhang, Yingliang, Ye, Jinwei, Ji, Yu, Li, Zhong, Zhou, Mingyuan, Yu, Jingyi
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2021
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM303982322
003 DE-627
005 20231225114008.0
007 cr uuu---uuuuu
008 231225s2021 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2019.2957119  |2 doi 
028 5 2 |a pubmed24n1013.xml 
035 |a (DE-627)NLM303982322 
035 |a (NLM)31796390 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Yang, Wei  |e verfasserin  |4 aut 
245 1 0 |a Structure From Motion on XSlit Cameras 
264 1 |c 2021 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Revised 02.04.2021 
500 |a published: Print-Electronic 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a We present a structure-from-motion (SfM) framework based on a special type of multi-perspective camera called the cross-slit or XSlit camera. Traditional perspective camera based SfM suffers from the scale ambiguity which is inherent to the pinhole camera geometry. In contrast, an XSlit camera captures rays passing through two oblique lines in 3D space and we show such ray geometry directly resolves the scale ambiguity when employed for SfM. To accommodate the XSlit cameras, we develop tailored feature matching, camera pose estimation, triangulation, and bundle adjustment techniques. Specifically, we devise a SIFT feature variant using non-uniform Gaussian kernels to handle the distortions in XSlit images for reliable feature matching. Moreover, we demonstrate that the XSlit camera exhibits ambiguities in pose estimation process which can not be handled by existing work. Consequently, we propose a 14 point algorithm to properly handle the XSlit degeneracy and estimate the relative pose between XSlit cameras from feature correspondences. We further exploit the unique depth-dependent aspect ratio (DDAR) property to improve the bundle adjustment for the XSlit camera. Synthetic and real experiments demonstrate that the proposed XSlit SfM can conduct reliable and high fidelity 3D reconstruction at an absolute scale 
650 4 |a Journal Article 
700 1 |a Zhang, Yingliang  |e verfasserin  |4 aut 
700 1 |a Ye, Jinwei  |e verfasserin  |4 aut 
700 1 |a Ji, Yu  |e verfasserin  |4 aut 
700 1 |a Li, Zhong  |e verfasserin  |4 aut 
700 1 |a Zhou, Mingyuan  |e verfasserin  |4 aut 
700 1 |a Yu, Jingyi  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 43(2021), 5 vom: 01. Mai, Seite 1691-1704  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:43  |g year:2021  |g number:5  |g day:01  |g month:05  |g pages:1691-1704 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2019.2957119  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 43  |j 2021  |e 5  |b 01  |c 05  |h 1691-1704