Booster : A Benchmark for Depth From Images of Specular and Transparent Surfaces

Estimating depth from images nowadays yields outstanding results, both in terms of in-domain accuracy and generalization. However, we identify two main challenges that remain open in this field: dealing with non-Lambertian materials and effectively processing high-resolution images. Purposely, we pr...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 46(2023), 1 vom: 11. Jan., Seite 85-102
1. Verfasser: Ramirez, Pierluigi Zama (VerfasserIn)
Weitere Verfasser: Costanzino, Alex, Tosi, Fabio, Poggi, Matteo, Salti, Samuele, Mattoccia, Stefano, Stefano, Luigi Di
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2024
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM363129154
003 DE-627
005 20231226092707.0
007 cr uuu---uuuuu
008 231226s2024 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2023.3323858  |2 doi 
028 5 2 |a pubmed24n1210.xml 
035 |a (DE-627)NLM363129154 
035 |a (NLM)37819829 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Ramirez, Pierluigi Zama  |e verfasserin  |4 aut 
245 1 0 |a Booster  |b A Benchmark for Depth From Images of Specular and Transparent Surfaces 
264 1 |c 2024 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Revised 06.12.2023 
500 |a published: Print-Electronic 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a Estimating depth from images nowadays yields outstanding results, both in terms of in-domain accuracy and generalization. However, we identify two main challenges that remain open in this field: dealing with non-Lambertian materials and effectively processing high-resolution images. Purposely, we propose a novel dataset that includes accurate and dense ground-truth labels at high resolution, featuring scenes containing several specular and transparent surfaces. Our acquisition pipeline leverages a novel deep space-time stereo framework, enabling easy and accurate labeling with sub-pixel precision. The dataset is composed of 606 samples collected in 85 different scenes, each sample includes both a high-resolution pair (12 Mpx) as well as an unbalanced stereo pair (Left: 12 Mpx, Right: 1.1 Mpx), typical of modern mobile devices that mount sensors with different resolutions. Additionally, we provide manually annotated material segmentation masks and 15 K unlabeled samples. The dataset is composed of a train set and two test sets, the latter devoted to the evaluation of stereo and monocular depth estimation networks. Our experiments highlight the open challenges and future research directions in this field 
650 4 |a Journal Article 
700 1 |a Costanzino, Alex  |e verfasserin  |4 aut 
700 1 |a Tosi, Fabio  |e verfasserin  |4 aut 
700 1 |a Poggi, Matteo  |e verfasserin  |4 aut 
700 1 |a Salti, Samuele  |e verfasserin  |4 aut 
700 1 |a Mattoccia, Stefano  |e verfasserin  |4 aut 
700 1 |a Stefano, Luigi Di  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 46(2023), 1 vom: 11. Jan., Seite 85-102  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:46  |g year:2023  |g number:1  |g day:11  |g month:01  |g pages:85-102 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2023.3323858  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 46  |j 2023  |e 1  |b 11  |c 01  |h 85-102