Z-Splat : Z-Axis Gaussian Splatting for Camera-Sonar Fusion

Differentiable 3D-Gaussian splatting (GS) is emerging as a prominent technique in computer vision and graphics for reconstructing 3D scenes. GS represents a scene as a set of 3D Gaussians with varying opacities and employs a computationally efficient splatting operation along with analytical derivat...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - PP(2024) vom: 23. Sept.
1. Verfasser: Qu, Ziyuan (VerfasserIn)
Weitere Verfasser: Vengurlekar, Omkar, Qadri, Mohamad, Zhang, Kevin, Kaess, Michael, Metzler, Christopher, Jayasuriya, Suren, Pediredla, Adithya
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2024
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM377993905
003 DE-627
005 20240924233248.0
007 cr uuu---uuuuu
008 240924s2024 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2024.3462290  |2 doi 
028 5 2 |a pubmed24n1547.xml 
035 |a (DE-627)NLM377993905 
035 |a (NLM)39312437 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Qu, Ziyuan  |e verfasserin  |4 aut 
245 1 0 |a Z-Splat  |b Z-Axis Gaussian Splatting for Camera-Sonar Fusion 
264 1 |c 2024 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Revised 23.09.2024 
500 |a published: Print-Electronic 
500 |a Citation Status Publisher 
520 |a Differentiable 3D-Gaussian splatting (GS) is emerging as a prominent technique in computer vision and graphics for reconstructing 3D scenes. GS represents a scene as a set of 3D Gaussians with varying opacities and employs a computationally efficient splatting operation along with analytical derivatives to compute the 3D Gaussian parameters given scene images captured from various viewpoints. Unfortunately, capturing surround view (360° viewpoint) images is impossible or impractical in many real-world imaging scenarios, including underwater imaging, rooms inside a building, and autonomous navigation. In these restricted baseline imaging scenarios, the GS algorithm suffers from a well-known 'missing cone' problem, which results in poor reconstruction along the depth axis. In this paper, we demonstrate that using transient data (from sonars) allows us to address the missing cone problem by sampling high-frequency data along the depth axis. We extend the Gaussian splatting algorithms for two commonly used sonars and propose fusion algorithms that simultaneously utilize RGB camera data and sonar data. Through simulations, emulations, and hardware experiments across various imaging scenarios, we show that the proposed fusion algorithms lead to significantly better novel view synthesis (5 dB improvement in PSNR) and 3D geometry reconstruction (60% lower Chamfer distance) 
650 4 |a Journal Article 
700 1 |a Vengurlekar, Omkar  |e verfasserin  |4 aut 
700 1 |a Qadri, Mohamad  |e verfasserin  |4 aut 
700 1 |a Zhang, Kevin  |e verfasserin  |4 aut 
700 1 |a Kaess, Michael  |e verfasserin  |4 aut 
700 1 |a Metzler, Christopher  |e verfasserin  |4 aut 
700 1 |a Jayasuriya, Suren  |e verfasserin  |4 aut 
700 1 |a Pediredla, Adithya  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g PP(2024) vom: 23. Sept.  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:PP  |g year:2024  |g day:23  |g month:09 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2024.3462290  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d PP  |j 2024  |b 23  |c 09