ImTooth : Neural Implicit Tooth for Dental Augmented Reality

The combination of augmented reality (AR) and medicine is an important trend in current research. The powerful display and interaction capabilities of the AR system can assist doctors to perform more complex operations. Since the tooth itself is an exposed rigid body structure, dental AR is a relati...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on visualization and computer graphics. - 1996. - PP(2023) vom: 23. Feb.
1. Verfasser: Li, Hai (VerfasserIn)
Weitere Verfasser: Zhai, Hongjia, Yang, Xingrui, Wu, Zhirong, Wu, Jianchao, Bao, Hujun, Zheng, Yihao, Wang, Haofan, Zhang, Guofeng
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2023
Zugriff auf das übergeordnete Werk:IEEE transactions on visualization and computer graphics
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM355322722
003 DE-627
005 20231226064114.0
007 cr uuu---uuuuu
008 231226s2023 xx |||||o 00| ||eng c
024 7 |a 10.1109/TVCG.2023.3247459  |2 doi 
028 5 2 |a pubmed24n1184.xml 
035 |a (DE-627)NLM355322722 
035 |a (NLM)37027614 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Li, Hai  |e verfasserin  |4 aut 
245 1 0 |a ImTooth  |b Neural Implicit Tooth for Dental Augmented Reality 
264 1 |c 2023 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Revised 07.04.2023 
500 |a published: Print-Electronic 
500 |a Citation Status Publisher 
520 |a The combination of augmented reality (AR) and medicine is an important trend in current research. The powerful display and interaction capabilities of the AR system can assist doctors to perform more complex operations. Since the tooth itself is an exposed rigid body structure, dental AR is a relatively hot research direction with application potential. However, none of the existing dental AR solutions are designed for wearable AR devices such as AR glasses. At the same time, these methods rely on high-precision scanning equipment or auxiliary positioning markers, which greatly increases the operational complexity and cost of clinical AR. In this work, we propose a simple and accurate neural-implicit model-driven dental AR system, named ImTooth, and adapted for AR glasses. Based on the modeling capabilities and differentiable optimization properties of state-of-the-art neural implicit representations, our system fuses reconstruction and registration in a single network, greatly simplifying the existing dental AR solutions and enabling reconstruction, registration, and interaction. Specifically, our method learns a scale-preserving voxel-based neural implicit model from multi-view images captured from a textureless plaster model of the tooth. Apart from color and surface, we also learn the consistent edge feature inside our representation. By leveraging the depth and edge information, our system can register the model to real images without additional training. In practice, our system uses a single Microsoft HoloLens 2 as the only sensor and display device. Experiments show that our method can reconstruct high-precision models and accomplish accurate registration. It is also robust to weak, repeating and inconsistent textures. We also show that our system can be easily integrated into dental diagnostic and therapeutic procedures, such as bracket placement guidance 
650 4 |a Journal Article 
700 1 |a Zhai, Hongjia  |e verfasserin  |4 aut 
700 1 |a Yang, Xingrui  |e verfasserin  |4 aut 
700 1 |a Wu, Zhirong  |e verfasserin  |4 aut 
700 1 |a Wu, Jianchao  |e verfasserin  |4 aut 
700 1 |a Bao, Hujun  |e verfasserin  |4 aut 
700 1 |a Zheng, Yihao  |e verfasserin  |4 aut 
700 1 |a Wang, Haofan  |e verfasserin  |4 aut 
700 1 |a Zhang, Guofeng  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on visualization and computer graphics  |d 1996  |g PP(2023) vom: 23. Feb.  |w (DE-627)NLM098269445  |x 1941-0506  |7 nnns 
773 1 8 |g volume:PP  |g year:2023  |g day:23  |g month:02 
856 4 0 |u http://dx.doi.org/10.1109/TVCG.2023.3247459  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d PP  |j 2023  |b 23  |c 02