Real-Time Shadow Detection From Live Outdoor Videos for Augmented Reality

Simulating shadow interactions between real and virtual objects is important for augmented reality (AR), in which accurately and efficiently detecting real shadows from live videos is a crucial step. Most of the existing methods are capable of processing only scenes captured under a fixed viewpoint....

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on visualization and computer graphics. - 1996. - 28(2022), 7 vom: 17. Juli, Seite 2748-2763
1. Verfasser: Liu, Yanli (VerfasserIn)
Weitere Verfasser: Zou, Xingming, Xu, Songhua, Xing, Guanyu, Wei, Housheng, Zhang, Yanci
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2022
Zugriff auf das übergeordnete Werk:IEEE transactions on visualization and computer graphics
Schlagworte:Journal Article Research Support, Non-U.S. Gov't
LEADER 01000naa a22002652 4500
001 NLM318121646
003 DE-627
005 20231225164707.0
007 cr uuu---uuuuu
008 231225s2022 xx |||||o 00| ||eng c
024 7 |a 10.1109/TVCG.2020.3041100  |2 doi 
028 5 2 |a pubmed24n1060.xml 
035 |a (DE-627)NLM318121646 
035 |a (NLM)33245695 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Liu, Yanli  |e verfasserin  |4 aut 
245 1 0 |a Real-Time Shadow Detection From Live Outdoor Videos for Augmented Reality 
264 1 |c 2022 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 30.05.2022 
500 |a Date Revised 27.06.2022 
500 |a published: Print-Electronic 
500 |a Citation Status MEDLINE 
520 |a Simulating shadow interactions between real and virtual objects is important for augmented reality (AR), in which accurately and efficiently detecting real shadows from live videos is a crucial step. Most of the existing methods are capable of processing only scenes captured under a fixed viewpoint. In contrast, this article proposes a new framework for shadow detection in live outdoor videos captured under moving viewpoints. The framework splits each frame into a tracked region, which is the region tracked from the previous video frame through optical flow analysis, and an emerging region, which is newly introduced into the scene due to the moving viewpoint. The framework subsequently extracts features based on the intensity profiles surrounding the boundaries of candidate shadow regions. These features are then utilized to both correct erroneous shadow boundaries for the tracked region and to detect shadow boundaries for the emerging region by a Bayesian learning module. To remove spurious shadows, spatial layout constraints are further considered for emerging regions. The experimental results demonstrate that the proposed framework outperforms the state-of-the-art shadow tracking and detection algorithms on a variety of challenging cases in real time, including shadows on backgrounds with complex textures, nonplanar shadows, fast-moving shadows with changing typologies, and shadows cast by nonrigid objects. The quantitative experiments show that our method outperforms the best existing method, achieving a 33.3% increase in the average Fmeasure on a self-collected database. Coupled with an image-based shadow-casting method, the proposed framework generates realistic shadow interaction results. This capability will be particularly beneficial for supporting AR applications 
650 4 |a Journal Article 
650 4 |a Research Support, Non-U.S. Gov't 
700 1 |a Zou, Xingming  |e verfasserin  |4 aut 
700 1 |a Xu, Songhua  |e verfasserin  |4 aut 
700 1 |a Xing, Guanyu  |e verfasserin  |4 aut 
700 1 |a Wei, Housheng  |e verfasserin  |4 aut 
700 1 |a Zhang, Yanci  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on visualization and computer graphics  |d 1996  |g 28(2022), 7 vom: 17. Juli, Seite 2748-2763  |w (DE-627)NLM098269445  |x 1941-0506  |7 nnns 
773 1 8 |g volume:28  |g year:2022  |g number:7  |g day:17  |g month:07  |g pages:2748-2763 
856 4 0 |u http://dx.doi.org/10.1109/TVCG.2020.3041100  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 28  |j 2022  |e 7  |b 17  |c 07  |h 2748-2763