ShadowMover : Automatically Projecting Real Shadows onto Virtual Object

Inserting 3D virtual objects into real-world images has many applications in photo editing and augmented reality. One key issue to ensure the reality of the composite whole scene is to generate consistent shadows between virtual and real objects. However, it is challenging to synthesize visually rea...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on visualization and computer graphics. - 1996. - PP(2023) vom: 22. Feb.
1. Verfasser: Yu, Piaopiao (VerfasserIn)
Weitere Verfasser: Guo, Jie, Huang, Fan, Chen, Zhenyu, Wang, Chen, Zhang, Yan, Guo, Yanwen
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2023
Zugriff auf das übergeordnete Werk:IEEE transactions on visualization and computer graphics
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM355323729
003 DE-627
005 20231226064115.0
007 cr uuu---uuuuu
008 231226s2023 xx |||||o 00| ||eng c
024 7 |a 10.1109/TVCG.2023.3247066  |2 doi 
028 5 2 |a pubmed24n1184.xml 
035 |a (DE-627)NLM355323729 
035 |a (NLM)37027714 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Yu, Piaopiao  |e verfasserin  |4 aut 
245 1 0 |a ShadowMover  |b Automatically Projecting Real Shadows onto Virtual Object 
264 1 |c 2023 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Revised 07.04.2023 
500 |a published: Print-Electronic 
500 |a Citation Status Publisher 
520 |a Inserting 3D virtual objects into real-world images has many applications in photo editing and augmented reality. One key issue to ensure the reality of the composite whole scene is to generate consistent shadows between virtual and real objects. However, it is challenging to synthesize visually realistic shadows for virtual and real objects without any explicit geometric information of the real scene or manual intervention, especially for the shadows on the virtual objects projected by real objects. In view of this challenge, we present, to our knowledge, the first end-to-end solution to fully automatically project real shadows onto virtual objects for outdoor scenes. In our method, we introduce the Shifted Shadow Map, a new shadow representation that encodes the binary mask of shifted real shadows after inserting virtual objects in an image. Based on the shifted shadow map, we propose a CNN-based shadow generation model named ShadowMover which first predicts the shifted shadow map for an input image and then automatically generates plausible shadows on any inserted virtual object. A large-scale dataset is constructed to train the model. Our ShadowMover is robust to various scene configurations without relying on any geometric information of the real scene and is free of manual intervention. Extensive experiments validate the effectiveness of our method 
650 4 |a Journal Article 
700 1 |a Guo, Jie  |e verfasserin  |4 aut 
700 1 |a Huang, Fan  |e verfasserin  |4 aut 
700 1 |a Chen, Zhenyu  |e verfasserin  |4 aut 
700 1 |a Wang, Chen  |e verfasserin  |4 aut 
700 1 |a Zhang, Yan  |e verfasserin  |4 aut 
700 1 |a Guo, Yanwen  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on visualization and computer graphics  |d 1996  |g PP(2023) vom: 22. Feb.  |w (DE-627)NLM098269445  |x 1941-0506  |7 nnns 
773 1 8 |g volume:PP  |g year:2023  |g day:22  |g month:02 
856 4 0 |u http://dx.doi.org/10.1109/TVCG.2023.3247066  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d PP  |j 2023  |b 22  |c 02