MR360 : Mixed Reality Rendering for 360° Panoramic Videos

This paper presents a novel immersive system called MR360 that provides interactive mixed reality (MR) experiences using a conventional low dynamic range (LDR) 360° panoramic video (360-video) shown in head mounted displays (HMDs). MR360 seamlessly composites 3D virtual objects into a live 360-video...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on visualization and computer graphics. - 1996. - 23(2017), 4 vom: 04. Apr., Seite 1379-1388
1. Verfasser: Rhee, Taehyun (VerfasserIn)
Weitere Verfasser: Petikam, Lohit, Allen, Benjamin, Chalmers, Andrew
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2017
Zugriff auf das übergeordnete Werk:IEEE transactions on visualization and computer graphics
Schlagworte:Journal Article Research Support, Non-U.S. Gov't
LEADER 01000naa a22002652 4500
001 NLM268401047
003 DE-627
005 20231224222602.0
007 cr uuu---uuuuu
008 231224s2017 xx |||||o 00| ||eng c
024 7 |a 10.1109/TVCG.2017.2657178  |2 doi 
028 5 2 |a pubmed24n0894.xml 
035 |a (DE-627)NLM268401047 
035 |a (NLM)28129172 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Rhee, Taehyun  |e verfasserin  |4 aut 
245 1 0 |a MR360  |b Mixed Reality Rendering for 360° Panoramic Videos 
264 1 |c 2017 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 04.10.2018 
500 |a Date Revised 04.10.2018 
500 |a published: Print-Electronic 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a This paper presents a novel immersive system called MR360 that provides interactive mixed reality (MR) experiences using a conventional low dynamic range (LDR) 360° panoramic video (360-video) shown in head mounted displays (HMDs). MR360 seamlessly composites 3D virtual objects into a live 360-video using the input panoramic video as the lighting source to illuminate the virtual objects. Image based lighting (IBL) is perceptually optimized to provide fast and believable results using the LDR 360-video as the lighting source. Regions of most salient lights in the input panoramic video are detected to optimize the number of lights used to cast perceptible shadows. Then, the areas of the detected lights adjust the penumbra of the shadow to provide realistic soft shadows. Finally, our real-time differential rendering synthesizes illumination of the virtual 3D objects into the 360-video. MR360 provides the illusion of interacting with objects in a video, which are actually 3D virtual objects seamlessly composited into the background of the 360-video. MR360 was implemented in a commercial game engine and tested using various 360-videos. Since our MR360 pipeline does not require any pre-computation, it can synthesize an interactive MR scene using a live 360-video stream while providing realistic high performance rendering suitable for HMDs 
650 4 |a Journal Article 
650 4 |a Research Support, Non-U.S. Gov't 
700 1 |a Petikam, Lohit  |e verfasserin  |4 aut 
700 1 |a Allen, Benjamin  |e verfasserin  |4 aut 
700 1 |a Chalmers, Andrew  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on visualization and computer graphics  |d 1996  |g 23(2017), 4 vom: 04. Apr., Seite 1379-1388  |w (DE-627)NLM098269445  |x 1941-0506  |7 nnns 
773 1 8 |g volume:23  |g year:2017  |g number:4  |g day:04  |g month:04  |g pages:1379-1388 
856 4 0 |u http://dx.doi.org/10.1109/TVCG.2017.2657178  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 23  |j 2017  |e 4  |b 04  |c 04  |h 1379-1388