Recovery of Lost Color and Depth Frames in Multiview Videos

In this paper, we consider an integrated error concealment system for lost color frames and lost depth frames in multiview videos with depths. We first proposed a pixel-based color error-concealment method with the use of depth information. Instead of assuming that the same moving object in consecut...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on image processing : a publication of the IEEE Signal Processing Society. - 1992. - 27(2018), 11 vom: 30. Nov., Seite 5449-5463
1. Verfasser: Ting-Lan Lin (VerfasserIn)
Weitere Verfasser: Chuan-Jia Wang, Tsai-Ling Ding, Gui-Xiang Huang, Wei-Lin Tsai, Tsung-En Chang, Neng-Chieh Yang
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2018
Zugriff auf das übergeordnete Werk:IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM275386244
003 DE-627
005 20231225005547.0
007 cr uuu---uuuuu
008 231225s2018 xx |||||o 00| ||eng c
024 7 |a 10.1109/TIP.2017.2745210  |2 doi 
028 5 2 |a pubmed24n0917.xml 
035 |a (DE-627)NLM275386244 
035 |a (NLM)28866492 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Ting-Lan Lin  |e verfasserin  |4 aut 
245 1 0 |a Recovery of Lost Color and Depth Frames in Multiview Videos 
264 1 |c 2018 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 11.12.2018 
500 |a Date Revised 11.12.2018 
500 |a published: Print-Electronic 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a In this paper, we consider an integrated error concealment system for lost color frames and lost depth frames in multiview videos with depths. We first proposed a pixel-based color error-concealment method with the use of depth information. Instead of assuming that the same moving object in consecutive frames has minimal depth difference, as is done in a state-of-the-art method, a more realistic situation in which the same moving object in consecutive frames can be in different depths is considered. In the derived motion vector candidate set, we consider all the candidate motion vectors in the set, and weight the reference pixels by the depth differences to obtain the final recovered pixel. Compared with the two state-of-the-art methods, the proposed method has average peak signal-to-noise ratio gains of up to 8.73 and 3.98 dB, respectively. Second, we proposed an iterative depth frame error-concealment method. The initial recovered depth frame is obtained by depth-image-based rendering from another available view. The holes in the recovered depth frame are then filled in the proposed priority order. Preprocessing methods (depth difference compensation and inconsistent pixel removal) are performed to improve the performance. Compared with a method that uses the available motion vector in a color frame to recover the lost depth pixels, the hybrid motion vector extrapolation method, the inpainting method and the proposed method have gains of up to 4.31, 10.29, and 6.04 dB, respectively. Finally, for the situation in which the color and the depth frames are lost at the same time, our two methods jointly perform better with a gain of up to 7.79 dB 
650 4 |a Journal Article 
700 1 |a Chuan-Jia Wang  |e verfasserin  |4 aut 
700 1 |a Tsai-Ling Ding  |e verfasserin  |4 aut 
700 1 |a Gui-Xiang Huang  |e verfasserin  |4 aut 
700 1 |a Wei-Lin Tsai  |e verfasserin  |4 aut 
700 1 |a Tsung-En Chang  |e verfasserin  |4 aut 
700 1 |a Neng-Chieh Yang  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on image processing : a publication of the IEEE Signal Processing Society  |d 1992  |g 27(2018), 11 vom: 30. Nov., Seite 5449-5463  |w (DE-627)NLM09821456X  |x 1941-0042  |7 nnns 
773 1 8 |g volume:27  |g year:2018  |g number:11  |g day:30  |g month:11  |g pages:5449-5463 
856 4 0 |u http://dx.doi.org/10.1109/TIP.2017.2745210  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 27  |j 2018  |e 11  |b 30  |c 11  |h 5449-5463