Learning Spatially Variant Linear Representation Models for Joint Filtering

Joint filtering mainly uses an additional guidance image as a prior and transfers its structures to the target image in the filtering process. Different from existing approaches that rely on local linear models or hand-designed objective functions to extract the structural information from the guida...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 44(2022), 11 vom: 02. Nov., Seite 8355-8370
1. Verfasser: Dong, Jiangxin (VerfasserIn)
Weitere Verfasser: Pan, Jinshan, Ren, Jimmy S, Lin, Liang, Tang, Jinhui, Yang, Ming-Hsuan
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2022
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM32902132X
003 DE-627
005 20231225204210.0
007 cr uuu---uuuuu
008 231225s2022 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2021.3102575  |2 doi 
028 5 2 |a pubmed24n1096.xml 
035 |a (DE-627)NLM32902132X 
035 |a (NLM)34357863 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Dong, Jiangxin  |e verfasserin  |4 aut 
245 1 0 |a Learning Spatially Variant Linear Representation Models for Joint Filtering 
264 1 |c 2022 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Revised 05.10.2022 
500 |a published: Print-Electronic 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a Joint filtering mainly uses an additional guidance image as a prior and transfers its structures to the target image in the filtering process. Different from existing approaches that rely on local linear models or hand-designed objective functions to extract the structural information from the guidance image, we propose a new joint filtering method based on a spatially variant linear representation model (SVLRM), where the target image is linearly represented by the guidance image. However, learning SVLRMs for vision tasks is a highly ill-posed problem. To estimate the spatially variant linear representation coefficients, we develop an effective approach based on a deep convolutional neural network (CNN). As such, the proposed deep CNN (constrained by the SVLRM) is able to model the structural information of both the guidance and input images. We show that the proposed approach can be effectively applied to a variety of applications, including depth/RGB image upsampling and restoration, flash deblurring, natural image denoising, and scale-aware filtering. In addition, we show that the linear representation model can be extended to high-order representation models (e.g., quadratic and cubic polynomial representations). Extensive experimental results demonstrate that the proposed method performs favorably against the state-of-the-art methods that have been specifically designed for each task 
650 4 |a Journal Article 
700 1 |a Pan, Jinshan  |e verfasserin  |4 aut 
700 1 |a Ren, Jimmy S  |e verfasserin  |4 aut 
700 1 |a Lin, Liang  |e verfasserin  |4 aut 
700 1 |a Tang, Jinhui  |e verfasserin  |4 aut 
700 1 |a Yang, Ming-Hsuan  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 44(2022), 11 vom: 02. Nov., Seite 8355-8370  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:44  |g year:2022  |g number:11  |g day:02  |g month:11  |g pages:8355-8370 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2021.3102575  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 44  |j 2022  |e 11  |b 02  |c 11  |h 8355-8370