SSL++ : Improving Self-Supervised Learning by Mitigating the Proxy Task-Specificity Problem

The success of deep convolutional networks (ConvNets) generally relies on a massive amount of well-labeled data, which is labor-intensive and time-consuming to collect and annotate in many scenarios. To eliminate such limitation, self-supervised learning (SSL) is recently proposed. Specifically, by...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on image processing : a publication of the IEEE Signal Processing Society. - 1992. - 31(2022) vom: 21., Seite 1134-1148
1. Verfasser: Chen, Song (VerfasserIn)
Weitere Verfasser: Xue, Jing-Hao, Chang, Jianlong, Zhang, Jianzhong, Yang, Jufeng, Tian, Qi
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2022
Zugriff auf das übergeordnete Werk:IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM33468482X
003 DE-627
005 20231225224232.0
007 cr uuu---uuuuu
008 231225s2022 xx |||||o 00| ||eng c
024 7 |a 10.1109/TIP.2021.3135470  |2 doi 
028 5 2 |a pubmed24n1115.xml 
035 |a (DE-627)NLM33468482X 
035 |a (NLM)34932477 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Chen, Song  |e verfasserin  |4 aut 
245 1 0 |a SSL++  |b Improving Self-Supervised Learning by Mitigating the Proxy Task-Specificity Problem 
264 1 |c 2022 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 21.01.2022 
500 |a Date Revised 21.01.2022 
500 |a published: Print-Electronic 
500 |a Citation Status MEDLINE 
520 |a The success of deep convolutional networks (ConvNets) generally relies on a massive amount of well-labeled data, which is labor-intensive and time-consuming to collect and annotate in many scenarios. To eliminate such limitation, self-supervised learning (SSL) is recently proposed. Specifically, by solving a pre-designed proxy task, SSL is capable of capturing general-purpose features without requiring human supervision. Existing efforts focus obsessively on designing a particular proxy task but ignore the semanticity of samples that are advantageous to downstream tasks, resulting in the inherent limitation that the learned features are specific to the proxy task, namely the proxy task-specificity of features. In this work, to improve the generalizability of features learned by existing SSL methods, we present a novel self-supervised framework SSL++ to incorporate the proxy task-independent semanticity of samples into the representation learning process. Technically, SSL++ aims to leverage the complementarity, between the low-level generic features learned by a proxy task and the high-level semantic features newly learned by the generated semantic pseudo-labels, to mitigate the task-specificity and improve the generalizability of features. Extensive experiments show that SSL++ performs favorably against the state-of-the-art approaches on the established and latest SSL benchmarks 
650 4 |a Journal Article 
700 1 |a Xue, Jing-Hao  |e verfasserin  |4 aut 
700 1 |a Chang, Jianlong  |e verfasserin  |4 aut 
700 1 |a Zhang, Jianzhong  |e verfasserin  |4 aut 
700 1 |a Yang, Jufeng  |e verfasserin  |4 aut 
700 1 |a Tian, Qi  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on image processing : a publication of the IEEE Signal Processing Society  |d 1992  |g 31(2022) vom: 21., Seite 1134-1148  |w (DE-627)NLM09821456X  |x 1941-0042  |7 nnns 
773 1 8 |g volume:31  |g year:2022  |g day:21  |g pages:1134-1148 
856 4 0 |u http://dx.doi.org/10.1109/TIP.2021.3135470  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 31  |j 2022  |b 21  |h 1134-1148