Understanding Whitening Loss in Self-Supervised Learning
A desirable objective in self-supervised learning (SSL) is to avoid feature collapse. Whitening loss guarantees collapse avoidance by minimizing the distance between embeddings of positive pairs under the conditioning that the embeddings from different views are whitened. In this paper, we propose a...
Description complète
Détails bibliographiques
Publié dans: | IEEE transactions on pattern analysis and machine intelligence. - 1979. - 46(2024), 12 vom: 21. Dez., Seite 9479-9492
|
Auteur principal: |
Huang, Lei
(Auteur) |
Autres auteurs: |
Ni, Yunhao,
Weng, Xi,
Anwer, Rao Muhammad,
Khan, Salman,
Yang, Ming-Hsuan,
Khan, Fahad Shahbaz |
Format: | Article en ligne
|
Langue: | English |
Publié: |
2024
|
Accès à la collection: | IEEE transactions on pattern analysis and machine intelligence
|
Sujets: | Journal Article |