Understanding Whitening Loss in Self-Supervised Learning

A desirable objective in self-supervised learning (SSL) is to avoid feature collapse. Whitening loss guarantees collapse avoidance by minimizing the distance between embeddings of positive pairs under the conditioning that the embeddings from different views are whitened. In this paper, we propose a...

Description complète

Détails bibliographiques
Publié dans:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 46(2024), 12 vom: 21. Dez., Seite 9479-9492
Auteur principal: Huang, Lei (Auteur)
Autres auteurs: Ni, Yunhao, Weng, Xi, Anwer, Rao Muhammad, Khan, Salman, Yang, Ming-Hsuan, Khan, Fahad Shahbaz
Format: Article en ligne
Langue:English
Publié: 2024
Accès à la collection:IEEE transactions on pattern analysis and machine intelligence
Sujets:Journal Article