Re-Thinking the Effectiveness of Batch Normalization and Beyond
Batch normalization (BN) is used by default in many modern deep neural networks due to its effectiveness in accelerating training convergence and boosting inference performance. Recent studies suggest that the effectiveness of BN is due to the Lipschitzness of the loss and gradient, rather than the...
| Publié dans: | IEEE transactions on pattern analysis and machine intelligence. - 1979. - 46(2024), 1 vom: 25. Jan., Seite 465-478 |
|---|---|
| Auteur principal: | |
| Autres auteurs: | , |
| Format: | Article en ligne |
| Langue: | English |
| Publié: |
2024
|
| Accès à la collection: | IEEE transactions on pattern analysis and machine intelligence |
| Sujets: | Journal Article |
| Accès en ligne |
Volltext |