A Theoretical View of Linear Backpropagation and its Convergence
Backpropagation (BP) is widely used for calculating gradients in deep neural networks (DNNs). Applied often along with stochastic gradient descent (SGD) or its variants, BP is considered as a de-facto choice in a variety of machine learning tasks including DNN training and adversarial attack/defense...
Publié dans: | IEEE transactions on pattern analysis and machine intelligence. - 1979. - 46(2024), 5 vom: 26. Mai, Seite 3972-3980 |
---|---|
Auteur principal: | |
Autres auteurs: | , , |
Format: | Article en ligne |
Langue: | English |
Publié: |
2024
|
Accès à la collection: | IEEE transactions on pattern analysis and machine intelligence |
Sujets: | Journal Article |
Accès en ligne |
Volltext |