A Theoretical View of Linear Backpropagation and its Convergence

Backpropagation (BP) is widely used for calculating gradients in deep neural networks (DNNs). Applied often along with stochastic gradient descent (SGD) or its variants, BP is considered as a de-facto choice in a variety of machine learning tasks including DNN training and adversarial attack/defense...

Description complète

Détails bibliographiques
Publié dans:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 46(2024), 5 vom: 26. Mai, Seite 3972-3980
Auteur principal: Li, Ziang (Auteur)
Autres auteurs: Guo, Yiwen, Liu, Haodi, Zhang, Changshui
Format: Article en ligne
Langue:English
Publié: 2024
Accès à la collection:IEEE transactions on pattern analysis and machine intelligence
Sujets:Journal Article