Adan : Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

In deep learning, different kinds of deep networks typically need different optimizers, which have to be chosen after multiple trials, making the training process inefficient. To relieve this issue and consistently improve the model training speed across deep networks, we propose the ADAptive Nester...

Description complète

Détails bibliographiques

Publié dans:	IEEE transactions on pattern analysis and machine intelligence. - 1979. - 46(2024), 12 vom: 04. Dez., Seite 9508-9520
Auteur principal:	Xie, Xingyu (Auteur)
Autres auteurs:	Zhou, Pan, Li, Huan, Lin, Zhouchen, Yan, Shuicheng
Format:	Article en ligne
Langue:	English
Publié:	2024
Accès à la collection:	IEEE transactions on pattern analysis and machine intelligence
Sujets:	Journal Article