Optimization Induced Equilibrium Networks : An Explicit Optimization Perspective for Understanding Equilibrium Models

To reveal the mystery behind deep neural networks (DNNs), optimization may offer a good perspective. There are already some clues showing the strong connection between DNNs and optimization problems, e.g., under a mild condition, DNN's activation function is indeed a proximal operator. In this...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 45(2023), 3 vom: 01. März, Seite 3604-3616
1. Verfasser: Xie, Xingyu (VerfasserIn)
Weitere Verfasser: Wang, Qiuhao, Ling, Zenan, Li, Xia, Liu, Guangcan, Lin, Zhouchen
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2023
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article