Fast-iTPN : Integrally Pre-Trained Transformer Pyramid Network with Token Migration

We propose integrally pre-trained transformer pyramid network (iTPN), towards jointly optimizing the network backbone and the neck, so that transfer gap between representation models and downstream tasks is minimal. iTPN is born with two elaborated designs: 1) The first pre-trained feature pyramid u...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - PP(2024) vom: 24. Juli
1. Verfasser: Tian, Yunjie (VerfasserIn)
Weitere Verfasser: Xie, Lingxi, Qiu, Jihao, Jiao, Jianbin, Wang, Yaowei, Tian, Qi, Ye, Qixiang
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2024
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article