Text Compression-Aided Transformer Encoding

Text encoding is one of the most important steps in Natural Language Processing (NLP). It has been done well by the self-attention mechanism in the current state-of-the-art Transformer encoder, which has brought about significant improvements in the performance of many NLP tasks. Though the Transfor...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 44(2022), 7 vom: 12. Juli, Seite 3840-3857
1. Verfasser: Li, Zuchao (VerfasserIn)
Weitere Verfasser: Zhang, Zhuosheng, Zhao, Hai, Wang, Rui, Chen, Kehai, Utiyama, Masao, Sumita, Eiichiro
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2022
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article