Analysis and Optimization of Loss Functions for Multiclass, Top-k, and Multilabel Classification

Top-k error is currently a popular performance measure on large scale image classification benchmarks such as ImageNet and Places. Despite its wide acceptance, our understanding of this metric is limited as most of the previous research is focused on its special case, the top-1 error. In this work,...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 40(2018), 7 vom: 06. Juli, Seite 1533-1554
1. Verfasser: Lapin, Maksim (VerfasserIn)
Weitere Verfasser: Hein, Matthias, Schiele, Bernt
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2018
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM275915468
003 DE-627
005 20231225010803.0
007 cr uuu---uuuuu
008 231225s2018 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2017.2751607  |2 doi 
028 5 2 |a pubmed24n0919.xml 
035 |a (DE-627)NLM275915468 
035 |a (NLM)28920896 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Lapin, Maksim  |e verfasserin  |4 aut 
245 1 0 |a Analysis and Optimization of Loss Functions for Multiclass, Top-k, and Multilabel Classification 
264 1 |c 2018 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 05.04.2019 
500 |a Date Revised 05.04.2019 
500 |a published: Print-Electronic 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a Top-k error is currently a popular performance measure on large scale image classification benchmarks such as ImageNet and Places. Despite its wide acceptance, our understanding of this metric is limited as most of the previous research is focused on its special case, the top-1 error. In this work, we explore two directions that shed more light on the top-k error. First, we provide an in-depth analysis of established and recently proposed single-label multiclass methods along with a detailed account of efficient optimization algorithms for them. Our results indicate that the softmax loss and the smooth multiclass SVM are surprisingly competitive in top-k error uniformly across all k, which can be explained by our analysis of multiclass top-k calibration. Further improvements for a specific k are possible with a number of proposed top-k loss functions. Second, we use the top-k methods to explore the transition from multiclass to multilabel learning. In particular, we find that it is possible to obtain effective multilabel classifiers on Pascal VOC using a single label per image for training, while the gap between multiclass and multilabel methods on MS COCO is more significant. Finally, our contribution of efficient algorithms for training with the considered top-k and multilabel loss functions is of independent interest 
650 4 |a Journal Article 
700 1 |a Hein, Matthias  |e verfasserin  |4 aut 
700 1 |a Schiele, Bernt  |e verfasserin  |4 aut 
700 1 |a Lapin, Maksim  |e verfasserin  |4 aut 
700 1 |a Hein, Matthias  |e verfasserin  |4 aut 
700 1 |a Schiele, Bernt  |e verfasserin  |4 aut 
700 1 |a Hein, Matthias  |e verfasserin  |4 aut 
700 1 |a Schiele, Bernt  |e verfasserin  |4 aut 
700 1 |a Lapin, Maksim  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 40(2018), 7 vom: 06. Juli, Seite 1533-1554  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:40  |g year:2018  |g number:7  |g day:06  |g month:07  |g pages:1533-1554 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2017.2751607  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 40  |j 2018  |e 7  |b 06  |c 07  |h 1533-1554