|
|
|
|
| LEADER |
01000naa a22002652 4500 |
| 001 |
NLM355202360 |
| 003 |
DE-627 |
| 005 |
20231226063839.0 |
| 007 |
cr uuu---uuuuu |
| 008 |
231226s2023 xx |||||o 00| ||eng c |
| 024 |
7 |
|
|a 10.1109/TPAMI.2022.3227571
|2 doi
|
| 028 |
5 |
2 |
|a pubmed24n1183.xml
|
| 035 |
|
|
|a (DE-627)NLM355202360
|
| 035 |
|
|
|a (NLM)37015490
|
| 040 |
|
|
|a DE-627
|b ger
|c DE-627
|e rakwb
|
| 041 |
|
|
|a eng
|
| 100 |
1 |
|
|a Nguyen, Tran Thien Dat
|e verfasserin
|4 aut
|
| 245 |
1 |
0 |
|a How Trustworthy are Performance Evaluations for Basic Vision Tasks?
|
| 264 |
|
1 |
|c 2023
|
| 336 |
|
|
|a Text
|b txt
|2 rdacontent
|
| 337 |
|
|
|a ƒaComputermedien
|b c
|2 rdamedia
|
| 338 |
|
|
|a ƒa Online-Ressource
|b cr
|2 rdacarrier
|
| 500 |
|
|
|a Date Completed 06.06.2023
|
| 500 |
|
|
|a Date Revised 06.06.2023
|
| 500 |
|
|
|a published: Print-Electronic
|
| 500 |
|
|
|a Citation Status PubMed-not-MEDLINE
|
| 520 |
|
|
|a This article examines performance evaluation criteria for basic vision tasks involving sets of objects namely, object detection, instance-level segmentation and multi-object tracking. The rankings of algorithms by a criterion can fluctuate with different choices of parameters, e.g. Intersection over Union (IoU) threshold, making their evaluations unreliable. More importantly, there is no means to verify whether we can trust the evaluations of a criterion. This work suggests a notion of trustworthiness for performance criteria, which requires (i) robustness to parameters for reliability, (ii) contextual meaningfulness in sanity tests, and (iii) consistency with mathematical requirements such as the metric properties. We observe that these requirements were overlooked by many widely-used criteria, and explore alternative criteria using metrics for sets of shapes. We also assess all these criteria based on the suggested requirements for trustworthiness
|
| 650 |
|
4 |
|a Journal Article
|
| 700 |
1 |
|
|a Rezatofighi, Hamid
|e verfasserin
|4 aut
|
| 700 |
1 |
|
|a Vo, Ba-Ngu
|e verfasserin
|4 aut
|
| 700 |
1 |
|
|a Vo, Ba-Tuong
|e verfasserin
|4 aut
|
| 700 |
1 |
|
|a Savarese, Silvio
|e verfasserin
|4 aut
|
| 700 |
1 |
|
|a Reid, Ian
|e verfasserin
|4 aut
|
| 773 |
0 |
8 |
|i Enthalten in
|t IEEE transactions on pattern analysis and machine intelligence
|d 1979
|g 45(2023), 7 vom: 09. Juli, Seite 8538-8552
|w (DE-627)NLM098212257
|x 1939-3539
|7 nnns
|
| 773 |
1 |
8 |
|g volume:45
|g year:2023
|g number:7
|g day:09
|g month:07
|g pages:8538-8552
|
| 856 |
4 |
0 |
|u http://dx.doi.org/10.1109/TPAMI.2022.3227571
|3 Volltext
|
| 912 |
|
|
|a GBV_USEFLAG_A
|
| 912 |
|
|
|a SYSFLAG_A
|
| 912 |
|
|
|a GBV_NLM
|
| 912 |
|
|
|a GBV_ILN_350
|
| 951 |
|
|
|a AR
|
| 952 |
|
|
|d 45
|j 2023
|e 7
|b 09
|c 07
|h 8538-8552
|