DART : Distribution Aware Retinal Transform for Event-Based Cameras

We introduce a generic visual descriptor, termed as distribution aware retinal transform (DART), that encodes the structural context using log-polar grids for event cameras. The DART descriptor is applied to four different problems, namely object classification, tracking, detection and feature match...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 42(2020), 11 vom: 30. Nov., Seite 2767-2780
1. Verfasser: Ramesh, Bharath (VerfasserIn)
Weitere Verfasser: Yang, Hong, Orchard, Garrick, Le Thi, Ngoc Anh, Zhang, Shihao, Xiang, Cheng
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2020
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM297624733
003 DE-627
005 20231225092409.0
007 cr uuu---uuuuu
008 231225s2020 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2019.2919301  |2 doi 
028 5 2 |a pubmed24n0992.xml 
035 |a (DE-627)NLM297624733 
035 |a (NLM)31144625 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Ramesh, Bharath  |e verfasserin  |4 aut 
245 1 0 |a DART  |b Distribution Aware Retinal Transform for Event-Based Cameras 
264 1 |c 2020 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 12.02.2021 
500 |a Date Revised 12.02.2021 
500 |a published: Print-Electronic 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a We introduce a generic visual descriptor, termed as distribution aware retinal transform (DART), that encodes the structural context using log-polar grids for event cameras. The DART descriptor is applied to four different problems, namely object classification, tracking, detection and feature matching: (1) The DART features are directly employed as local descriptors in a bag-of-words classification framework and testing is carried out on four standard event-based object datasets (N-MNIST, MNIST-DVS, CIFAR10-DVS, NCaltech-101); (2) Extending the classification system, tracking is demonstrated using two key novelties: (i) Statistical bootstrapping is leveraged with online learning for overcoming the low-sample problem during the one-shot learning of the tracker, (ii) Cyclical shifts are induced in the log-polar domain of the DART descriptor to achieve robustness to object scale and rotation variations; (3) To solve the long-term object tracking problem, an object detector is designed using the principle of cluster majority voting. The detection scheme is then combined with the tracker to result in a high intersection-over-union score with augmented ground truth annotations on the publicly available event camera dataset; (4) Finally, the event context encoded by DART greatly simplifies the feature correspondence problem, especially for spatio-temporal slices far apart in time, which has not been explicitly tackled in the event-based vision domain 
650 4 |a Journal Article 
700 1 |a Yang, Hong  |e verfasserin  |4 aut 
700 1 |a Orchard, Garrick  |e verfasserin  |4 aut 
700 1 |a Le Thi, Ngoc Anh  |e verfasserin  |4 aut 
700 1 |a Zhang, Shihao  |e verfasserin  |4 aut 
700 1 |a Xiang, Cheng  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 42(2020), 11 vom: 30. Nov., Seite 2767-2780  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:42  |g year:2020  |g number:11  |g day:30  |g month:11  |g pages:2767-2780 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2019.2919301  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 42  |j 2020  |e 11  |b 30  |c 11  |h 2767-2780