Labeled Graph Kernel for Behavior Analysis

Automatic behavior analysis from video is a major topic in many areas of research, including computer vision, multimedia, robotics, biology, cognitive science, social psychology, psychiatry, and linguistics. Two major problems are of interest when analyzing behavior. First, we wish to automatically...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 38(2016), 8 vom: 10. Aug., Seite 1640-50
1. Verfasser: Zhao, Ruiqi (VerfasserIn)
Weitere Verfasser: Martinez, Aleix M
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2016
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article Research Support, N.I.H., Extramural
LEADER 01000naa a22002652 4500
001 NLM253184150
003 DE-627
005 20231224165705.0
007 cr uuu---uuuuu
008 231224s2016 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2015.2481404  |2 doi 
028 5 2 |a pubmed24n0844.xml 
035 |a (DE-627)NLM253184150 
035 |a (NLM)26415154 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Zhao, Ruiqi  |e verfasserin  |4 aut 
245 1 0 |a Labeled Graph Kernel for Behavior Analysis 
264 1 |c 2016 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 09.05.2018 
500 |a Date Revised 11.01.2019 
500 |a published: Print-Electronic 
500 |a Citation Status MEDLINE 
520 |a Automatic behavior analysis from video is a major topic in many areas of research, including computer vision, multimedia, robotics, biology, cognitive science, social psychology, psychiatry, and linguistics. Two major problems are of interest when analyzing behavior. First, we wish to automatically categorize observed behaviors into a discrete set of classes (i.e., classification). For example, to determine word production from video sequences in sign language. Second, we wish to understand the relevance of each behavioral feature in achieving this classification (i.e., decoding). For instance, to know which behavior variables are used to discriminate between the words apple and onion in American Sign Language (ASL). The present paper proposes to model behavior using a labeled graph, where the nodes define behavioral features and the edges are labels specifying their order (e.g., before, overlaps, start). In this approach, classification reduces to a simple labeled graph matching. Unfortunately, the complexity of labeled graph matching grows exponentially with the number of categories we wish to represent. Here, we derive a graph kernel to quickly and accurately compute this graph similarity. This approach is very general and can be plugged into any kernel-based classifier. Specifically, we derive a Labeled Graph Support Vector Machine (LGSVM) and a Labeled Graph Logistic Regressor (LGLR) that can be readily employed to discriminate between many actions (e.g., sign language concepts). The derived approach can be readily used for decoding too, yielding invaluable information for the understanding of a problem (e.g., to know how to teach a sign language). The derived algorithms allow us to achieve higher accuracy results than those of state-of-the-art algorithms in a fraction of the time. We show experimental results on a variety of problems and datasets, including multimodal data 
650 4 |a Journal Article 
650 4 |a Research Support, N.I.H., Extramural 
700 1 |a Martinez, Aleix M  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 38(2016), 8 vom: 10. Aug., Seite 1640-50  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:38  |g year:2016  |g number:8  |g day:10  |g month:08  |g pages:1640-50 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2015.2481404  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 38  |j 2016  |e 8  |b 10  |c 08  |h 1640-50