A Novel Geometric Framework on Gram Matrix Trajectories for Human Behavior Understanding

In this paper, we propose a novel space-time geometric representation of human landmark configurations and derive tools for comparison and classification. We model the temporal evolution of landmarks as parametrized trajectories on the Riemannian manifold of positive semidefinite matrices of fixed-r...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 42(2020), 1 vom: 01. Jan., Seite 1-14
1. Verfasser: Kacem, Anis (VerfasserIn)
Weitere Verfasser: Daoudi, Mohamed, Amor, Boulbaba Ben, Berretti, Stefano, Alvarez-Paiva, Juan Carlos
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2020
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article Research Support, Non-U.S. Gov't
LEADER 01000naa a22002652 4500
001 NLM28916964X
003 DE-627
005 20231225061947.0
007 cr uuu---uuuuu
008 231225s2020 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2018.2872564  |2 doi 
028 5 2 |a pubmed24n0963.xml 
035 |a (DE-627)NLM28916964X 
035 |a (NLM)30281437 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Kacem, Anis  |e verfasserin  |4 aut 
245 1 2 |a A Novel Geometric Framework on Gram Matrix Trajectories for Human Behavior Understanding 
264 1 |c 2020 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 18.12.2020 
500 |a Date Revised 18.12.2020 
500 |a published: Print-Electronic 
500 |a Citation Status MEDLINE 
520 |a In this paper, we propose a novel space-time geometric representation of human landmark configurations and derive tools for comparison and classification. We model the temporal evolution of landmarks as parametrized trajectories on the Riemannian manifold of positive semidefinite matrices of fixed-rank. Our representation has the benefit to bring naturally a second desirable quantity when comparing shapes-the spatial covariance-in addition to the conventional affine-shape representation. We derived then geometric and computational tools for rate-invariant analysis and adaptive re-sampling of trajectories, grounding on the Riemannian geometry of the underlying manifold. Specifically, our approach involves three steps: (1) landmarks are first mapped into the Riemannian manifold of positive semidefinite matrices of fixed-rank to build time-parameterized trajectories; (2) a temporal warping is performed on the trajectories, providing a geometry-aware (dis-)similarity measure between them; (3) finally, a pairwise proximity function SVM is used to classify them, incorporating the (dis-)similarity measure into the kernel function. We show that such representation and metric achieve competitive results in applications as action recognition and emotion recognition from 3D skeletal data, and facial expression recognition from videos. Experiments have been conducted on several publicly available up-to-date benchmarks 
650 4 |a Journal Article 
650 4 |a Research Support, Non-U.S. Gov't 
700 1 |a Daoudi, Mohamed  |e verfasserin  |4 aut 
700 1 |a Amor, Boulbaba Ben  |e verfasserin  |4 aut 
700 1 |a Berretti, Stefano  |e verfasserin  |4 aut 
700 1 |a Alvarez-Paiva, Juan Carlos  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 42(2020), 1 vom: 01. Jan., Seite 1-14  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:42  |g year:2020  |g number:1  |g day:01  |g month:01  |g pages:1-14 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2018.2872564  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 42  |j 2020  |e 1  |b 01  |c 01  |h 1-14