Forecasting People Trajectories and Head Poses by Jointly Reasoning on Tracklets and Vislets

In this article, we explore the correlation between people trajectories and their head orientations. We argue that people trajectory and head pose forecasting can be modelled as a joint problem. Recent approaches on trajectory forecasting leverage short-term trajectories (aka tracklets) of pedestria...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 43(2021), 4 vom: 31. Apr., Seite 1267-1278
1. Verfasser: Hasan, Irtiza (VerfasserIn)
Weitere Verfasser: Setti, Francesco, Tsesmelis, Theodore, Belagiannis, Vasileios, Amin, Sikandar, Del Bue, Alessio, Cristani, Marco, Galasso, Fabio
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2021
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article Research Support, Non-U.S. Gov't
LEADER 01000naa a22002652 4500
001 NLM302751467
003 DE-627
005 20231225111403.0
007 cr uuu---uuuuu
008 231225s2021 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2019.2949414  |2 doi 
028 5 2 |a pubmed24n1009.xml 
035 |a (DE-627)NLM302751467 
035 |a (NLM)31670663 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Hasan, Irtiza  |e verfasserin  |4 aut 
245 1 0 |a Forecasting People Trajectories and Head Poses by Jointly Reasoning on Tracklets and Vislets 
264 1 |c 2021 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 29.09.2021 
500 |a Date Revised 29.09.2021 
500 |a published: Print-Electronic 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a In this article, we explore the correlation between people trajectories and their head orientations. We argue that people trajectory and head pose forecasting can be modelled as a joint problem. Recent approaches on trajectory forecasting leverage short-term trajectories (aka tracklets) of pedestrians to predict their future paths. In addition, sociological cues, such as expected destination or pedestrian interaction, are often combined with tracklets. In this article, we propose MiXing-LSTM (MX-LSTM) to capture the interplay between positions and head orientations (vislets) thanks to a joint unconstrained optimization of full covariance matrices during the LSTM backpropagation. We additionally exploit the head orientations as a proxy for the visual attention, when modeling social interactions. MX-LSTM predicts future pedestrians location and head pose, increasing the standard capabilities of the current approaches on long-term trajectory forecasting. Compared to the state-of-the-art, our approach shows better performances on an extensive set of public benchmarks. MX-LSTM is particularly effective when people move slowly, i.e., the most challenging scenario for all other models. The proposed approach also allows for accurate predictions on a longer time horizon 
650 4 |a Journal Article 
650 4 |a Research Support, Non-U.S. Gov't 
700 1 |a Setti, Francesco  |e verfasserin  |4 aut 
700 1 |a Tsesmelis, Theodore  |e verfasserin  |4 aut 
700 1 |a Belagiannis, Vasileios  |e verfasserin  |4 aut 
700 1 |a Amin, Sikandar  |e verfasserin  |4 aut 
700 1 |a Del Bue, Alessio  |e verfasserin  |4 aut 
700 1 |a Cristani, Marco  |e verfasserin  |4 aut 
700 1 |a Galasso, Fabio  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 43(2021), 4 vom: 31. Apr., Seite 1267-1278  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:43  |g year:2021  |g number:4  |g day:31  |g month:04  |g pages:1267-1278 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2019.2949414  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 43  |j 2021  |e 4  |b 31  |c 04  |h 1267-1278