Real-Time Multi-Map Saliency-Driven Gaze Behavior for Non-Conversational Characters

Gaze behavior of virtual characters in video games and virtual reality experiences is a key factor of realism and immersion. Indeed, gaze plays many roles when interacting with the environment; not only does it indicate what characters are looking at, but it also plays an important role in verbal an...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on visualization and computer graphics. - 1996. - 30(2024), 7 vom: 10. Juni, Seite 3871-3883
1. Verfasser: Goude, Ific (VerfasserIn)
Weitere Verfasser: Bruckert, Alexandre, Olivier, Anne-Helene, Pettre, Julien, Cozot, Remi, Bouatouch, Kadi, Christie, Marc, Hoyet, Ludovic
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2024
Zugriff auf das übergeordnete Werk:IEEE transactions on visualization and computer graphics
Schlagworte:Journal Article
LEADER 01000caa a22002652 4500
001 NLM35527552X
003 DE-627
005 20240628231859.0
007 cr uuu---uuuuu
008 231226s2024 xx |||||o 00| ||eng c
024 7 |a 10.1109/TVCG.2023.3244679  |2 doi 
028 5 2 |a pubmed24n1454.xml 
035 |a (DE-627)NLM35527552X 
035 |a (NLM)37022858 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Goude, Ific  |e verfasserin  |4 aut 
245 1 0 |a Real-Time Multi-Map Saliency-Driven Gaze Behavior for Non-Conversational Characters 
264 1 |c 2024 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 27.06.2024 
500 |a Date Revised 28.06.2024 
500 |a published: Print-Electronic 
500 |a Citation Status MEDLINE 
520 |a Gaze behavior of virtual characters in video games and virtual reality experiences is a key factor of realism and immersion. Indeed, gaze plays many roles when interacting with the environment; not only does it indicate what characters are looking at, but it also plays an important role in verbal and non-verbal behaviors and in making virtual characters alive. Automated computing of gaze behaviors is however a challenging problem, and to date none of the existing methods are capable of producing close-to-real results in an interactive context. We therefore propose a novel method that leverages recent advances in several distinct areas related to visual saliency, attention mechanisms, saccadic behavior modelling, and head-gaze animation techniques. Our approach articulates these advances to converge on a multi-map saliency-driven model which offers real-time realistic gaze behaviors for non-conversational characters, together with additional user-control over customizable features to compose a wide variety of results. We first evaluate the benefits of our approach through an objective evaluation that confronts our gaze simulation with ground truth data using an eye-tracking dataset specifically acquired for this purpose. We then rely on subjective evaluation to measure the level of realism of gaze animations generated by our method, in comparison with gaze animations captured from real actors. Our results show that our method generates gaze behaviors that cannot be distinguished from captured gaze animations. Overall, we believe that these results will open the way for more natural and intuitive design of realistic and coherent gaze animations for real-time applications 
650 4 |a Journal Article 
700 1 |a Bruckert, Alexandre  |e verfasserin  |4 aut 
700 1 |a Olivier, Anne-Helene  |e verfasserin  |4 aut 
700 1 |a Pettre, Julien  |e verfasserin  |4 aut 
700 1 |a Cozot, Remi  |e verfasserin  |4 aut 
700 1 |a Bouatouch, Kadi  |e verfasserin  |4 aut 
700 1 |a Christie, Marc  |e verfasserin  |4 aut 
700 1 |a Hoyet, Ludovic  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on visualization and computer graphics  |d 1996  |g 30(2024), 7 vom: 10. Juni, Seite 3871-3883  |w (DE-627)NLM098269445  |x 1941-0506  |7 nnns 
773 1 8 |g volume:30  |g year:2024  |g number:7  |g day:10  |g month:06  |g pages:3871-3883 
856 4 0 |u http://dx.doi.org/10.1109/TVCG.2023.3244679  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 30  |j 2024  |e 7  |b 10  |c 06  |h 3871-3883