Analysis of head gesture and prosody patterns for prosody-driven head-gesture animation

We propose a new two-stage framework for joint analysis of head gesture and speech prosody patterns of a speaker towards automatic realistic synthesis of head gestures from speech prosody. In the first stage analysis, we perform Hidden Markov Model (HMM) based unsupervised temporal segmentation of h...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 30(2008), 8 vom: 05. Aug., Seite 1330-45
1. Verfasser: Sargin, Mehmet E (VerfasserIn)
Weitere Verfasser: Yemez, Yucel, Erzin, Engin, Tekalp, Ahmet M
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2008
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article Research Support, Non-U.S. Gov't
LEADER 01000naa a22002652 4500
001 NLM180332678
003 DE-627
005 20231223155310.0
007 cr uuu---uuuuu
008 231223s2008 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2007.70797  |2 doi 
028 5 2 |a pubmed24n0601.xml 
035 |a (DE-627)NLM180332678 
035 |a (NLM)18566489 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Sargin, Mehmet E  |e verfasserin  |4 aut 
245 1 0 |a Analysis of head gesture and prosody patterns for prosody-driven head-gesture animation 
264 1 |c 2008 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 28.08.2008 
500 |a Date Revised 20.06.2008 
500 |a published: Print 
500 |a Citation Status MEDLINE 
520 |a We propose a new two-stage framework for joint analysis of head gesture and speech prosody patterns of a speaker towards automatic realistic synthesis of head gestures from speech prosody. In the first stage analysis, we perform Hidden Markov Model (HMM) based unsupervised temporal segmentation of head gesture and speech prosody features separately to determine elementary head gesture and speech prosody patterns, respectively, for a particular speaker. In the second stage, joint analysis of correlations between these elementary head gesture and prosody patterns is performed using Multi-Stream HMMs to determine an audio-visual mapping model. The resulting audio-visual mapping model is then employed to synthesize natural head gestures from arbitrary input test speech given a head model for the speaker. In the synthesis stage, the audio-visual mapping model is used to predict a sequence of gesture patterns from the prosody pattern sequence computed for the input test speech. The Euler angles associated with each gesture pattern are then applied to animate the speaker head model. Objective and subjective evaluations indicate that the proposed synthesis by analysis scheme provides natural looking head gestures for the speaker with any input test speech, as well as in "prosody transplant" and gesture transplant" scenarios 
650 4 |a Journal Article 
650 4 |a Research Support, Non-U.S. Gov't 
700 1 |a Yemez, Yucel  |e verfasserin  |4 aut 
700 1 |a Erzin, Engin  |e verfasserin  |4 aut 
700 1 |a Tekalp, Ahmet M  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 30(2008), 8 vom: 05. Aug., Seite 1330-45  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:30  |g year:2008  |g number:8  |g day:05  |g month:08  |g pages:1330-45 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2007.70797  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 30  |j 2008  |e 8  |b 05  |c 08  |h 1330-45