Rhythm is a Dancer : Music-Driven Motion Synthesis With Global Structure

Synthesizing human motion with a global structure, such as a choreography, is a challenging task. Existing methods tend to concentrate on local smooth pose transitions and neglect the global context or the theme of the motion. In this work, we present a music-driven motion synthesis framework that g...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on visualization and computer graphics. - 1996. - 29(2023), 8 vom: 30. Aug., Seite 3519-3534
1. Verfasser: Aristidou, Andreas (VerfasserIn)
Weitere Verfasser: Yiannakidis, Anastasios, Aberman, Kfir, Cohen-Or, Daniel, Shamir, Ariel, Chrysanthou, Yiorgos
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2023
Zugriff auf das übergeordnete Werk:IEEE transactions on visualization and computer graphics
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM338837515
003 DE-627
005 20231226001553.0
007 cr uuu---uuuuu
008 231226s2023 xx |||||o 00| ||eng c
024 7 |a 10.1109/TVCG.2022.3163676  |2 doi 
028 5 2 |a pubmed24n1129.xml 
035 |a (DE-627)NLM338837515 
035 |a (NLM)35353702 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Aristidou, Andreas  |e verfasserin  |4 aut 
245 1 0 |a Rhythm is a Dancer  |b Music-Driven Motion Synthesis With Global Structure 
264 1 |c 2023 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 03.07.2023 
500 |a Date Revised 03.07.2023 
500 |a published: Print-Electronic 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a Synthesizing human motion with a global structure, such as a choreography, is a challenging task. Existing methods tend to concentrate on local smooth pose transitions and neglect the global context or the theme of the motion. In this work, we present a music-driven motion synthesis framework that generates long-term sequences of human motions which are synchronized with the input beats, and jointly form a global structure that respects a specific dance genre. In addition, our framework enables generation of diverse motions that are controlled by the content of the music, and not only by the beat. Our music-driven dance synthesis framework is a hierarchical system that consists of three levels: pose, motif, and choreography. The pose level consists of an LSTM component that generates temporally coherent sequences of poses. The motif level guides sets of consecutive poses to form a movement that belongs to a specific distribution using a novel motion perceptual-loss. And the choreography level selects the order of the performed movements and drives the system to follow the global structure of a dance genre. Our results demonstrate the effectiveness of our music-driven framework to generate natural and consistent movements on various dance types, having control over the content of the synthesized motions, and respecting the overall structure of the dance 
650 4 |a Journal Article 
700 1 |a Yiannakidis, Anastasios  |e verfasserin  |4 aut 
700 1 |a Aberman, Kfir  |e verfasserin  |4 aut 
700 1 |a Cohen-Or, Daniel  |e verfasserin  |4 aut 
700 1 |a Shamir, Ariel  |e verfasserin  |4 aut 
700 1 |a Chrysanthou, Yiorgos  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on visualization and computer graphics  |d 1996  |g 29(2023), 8 vom: 30. Aug., Seite 3519-3534  |w (DE-627)NLM098269445  |x 1941-0506  |7 nnns 
773 1 8 |g volume:29  |g year:2023  |g number:8  |g day:30  |g month:08  |g pages:3519-3534 
856 4 0 |u http://dx.doi.org/10.1109/TVCG.2022.3163676  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 29  |j 2023  |e 8  |b 30  |c 08  |h 3519-3534