Learning Disentangled Representation for One-Shot Progressive Face Swapping

Although face swapping has attracted much attention in recent years, it remains a challenging problem. Existing methods leverage a large number of data samples to explore the intrinsic properties of face swapping without considering the semantic information of face images. Moreover, the representati...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - PP(2024) vom: 22. Mai
1. Verfasser: Li, Qi (VerfasserIn)
Weitere Verfasser: Wang, Weining, Xu, Chengzhong, Sun, Zhenan, Yang, Ming-Hsuan
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2024
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM372645283
003 DE-627
005 20240523233144.0
007 cr uuu---uuuuu
008 240523s2024 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2024.3404334  |2 doi 
028 5 2 |a pubmed24n1416.xml 
035 |a (DE-627)NLM372645283 
035 |a (NLM)38776190 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Li, Qi  |e verfasserin  |4 aut 
245 1 0 |a Learning Disentangled Representation for One-Shot Progressive Face Swapping 
264 1 |c 2024 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Revised 23.05.2024 
500 |a published: Print-Electronic 
500 |a Citation Status Publisher 
520 |a Although face swapping has attracted much attention in recent years, it remains a challenging problem. Existing methods leverage a large number of data samples to explore the intrinsic properties of face swapping without considering the semantic information of face images. Moreover, the representation of the identity information tends to be fixed, leading to suboptimal face swapping. In this paper, we present a simple yet efficient method named FaceSwapper, for one-shot face swapping based on Generative Adversarial Networks. Our method consists of a disentangled representation module and a semantic-guided fusion module. The disentangled representation module comprises an attribute encoder and an identity encoder, which aims to achieve the disentanglement of the identity and attribute information. The identity encoder is more flexible, and the attribute encoder contains more attribute details than its competitors. Benefiting from the disentangled representation, FaceSwapper can swap face images progressively. In addition, semantic information is introduced into the semantic-guided fusion module to control the swapped region and model the pose and expression more accurately. Experimental results show that our method achieves state-of-the-art results on benchmark datasets with fewer training samples. Our code is publicly available at https://github.com/liqi-casia/FaceSwapper 
650 4 |a Journal Article 
700 1 |a Wang, Weining  |e verfasserin  |4 aut 
700 1 |a Xu, Chengzhong  |e verfasserin  |4 aut 
700 1 |a Sun, Zhenan  |e verfasserin  |4 aut 
700 1 |a Yang, Ming-Hsuan  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g PP(2024) vom: 22. Mai  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:PP  |g year:2024  |g day:22  |g month:05 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2024.3404334  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d PP  |j 2024  |b 22  |c 05