Towards Disentangling Latent Space for Unsupervised Semantic Face Editing

Facial attributes in StyleGAN generated images are entangled in the latent space which makes it very difficult to independently control a specific attribute without affecting the others. Supervised attribute editing requires annotated training data which is difficult to obtain and limits the editabl...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on image processing : a publication of the IEEE Signal Processing Society. - 1992. - 31(2022) vom: 19., Seite 1475-1489
1. Verfasser: Liu, Kanglin (VerfasserIn)
Weitere Verfasser: Cao, Gaofeng, Zhou, Fei, Liu, Bozhi, Duan, Jiang, Qiu, Guoping
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2022
Zugriff auf das übergeordnete Werk:IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM335796141
003 DE-627
005 20231225230657.0
007 cr uuu---uuuuu
008 231225s2022 xx |||||o 00| ||eng c
024 7 |a 10.1109/TIP.2022.3142527  |2 doi 
028 5 2 |a pubmed24n1119.xml 
035 |a (DE-627)NLM335796141 
035 |a (NLM)35044915 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Liu, Kanglin  |e verfasserin  |4 aut 
245 1 0 |a Towards Disentangling Latent Space for Unsupervised Semantic Face Editing 
264 1 |c 2022 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 31.01.2022 
500 |a Date Revised 31.01.2022 
500 |a published: Print-Electronic 
500 |a Citation Status MEDLINE 
520 |a Facial attributes in StyleGAN generated images are entangled in the latent space which makes it very difficult to independently control a specific attribute without affecting the others. Supervised attribute editing requires annotated training data which is difficult to obtain and limits the editable attributes to those with labels. Therefore, unsupervised attribute editing in an disentangled latent space is key to performing neat and versatile semantic face editing. In this paper, we present a new technique termed Structure-Texture Independent Architecture with Weight Decomposition and Orthogonal Regularization (STIA-WO) to disentangle the latent space for unsupervised semantic face editing. By applying STIA-WO to GAN, we have developed a StyleGAN termed STGAN-WO which performs weight decomposition through utilizing the style vector to construct a fully controllable weight matrix to regulate image synthesis, and employs orthogonal regularization to ensure each entry of the style vector only controls one independent feature matrix. To further disentangle the facial attributes, STGAN-WO introduces a structure-texture independent architecture which utilizes two independently and identically distributed (i.i.d.) latent vectors to control the synthesis of the texture and structure components in a disentangled way. Unsupervised semantic editing is achieved by moving the latent code in the coarse layers along its orthogonal directions to change texture related attributes or changing the latent code in the fine layers to manipulate structure related ones. We present experimental results which show that our new STGAN-WO can achieve better attribute editing than state of the art methods 
650 4 |a Journal Article 
700 1 |a Cao, Gaofeng  |e verfasserin  |4 aut 
700 1 |a Zhou, Fei  |e verfasserin  |4 aut 
700 1 |a Liu, Bozhi  |e verfasserin  |4 aut 
700 1 |a Duan, Jiang  |e verfasserin  |4 aut 
700 1 |a Qiu, Guoping  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on image processing : a publication of the IEEE Signal Processing Society  |d 1992  |g 31(2022) vom: 19., Seite 1475-1489  |w (DE-627)NLM09821456X  |x 1941-0042  |7 nnns 
773 1 8 |g volume:31  |g year:2022  |g day:19  |g pages:1475-1489 
856 4 0 |u http://dx.doi.org/10.1109/TIP.2022.3142527  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 31  |j 2022  |b 19  |h 1475-1489