Pattern Guided UV Recovery for Realistic Video Garment Texturing

The fast growth of E-Commerce creates a global market worth USD 821 billion for online fashion shopping. What unique about fashion presentation is that, the same design can usually be offered with different cloths textures. However, only real video capturing or manual per-frame editing can be used f...

Description complète

Détails bibliographiques
Publié dans:IEEE transactions on visualization and computer graphics. - 1996. - 30(2024), 12 vom: 16. Dez., Seite 7531-7543
Auteur principal: Zhan, Youyi (Auteur)
Autres auteurs: Wang, Tuanfeng Y, Shao, Tianjia, Zhou, Kun
Format: Article en ligne
Langue:English
Publié: 2024
Accès à la collection:IEEE transactions on visualization and computer graphics
Sujets:Journal Article
LEADER 01000caa a22002652c 4500
001 NLM367179628
003 DE-627
005 20250305164055.0
007 cr uuu---uuuuu
008 240116s2024 xx |||||o 00| ||eng c
024 7 |a 10.1109/TVCG.2024.3354727  |2 doi 
028 5 2 |a pubmed25n1223.xml 
035 |a (DE-627)NLM367179628 
035 |a (NLM)38227412 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Zhan, Youyi  |e verfasserin  |4 aut 
245 1 0 |a Pattern Guided UV Recovery for Realistic Video Garment Texturing 
264 1 |c 2024 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Revised 29.10.2024 
500 |a published: Print-Electronic 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a The fast growth of E-Commerce creates a global market worth USD 821 billion for online fashion shopping. What unique about fashion presentation is that, the same design can usually be offered with different cloths textures. However, only real video capturing or manual per-frame editing can be used for virtual showcase on the same design with different textures, both of which are heavily labor intensive. In this paper, we present a pattern-based approach for UV and shading recovery from a captured real video so that the garment's texture can be replaced automatically. The core of our approach is a per-pixel UV regression module via blended-weight multilayer perceptrons (MLPs) driven by the detected discrete correspondences from the cloth pattern. We propose a novel loss on the Jacobian of the UV mapping to create pleasant seams around the folding areas and the boundary of occluded regions while avoiding UV distortion. We also adopts the temporal constraint to ensure consistency and accuracy in UV prediction across adjacent frames. We show that our approach is robust to a variety type of clothes, in the wild illuminations and with challenging motions. We show plausible texture replacement results in our experiment, in which the folding and overlapping of the garment can be greatly preserved. We also show clear qualitative and quantitative improvement compared to the baselines as well. With the one-click setup, we look forward to our approach contributing to the growth of fashion E-commerce 
650 4 |a Journal Article 
700 1 |a Wang, Tuanfeng Y  |e verfasserin  |4 aut 
700 1 |a Shao, Tianjia  |e verfasserin  |4 aut 
700 1 |a Zhou, Kun  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on visualization and computer graphics  |d 1996  |g 30(2024), 12 vom: 16. Dez., Seite 7531-7543  |w (DE-627)NLM098269445  |x 1941-0506  |7 nnas 
773 1 8 |g volume:30  |g year:2024  |g number:12  |g day:16  |g month:12  |g pages:7531-7543 
856 4 0 |u http://dx.doi.org/10.1109/TVCG.2024.3354727  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 30  |j 2024  |e 12  |b 16  |c 12  |h 7531-7543