Dynamic Facial Expression Recognition Under Partial Occlusion With Optical Flow Reconstruction

Video facial expression recognition is useful for many applications and received much interest lately. Although some methods give good results in controlled environments (no occlusion), recognition in the presence of partial facial occlusion remains a challenging task. To handle facial occlusions, m...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on image processing : a publication of the IEEE Signal Processing Society. - 1992. - 31(2022) vom: 02., Seite 446-457
1. Verfasser: Poux, Delphine (VerfasserIn)
Weitere Verfasser: Allaert, Benjamin, Ihaddadene, Nacim, Bilasco, Ioan Marius, Djeraba, Chaabane, Bennamoun, Mohammed
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2022
Zugriff auf das übergeordnete Werk:IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM333924258
003 DE-627
005 20231225222641.0
007 cr uuu---uuuuu
008 231225s2022 xx |||||o 00| ||eng c
024 7 |a 10.1109/TIP.2021.3129120  |2 doi 
028 5 2 |a pubmed24n1113.xml 
035 |a (DE-627)NLM333924258 
035 |a (NLM)34855591 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Poux, Delphine  |e verfasserin  |4 aut 
245 1 0 |a Dynamic Facial Expression Recognition Under Partial Occlusion With Optical Flow Reconstruction 
264 1 |c 2022 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 20.12.2021 
500 |a Date Revised 20.12.2021 
500 |a published: Print-Electronic 
500 |a Citation Status MEDLINE 
520 |a Video facial expression recognition is useful for many applications and received much interest lately. Although some methods give good results in controlled environments (no occlusion), recognition in the presence of partial facial occlusion remains a challenging task. To handle facial occlusions, methods based on the reconstruction of the occluded part of the face have been proposed. These methods are mainly based on the texture or the geometry of the face. However, the similarity of the face movement between different persons doing the same expression seems to be a real asset for the reconstruction. In this paper we exploit this asset and propose a new method based on an auto-encoder with skip connections to reconstruct the occluded part of the face in the optical flow domain. To the best of our knowledge, this is the first work that directly reconstructs the movement for facial expression recognition. We validated our approach in the controlled CK+ datasets on which different occlusions were generated. Our experiments show that the proposed method reduces the gap in the recognition accuracy between occluded and unoccluded situations. We also compare our approach with existing state-of-the-art approaches. In order to lay the basis of a reproducible and fair comparison in the future, we also propose a new experimental protocol that includes occlusion generation and reconstruction evaluation 
650 4 |a Journal Article 
700 1 |a Allaert, Benjamin  |e verfasserin  |4 aut 
700 1 |a Ihaddadene, Nacim  |e verfasserin  |4 aut 
700 1 |a Bilasco, Ioan Marius  |e verfasserin  |4 aut 
700 1 |a Djeraba, Chaabane  |e verfasserin  |4 aut 
700 1 |a Bennamoun, Mohammed  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on image processing : a publication of the IEEE Signal Processing Society  |d 1992  |g 31(2022) vom: 02., Seite 446-457  |w (DE-627)NLM09821456X  |x 1941-0042  |7 nnns 
773 1 8 |g volume:31  |g year:2022  |g day:02  |g pages:446-457 
856 4 0 |u http://dx.doi.org/10.1109/TIP.2021.3129120  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 31  |j 2022  |b 02  |h 446-457