Simultaneously-Collected Multimodal Lying Pose Dataset : Enabling In-Bed Human Pose Monitoring

Computer vision field has achieved great success in interpreting semantic meanings from images, yet its algorithms can be brittle for tasks with adverse vision conditions and the ones suffering from data/label pair limitation. Among these tasks is in-bed human pose monitoring with significant value...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 45(2023), 1 vom: 03. Jan., Seite 1106-1118
1. Verfasser: Liu, Shuangjun (VerfasserIn)
Weitere Verfasser: Huang, Xiaofei, Fu, Nihang, Li, Cheng, Su, Zhongnan, Ostadabbas, Sarah
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2023
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article Research Support, U.S. Gov't, Non-P.H.S.
LEADER 01000naa a22002652 4500
001 NLM337707006
003 DE-627
005 20231225235027.0
007 cr uuu---uuuuu
008 231225s2023 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2022.3155712  |2 doi 
028 5 2 |a pubmed24n1125.xml 
035 |a (DE-627)NLM337707006 
035 |a (NLM)35239476 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Liu, Shuangjun  |e verfasserin  |4 aut 
245 1 0 |a Simultaneously-Collected Multimodal Lying Pose Dataset  |b Enabling In-Bed Human Pose Monitoring 
264 1 |c 2023 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 06.04.2023 
500 |a Date Revised 05.05.2023 
500 |a published: Print-Electronic 
500 |a Citation Status MEDLINE 
520 |a Computer vision field has achieved great success in interpreting semantic meanings from images, yet its algorithms can be brittle for tasks with adverse vision conditions and the ones suffering from data/label pair limitation. Among these tasks is in-bed human pose monitoring with significant value in many healthcare applications. In-bed pose monitoring in natural settings involves pose estimation in complete darkness or full occlusion. The lack of publicly available in-bed pose datasets hinders the applicability of many successful human pose estimation algorithms for this task. In this paper, we introduce our Simultaneously-collected multimodal Lying Pose (SLP) dataset, which includes in-bed pose images from 109 participants captured using multiple imaging modalities including RGB, long wave infrared (LWIR), depth, and pressure map. We also present a physical hyper parameter tuning strategy for ground truth pose label generation under adverse vision conditions. The SLP design is compatible with the mainstream human pose datasets; therefore, the state-of-the-art 2D pose estimation models can be trained effectively with the SLP data with promising performance as high as 95% at PCKh0.5 on a single modality. The pose estimation performance of these models can be further improved by including additional modalities through the proposed collaborative scheme 
650 4 |a Journal Article 
650 4 |a Research Support, U.S. Gov't, Non-P.H.S. 
700 1 |a Huang, Xiaofei  |e verfasserin  |4 aut 
700 1 |a Fu, Nihang  |e verfasserin  |4 aut 
700 1 |a Li, Cheng  |e verfasserin  |4 aut 
700 1 |a Su, Zhongnan  |e verfasserin  |4 aut 
700 1 |a Ostadabbas, Sarah  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 45(2023), 1 vom: 03. Jan., Seite 1106-1118  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:45  |g year:2023  |g number:1  |g day:03  |g month:01  |g pages:1106-1118 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2022.3155712  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 45  |j 2023  |e 1  |b 03  |c 01  |h 1106-1118