Sign language spotting with a threshold model based on conditional random fields

Sign language spotting is the task of detecting and recognizing signs in a signed utterance, in a set vocabulary. The difficulty of sign language spotting is that instances of signs vary in both motion and appearance. Moreover, signs appear within a continuous gesture stream, interspersed with trans...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1979. - 31(2009), 7 vom: 14. Juli, Seite 1264-77
1. Verfasser: Yang, Hee-Deok (VerfasserIn)
Weitere Verfasser: Sclaroff, Stan, Lee, Seong-Whan
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2009
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article Research Support, Non-U.S. Gov't Research Support, U.S. Gov't, Non-P.H.S.
LEADER 01000naa a22002652 4500
001 NLM188542302
003 DE-627
005 20231223182114.0
007 cr uuu---uuuuu
008 231223s2009 xx |||||o 00| ||eng c
024 7 |a 10.1109/TPAMI.2008.172  |2 doi 
028 5 2 |a pubmed24n0629.xml 
035 |a (DE-627)NLM188542302 
035 |a (NLM)19443924 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Yang, Hee-Deok  |e verfasserin  |4 aut 
245 1 0 |a Sign language spotting with a threshold model based on conditional random fields 
264 1 |c 2009 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 22.07.2009 
500 |a Date Revised 15.05.2009 
500 |a published: Print 
500 |a Citation Status MEDLINE 
520 |a Sign language spotting is the task of detecting and recognizing signs in a signed utterance, in a set vocabulary. The difficulty of sign language spotting is that instances of signs vary in both motion and appearance. Moreover, signs appear within a continuous gesture stream, interspersed with transitional movements between signs in a vocabulary and nonsign patterns (which include out-of-vocabulary signs, epentheses, and other movements that do not correspond to signs). In this paper, a novel method for designing threshold models in a conditional random field (CRF) model is proposed which performs an adaptive threshold for distinguishing between signs in a vocabulary and nonsign patterns. A short-sign detector, a hand appearance-based sign verification method, and a subsign reasoning method are included to further improve sign language spotting accuracy. Experiments demonstrate that our system can spot signs from continuous data with an 87.0 percent spotting rate and can recognize signs from isolated data with a 93.5 percent recognition rate versus 73.5 percent and 85.4 percent, respectively, for CRFs without a threshold model, short-sign detection, subsign reasoning, and hand appearance-based sign verification. Our system can also achieve a 15.0 percent sign error rate (SER) from continuous data and a 6.4 percent SER from isolated data versus 76.2 percent and 14.5 percent, respectively, for conventional CRFs 
650 4 |a Journal Article 
650 4 |a Research Support, Non-U.S. Gov't 
650 4 |a Research Support, U.S. Gov't, Non-P.H.S. 
700 1 |a Sclaroff, Stan  |e verfasserin  |4 aut 
700 1 |a Lee, Seong-Whan  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1979  |g 31(2009), 7 vom: 14. Juli, Seite 1264-77  |w (DE-627)NLM098212257  |x 1939-3539  |7 nnns 
773 1 8 |g volume:31  |g year:2009  |g number:7  |g day:14  |g month:07  |g pages:1264-77 
856 4 0 |u http://dx.doi.org/10.1109/TPAMI.2008.172  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 31  |j 2009  |e 7  |b 14  |c 07  |h 1264-77