Space-time behavior-based correlation-Or-how to tell if two underlying motion fields are similar without computing them?

We introduce a behavior-based similarity measure which tells us whether two different space-time intensity patterns of two different video segments could have resulted from a similar underlying motion field. This is done directly from the intensity information, without explicitly computing the under...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence. - 1998. - 29(2007), 11 vom: 11. Nov., Seite 2045-56
1. Verfasser: Shechtman, Eli (VerfasserIn)
Weitere Verfasser: Irani, Michal
Format: Aufsatz
Sprache:English
Veröffentlicht: 2007
Zugriff auf das übergeordnete Werk:IEEE transactions on pattern analysis and machine intelligence
Schlagworte:Journal Article Research Support, Non-U.S. Gov't
LEADER 01000caa a22002652 4500
001 NLM173583253
003 DE-627
005 20250208163211.0
007 tu
008 231223s2007 xx ||||| 00| ||eng c
028 5 2 |a pubmed25n0579.xml 
035 |a (DE-627)NLM173583253 
035 |a (NLM)17848783 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Shechtman, Eli  |e verfasserin  |4 aut 
245 1 0 |a Space-time behavior-based correlation-Or-how to tell if two underlying motion fields are similar without computing them? 
264 1 |c 2007 
336 |a Text  |b txt  |2 rdacontent 
337 |a ohne Hilfsmittel zu benutzen  |b n  |2 rdamedia 
338 |a Band  |b nc  |2 rdacarrier 
500 |a Date Completed 13.12.2007 
500 |a Date Revised 12.09.2007 
500 |a published: Print 
500 |a Citation Status MEDLINE 
520 |a We introduce a behavior-based similarity measure which tells us whether two different space-time intensity patterns of two different video segments could have resulted from a similar underlying motion field. This is done directly from the intensity information, without explicitly computing the underlying motions. Such a measure allows us to detect similarity between video segments of differently dressed people performing the same type of activity. It requires no foreground/background segmentation, no prior learning of activities, and no motion estimation or tracking. Using this behavior-based similarity measure, we extend the notion of 2-dimensional image correlation into the 3-dimensional space-time volume, thus allowing to correlate dynamic behaviors and actions. Small space-time video segments (small video clips) are "correlated" against entire video sequences in all three dimensions (x,y, and t). Peak correlation values correspond to video locations with similar dynamic behaviors. Our approach can detect very complex behaviors in video sequences (e.g., ballet movements, pool dives, running water), even when multiple complex activities occur simultaneously within the field-of-view of the camera. We further show its robustness to small changes in scale and orientation of the correlated behavior 
650 4 |a Journal Article 
650 4 |a Research Support, Non-U.S. Gov't 
700 1 |a Irani, Michal  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on pattern analysis and machine intelligence  |d 1998  |g 29(2007), 11 vom: 11. Nov., Seite 2045-56  |w (DE-627)NLM098212257  |x 0162-8828  |7 nnns 
773 1 8 |g volume:29  |g year:2007  |g number:11  |g day:11  |g month:11  |g pages:2045-56 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 29  |j 2007  |e 11  |b 11  |c 11  |h 2045-56