AudioGest : Gesture-based Interaction for Virtual Reality using Audio Devices

Current virtual reality (VR) system takes gesture interaction based on camera, handle and touch screen as one of the mainstream interaction methods, which can provide accurate gesture input for it. However, limited by application forms and the volume of devices, these methods cannot extend the inter...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on visualization and computer graphics. - 1996. - PP(2024) vom: 07. Mai
1. Verfasser: Liu, Tong (VerfasserIn)
Weitere Verfasser: Xiao, Yi, Hu, Mingwei, Sha, Hao, Ma, Shining, Gao, Boyu, Guo, Shihui, Liu, Yue, Song, Weitao
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2024
Zugriff auf das übergeordnete Werk:IEEE transactions on visualization and computer graphics
Schlagworte:Journal Article
LEADER 01000naa a22002652 4500
001 NLM37202212X
003 DE-627
005 20240508232835.0
007 cr uuu---uuuuu
008 240508s2024 xx |||||o 00| ||eng c
024 7 |a 10.1109/TVCG.2024.3397868  |2 doi 
028 5 2 |a pubmed24n1401.xml 
035 |a (DE-627)NLM37202212X 
035 |a (NLM)38713570 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Liu, Tong  |e verfasserin  |4 aut 
245 1 0 |a AudioGest  |b Gesture-based Interaction for Virtual Reality using Audio Devices 
264 1 |c 2024 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Revised 08.05.2024 
500 |a published: Print-Electronic 
500 |a Citation Status Publisher 
520 |a Current virtual reality (VR) system takes gesture interaction based on camera, handle and touch screen as one of the mainstream interaction methods, which can provide accurate gesture input for it. However, limited by application forms and the volume of devices, these methods cannot extend the interaction area to such surfaces as walls and tables. To address the above challenge, we propose AudioGest, a portable, plug-and-play system that detects the audio signal generated by finger tapping and sliding on the surface through a set of microphone devices without extensive calibration. First, an audio synthesis-recognition pipeline based on micro-contact dynamics simulation is constructed to generate modal audio synthesis from different materials and physical properties. Then the accuracy and effectiveness of the synthetic audio are verified by mixing the synthetic audio with real audio proportionally as the training sets. Finally, a series of desktop office applications are developed to demonstrate the application potential of AudioGest's scalability and versatility in VR scenarios 
650 4 |a Journal Article 
700 1 |a Xiao, Yi  |e verfasserin  |4 aut 
700 1 |a Hu, Mingwei  |e verfasserin  |4 aut 
700 1 |a Sha, Hao  |e verfasserin  |4 aut 
700 1 |a Ma, Shining  |e verfasserin  |4 aut 
700 1 |a Gao, Boyu  |e verfasserin  |4 aut 
700 1 |a Guo, Shihui  |e verfasserin  |4 aut 
700 1 |a Liu, Yue  |e verfasserin  |4 aut 
700 1 |a Song, Weitao  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on visualization and computer graphics  |d 1996  |g PP(2024) vom: 07. Mai  |w (DE-627)NLM098269445  |x 1941-0506  |7 nnns 
773 1 8 |g volume:PP  |g year:2024  |g day:07  |g month:05 
856 4 0 |u http://dx.doi.org/10.1109/TVCG.2024.3397868  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d PP  |j 2024  |b 07  |c 05