Complex Interaction as Emergent Behaviour : Simulating Mid-Air Virtual Keyboard Typing using Reinforcement Learning

Accurately modelling user behaviour has the potential to significantly improve the quality of human-computer interaction. Traditionally, these models are carefully hand-crafted to approximate specific aspects of well-documented user behaviour. This limits their availability in virtual and augmented...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on visualization and computer graphics. - 1996. - 27(2021), 11 vom: 15. Nov., Seite 4140-4149
1. Verfasser: Hetzel, Lorenz (VerfasserIn)
Weitere Verfasser: Dudley, John, Feit, Anna Maria, Kristensson, Per Ola
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2021
Zugriff auf das übergeordnete Werk:IEEE transactions on visualization and computer graphics
Schlagworte:Journal Article Research Support, Non-U.S. Gov't
LEADER 01000naa a22002652 4500
001 NLM329922149
003 DE-627
005 20231225210155.0
007 cr uuu---uuuuu
008 231225s2021 xx |||||o 00| ||eng c
024 7 |a 10.1109/TVCG.2021.3106494  |2 doi 
028 5 2 |a pubmed24n1099.xml 
035 |a (DE-627)NLM329922149 
035 |a (NLM)34449380 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Hetzel, Lorenz  |e verfasserin  |4 aut 
245 1 0 |a Complex Interaction as Emergent Behaviour  |b Simulating Mid-Air Virtual Keyboard Typing using Reinforcement Learning 
264 1 |c 2021 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 13.01.2022 
500 |a Date Revised 13.01.2022 
500 |a published: Print-Electronic 
500 |a Citation Status MEDLINE 
520 |a Accurately modelling user behaviour has the potential to significantly improve the quality of human-computer interaction. Traditionally, these models are carefully hand-crafted to approximate specific aspects of well-documented user behaviour. This limits their availability in virtual and augmented reality where user behaviour is often not yet well understood. Recent efforts have demonstrated that reinforcement learning can approximate human behaviour during simple goal-oriented reaching tasks. We build on these efforts and demonstrate that reinforcement learning can also approximate user behaviour in a complex mid-air interaction task: typing on a virtual keyboard. We present the first reinforcement learning-based user model for mid-air and surface-aligned typing on a virtual keyboard. Our model is shown to replicate high-level human typing behaviour. We demonstrate that this approach may be used to augment or replace human testing during the validation and development of virtual keyboards 
650 4 |a Journal Article 
650 4 |a Research Support, Non-U.S. Gov't 
700 1 |a Dudley, John  |e verfasserin  |4 aut 
700 1 |a Feit, Anna Maria  |e verfasserin  |4 aut 
700 1 |a Kristensson, Per Ola  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on visualization and computer graphics  |d 1996  |g 27(2021), 11 vom: 15. Nov., Seite 4140-4149  |w (DE-627)NLM098269445  |x 1941-0506  |7 nnns 
773 1 8 |g volume:27  |g year:2021  |g number:11  |g day:15  |g month:11  |g pages:4140-4149 
856 4 0 |u http://dx.doi.org/10.1109/TVCG.2021.3106494  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 27  |j 2021  |e 11  |b 15  |c 11  |h 4140-4149