Exploring the SenseMaking Process through Interactions and fNIRS in Immersive Visualization

Theories of cognition inform our decisions when designing human-computer interfaces, and immersive systems enable us to examine these theories. This work explores the sensemaking process in an immersive environment through studying both internal and external user behaviors with a classical visualiza...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on visualization and computer graphics. - 1996. - 27(2021), 5 vom: 06. Mai, Seite 2714-2724
1. Verfasser: Galati, Alexia (VerfasserIn)
Weitere Verfasser: Schoppa, Riley, Lu, Aidong
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2021
Zugriff auf das übergeordnete Werk:IEEE transactions on visualization and computer graphics
Schlagworte:Journal Article Research Support, U.S. Gov't, Non-P.H.S.
LEADER 01000naa a22002652 4500
001 NLM323070434
003 DE-627
005 20231225183358.0
007 cr uuu---uuuuu
008 231225s2021 xx |||||o 00| ||eng c
024 7 |a 10.1109/TVCG.2021.3067693  |2 doi 
028 5 2 |a pubmed24n1076.xml 
035 |a (DE-627)NLM323070434 
035 |a (NLM)33750695 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Galati, Alexia  |e verfasserin  |4 aut 
245 1 0 |a Exploring the SenseMaking Process through Interactions and fNIRS in Immersive Visualization 
264 1 |c 2021 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Completed 03.01.2022 
500 |a Date Revised 03.01.2022 
500 |a published: Print-Electronic 
500 |a Citation Status MEDLINE 
520 |a Theories of cognition inform our decisions when designing human-computer interfaces, and immersive systems enable us to examine these theories. This work explores the sensemaking process in an immersive environment through studying both internal and external user behaviors with a classical visualization problem: a visual comparison and clustering task. We developed an immersive system to perform a user study, collecting user behavior data from different channels: AR HMD for capturing external user interactions, functional near-infrared spectroscopy (fNIRS) for capturing internal neural sequences, and video for references. To examine sensemaking, we assessed how the layout of the interface (planar 2D vs. cylindrical 3D layout) and the challenge level of the task (low vs. high cognitive load) influenced the users' interactions, how these interactions changed over time, and how they influenced task performance. We also developed a visualization system to explore joint patterns among all the data channels. We found that increased interactions and cerebral hemodynamic responses were associated with more accurate performance, especially on cognitively demanding trials. The layout types did not reliably influence interactions or task performance. We discuss how these findings inform the design and evaluation of immersive systems, predict user performance and interaction, and offer theoretical insights about sensemaking from the perspective of embodied and distributed cognition 
650 4 |a Journal Article 
650 4 |a Research Support, U.S. Gov't, Non-P.H.S. 
700 1 |a Schoppa, Riley  |e verfasserin  |4 aut 
700 1 |a Lu, Aidong  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on visualization and computer graphics  |d 1996  |g 27(2021), 5 vom: 06. Mai, Seite 2714-2724  |w (DE-627)NLM098269445  |x 1941-0506  |7 nnns 
773 1 8 |g volume:27  |g year:2021  |g number:5  |g day:06  |g month:05  |g pages:2714-2724 
856 4 0 |u http://dx.doi.org/10.1109/TVCG.2021.3067693  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 27  |j 2021  |e 5  |b 06  |c 05  |h 2714-2724