Poster No:
1351
Submission Type:
Abstract Submission
Authors:
Kelssy Hitomi dos Santos Kawata1, Wey Lem1, Koki Ono1, Hiroshi Oyama1
Institutions:
1The University of Tokyo, Bunkyo-Ku, Tokyo
First Author:
Co-Author(s):
Wey Lem
The University of Tokyo
Bunkyo-Ku, Tokyo
Koki Ono
The University of Tokyo
Bunkyo-Ku, Tokyo
Introduction:
We previously demonstrated via visual-motor action synchronization that the sense of embodiment (SoE) experience into an avatar with mental illness using immersive virtual reality (IVR) increased knowledge acquisition and decreased stigma towards the mental illness person [1]. In order to maximize this effect, there is a need to verify the neural correlates of individual differences of SoE. Here, we investigated the effect of SoE through visual-motor action synchronization using embodiment into an avatar with mental illness via IVR in regard to the neural correlates of the individual difference of SoE.
Methods:
We analysed data from 32 right-handed native Japanese (14 female; M = 24.00, SD = 6.10 years), and they were randomized into either the IVR-control or control-IVR sequence groups. The IVR group experienced the embodiment of an avatar with mental illness in IVR via a head-mounted display (HMD), in which they assumed the role of a company employee with mild symptoms of depression and experienced stigma. The embodiment experience was performed via visual-motor action synchronization with the hand-tracking feature, allowing for three types of interactions; grabbing a paper, holding a computer mouse, and pressing the snooze button on the alarm clock. On the other hand, the control group watched a video with the same content as the IVR group but without visual-motor action synchronization.
In both groups, after each experience, participants were evaluated in terms of the SoE. During the functional magnetic resonance imaging (fMRI) scanning that occurred before and after these experiences, all participants were asked to listen to the main auditory content of the embodiment experience while wearing a sleeping mask to minimize the visual effects generated by removing the HMD.
For the behavioural data, a paired t-test was conducted for the SoE scores between the IVR and control groups. In addition, the effect of individual differences of embodiment on brain activity was examined using a 2nd-level between participant regression analysis, respectively for the IVR and control groups. The voxel-wise statistics used an uncorrected p-value of <0.001 for the cluster-forming threshold and at a threshold of family-wise error (FWE)-corrected p-value of <0.05 for cluster extent.
The protocol received approval from the Research Ethics Committee of the Faculty of Medicine and Graduate School of Medicine of the University of Tokyo (2019099NI).
Results:
The SoE score in the IVR group was significantly higher than those in the control group. The SoE score related to the IVR group was negatively associated with the neural response of mental illness embodied experience in the right inferior frontal gyrus, right anterior insula and left angular gyrus. These brain regions contain mirror neurons which engage in understanding visual-motor actions and emotion in various fMRI studies beyond embodiment [2-5].
Conclusions:
Thus, our findings suggest that mirror neurons contributes to the mechanisms of embodiment simulation using IVR and has important implications for the development of a more objective method of SoE assessment, based on physiological data.
Emotion, Motivation and Social Neuroscience:
Social Neuroscience Other
Higher Cognitive Functions:
Imagery
Modeling and Analysis Methods:
Activation (eg. BOLD task-fMRI) 1
Motor Behavior:
Mirror System 2
Keywords:
Cognition
FUNCTIONAL MRI
Perception
Other - Virtual Reality
1|2Indicates the priority used for review
Provide references using author date format
References
1. Lem WG, dos Santos Kawata KH, Oyama H: The Impact of Virtual Reality-Based Anti-Stigma Intervention on Mental Illness Knowledge and Associated Neural Activity. In: Proceedings of Annual Conference of Japan Society for Medical Virtual Reality 第 22 回 日本 VR 医学会学術大会: 2023: Japanese Society for Medical Virtual Reality; 2023: 25-26.
2. Yang C-J, Yu H-Y, Hong T-Y, Shih C-H, Yeh T-C, Chen L-F, Hsieh J-C: Trait Representation of Embodied Cognition in Dancers Pivoting on the Extended Mirror Neuron System: A Resting-State fMRI Study. Front Hum Neurosci 2023, 17:1173993.
3. Shimada S: Multisensory and Sensorimotor Integration in the Embodied Self: Relationship between Self-Body Recognition and the Mirror Neuron System. Sensors 2022, 22(13):5059.
4. Ku J, Lee H, Kim J-J, Kim IY, Kim SI: Brain mechanism involved in the real motion interaction with a virtual avatar. Biomedical Engineering Letters 2012, 2:164-172.
5. Horoufchin H, Bzdok D, Buccino G, Borghi AM, Binkofski F: Action and object words are differentially anchored in the sensory motor system-A perspective on cognitive embodiment. Sci Rep-Uk 2018, 8(1):6583.