Poster No:
976
Submission Type:
Abstract Submission
Authors:
Jii Kwon1, June Sic Kim1, Chun Kee Chung2
Institutions:
1Seoul National University, Seoul, Republic of Korea, 2Seoul National University Medical Research Center, Seoul, Republic of Korea
First Author:
Jii Kwon
Seoul National University
Seoul, Republic of Korea
Co-Author(s):
June Sic Kim
Seoul National University
Seoul, Republic of Korea
Chun Kee Chung
Seoul National University Medical Research Center
Seoul, Republic of Korea
Introduction:
Melody, consisting of a pitch series, is an essential element in music, essential in distinguishing music. Melody could be perceived by the pattern of interval distances between the tones (relative pitches), not by absolute pitches in most subjects. Here, we aimed to reconstruct an imagined melody by decoding the relative pitch heights during music imagery with electrocorticography (ECoG). Furthermore, we try to elucidate the major neural features contributing the classification accuracy.
Methods:
Ten medically intractable epilepsy patients without professional musical backgrounds participated in the present study. Five well-known children's songs were used. We used a questionnaire to assess their familiarity with scores ranging from 1 to 5 for each song (1, least familiar; and 5, most familiar). Patients performed the task of listening, followed by imagery of certain melody parts. During the music imagery, we observed significantly increased high gamma activities in the temporal, the inferior frontal, and the sensorimotor cortices. Neural features activated during music imagery were used in decoding the relative pitch height (Do-Re-Mi-Fa-Sol-La) by Random Forest algorithms with the sequential forward floating selection (SFFS). To quantify the contribution of each feature in the classification accuracy, an increment value was calculated during SFFS. With decoding in order within one melody chunk, we reconstruct the imagined melody. Spearman's correlation coefficient was employed to evaluate reconstructed imagined melody with the original one.
Results:
High frequency activities, including gamma and high gamma, from the left superior temporal gyrus (STG) and the right rostral middle frontal cortex (rostral MFC) significantly contributed to relative pitch decoding in music imagery. After then, we could reconstruct imagined melodies, with a mean Spearman's correlation coefficient of 0.58 (p < 0.01) with the original melodies. Lower familiarity scores are, lower is the correlation of reconstructed imagined melodies, and vice versa in higher familiarity for each of the 5 songs analyzed.
Conclusions:
We successfully reconstructed imagined melodies of children's songs with ECoG. We demonstrated the feasibility of decoding relative pitch height in the single-note domain with significantly increased high-gamma responses during music imagery. Critically, we found that left STG and the right rostral MFC significantly contributed in decoding. The left STG, traditionally linked to auditory processing and pitch perception, is involved in music imagery, suggesting a shared neural substrate for music perception and imagery. Meanwhile, the right rostral MFC's contribution underlines an intricate interplay of auditory processing and executive functions, suggesting the cognitive complexity inherent in music imagery.
Higher Cognitive Functions:
Imagery 1
Music
Modeling and Analysis Methods:
Classification and Predictive Modeling 2
Novel Imaging Acquisition Methods:
Imaging Methods Other
Perception, Attention and Motor Behavior:
Attention: Auditory/Tactile/Motor
Keywords:
Cortex
Data analysis
ELECTROCORTICOGRAPHY
Epilepsy
Machine Learning
Other - Music imagery
1|2Indicates the priority used for review
Provide references using author date format
Badre, D. (2009). "Is the rostro-caudal axis of the frontal lobe hierarchical?" Nature Reviews Neuroscience 10(9): 659-669.
Gómez, E. (2003). Melody description and extraction in the context of music content processing. Journal of New Music Research, 32(1), 23-40.
Levitin, D. J. (2005). "Absolute pitch: perception, coding, and controversies." Trends in cognitive sciences 9(1): 26-33.
Patterson, R. D. (2002). "The processing of temporal pitch and melody information in auditory cortex." Neuron 36(4): 767-776.
Zatorre, R. J. (2005). "Mental concerts: musical imagery and auditory cortex." Neuron 47(1): 9-12.