Poster No:
1910
Submission Type:
Abstract Submission
Authors:
Vaibhavi Itkyal1, Theodore LaGrow2, Anees Abrol3, Vince Calhoun4
Institutions:
1Emory University, Decatur, GA, 2Georgia Institute of Technology, Beaverton, OR, 3Georgia State University, Atlanta, GA, 4GSU/GATech/Emory, Decatur, GA
First Author:
Co-Author(s):
Introduction:
This study addresses the imperative need for accurate early diagnosis of Alzheimer's Disease (AD) by exploring the synergies between structural magnetic resonance imaging (sMRI) and resting-state functional magnetic resonance imaging (rs-fMRI). The novel approach integrates rs-fMRI networks which are computed using independent component analysis followed by voxelwise intensity projections (i.e., iVIP), with sMRI, surpassing traditional metrics like amplitude of low-frequency fluctuations (ALFF) and fractional ALFF (fALFF). Inspired by AlexNet, a multi-channel convolutional neural network effectively captures both spatial and temporal dependencies, achieving a 93.31% test accuracy and a 97.79 AUC score on the classification task of AD vs cognitively normal (CN) from the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. Our multimodal deep learning results outperform unimodal approaches, highlighting crucial differences in neurobiologically relevant regions. Saliency visualizations emphasize distinctions in the hippocampus, amygdala, caudate nucleus, and thalamus, aligning with existing literature. This innovative multimodal deep learning model validated on publicly available data demonstrates superior diagnostic performance, offering valuable insights into AD-related alterations through spatiotemporal information integration.
Methods:
We used ADNI data, comprising sMRI and rs-fMRI scans from 466 subjects, including 383 CN and 83 AD individuals. The rigorous preprocessing includes spatial normalization, tissue segmentation, and transformations using SPM 12, with stringent quality control measures applied. The fMRI preprocessing involves motion correction, slice-timing correction, standardization to MNI space, resampling, and Gaussian smoothing. All pre-processing information for this dataset can be found in Du et al. 2020. Spatially constrained independent component analysis generated 53 intrinsic connectivity networks (ICNs) using Neuromark (Du et al. 2020), from which independent voxelwise intensity projection images (iVIPs) are computed. These iVIPs, representing max, abs min, and max abs of ICNs, serve as input for a specialized 3D multimodal deep learning architecture inspired by AlexNet (Abrol et al. 2021; Krizhevsky, Sutskever, and Hinton 2017). The model, operating on rs-fMRI or sMRI data, captures spatial patterns through convolutional layers, adaptive pooling, and dropout for classification. The study achieves a 93.31% test accuracy in discriminating AD and CN, surpassing traditional metrics like ALFF (Turner et al. 2013) and fALFF. Training and saliency maps, generated through guided backpropagation, provide insights into the model's decision-making processes. We did 8-fold cross-validation and used Adam algorithm.

·Inputs used in our 3D CNN model along with the saliency maps.
Results:
iVIP compared to traditional metrics like ALFF/fALFF, iVIP exhibits quantitative superiority in test accuracy and balanced accuracy, particularly excelling in two-way classification with max(ICN) and max(abs(ICN)). Deep learning models based on iVIP outperform those derived from ALFF/fALFF, achieving an 85.02% peak test accuracy for AD vs CN. Combining sMRI and iVIP in a multimodal model (sMRI + iVIP) achieves the highest accuracy at 93.31%, surpassing unimodal models. Saliency maps highlight distinct spatial patterns, with sMRI emphasizing the hippocampus, amygdala, and caudate nucleus, while max(ICN) reveals variations in the cingulate cortex, thalamus, and caudate nucleus. These findings provide valuable insights into AD-related brain alterations, emphasizing the synergistic benefits of multimodal approaches in neuroimaging studies (Abbott et al. 2014; Wang et al. 2016; Lee et al. 2020).

·Summary of quantitative results.
Conclusions:
The study integrates iVIP with sMRI into a 3D CNN, achieving 93.31% accuracy for early AD diagnosis, surpassing traditional metrics - ALFF/fALFF. Our multimodal approach provides insights into neurobiological changes, emphasizing its potential for effective clinical strategies in AD diagnosis and intervention.
Disorders of the Nervous System:
Neurodegenerative/ Late Life (eg. Parkinson’s, Alzheimer’s)
Modeling and Analysis Methods:
Connectivity (eg. functional, effective, structural)
Methods Development 1
Task-Independent and Resting-State Analysis 2
Keywords:
Data analysis
FUNCTIONAL MRI
STRUCTURAL MRI
1|2Indicates the priority used for review
Provide references using author date format
Abbott, C. C., T. Jones, N. T. Lemke, P. Gallegos, S. M. McClintock, A. R. Mayer, J. Bustillo, and V. D. Calhoun. 2014. “Hippocampal Structural and Functional Changes Associated with Electroconvulsive Therapy Response.” Translational Psychiatry 4 (11): e483–e483. https://doi.org/10.1038/tp.2014.124.
Abrol, Anees, Zening Fu, Mustafa Salman, Rogers Silva, Yuhui Du, Sergey Plis, and Vince Calhoun. 2021. “Deep Learning Encodes Robust Discriminative Neuroimaging Representations to Outperform Standard Machine Learning.” Nature Communications 12 (1): 353. https://doi.org/10.1038/s41467-020-20655-6.
Du, Yuhui, Zening Fu, Jing Sui, Shuang Gao, Ying Xing, Dongdong Lin, Mustafa Salman, et al. 2020. “NeuroMark: An Automated and Adaptive ICA Based Pipeline to Identify Reproducible fMRI Markers of Brain Disorders.” NeuroImage: Clinical 28 (January): 102375. https://doi.org/10.1016/j.nicl.2020.102375.
Krizhevsky, Alex, Ilya Sutskever, and Geoffrey E. Hinton. 2017. “ImageNet Classification with Deep Convolutional Neural Networks.” Communications of the ACM 60 (6): 84–90. https://doi.org/10.1145/3065386.
Lee, Pei-Lin, Kun-Hsien Chou, Chih-Ping Chung, Tzu-Hsien Lai, Juan Helen Zhou, Pei-Ning Wang, and Ching-Po Lin. 2020. “Posterior Cingulate Cortex Network Predicts Alzheimer’s Disease Progression.” Frontiers in Aging Neuroscience 12. https://www.frontiersin.org/articles/10.3389/fnagi.2020.608667.
Turner, Jessica, Eswar Damaraju, Theo Van Erp, Daniel Mathalon, Judith Ford, James Voyvodic, Bryon Mueller, et al. 2013. “A Multi-Site Resting State fMRI Study on the Amplitude of Low Frequency Fluctuations in Schizophrenia.” Frontiers in Neuroscience 7. https://www.frontiersin.org/articles/10.3389/fnins.2013.00137.
Wang, Zhiqun, Min Zhang, Ying Han, Haiqing Song, Rongjuan Guo, and Kuncheng Li. 2016. “Differentially Disrupted Functional Connectivity of the Subregions of the Amygdala in Alzheimer’s Disease.” Journal of X-Ray Science and Technology 24 (2): 329–42. https://doi.org/10.3233/XST-160556.