Poster No:
1859
Submission Type:
Abstract Submission
Authors:
Jingru Fu1, Yuqi Zheng2, Daniel Ferreira3, Rodrigo Moreno4
Institutions:
1KTH, Huddinge, STOCKHOLM, 2KTH, Stockholm, stockholm, 3Karolinska Institutet, Stockholm, Sweden, 4KTH, Huddinge, stockholm
First Author:
Co-Author(s):
Introduction:
Simulation of different future appearances of the MRI scans of an individual can provide relevant information to the physicians to select the most appropriate health care. In the last few years, different deep learning- (DL) based medical image generation (MIG) models have been proposed for this task. For example, generative adversarial networks (GANs) have been used for modeling the aging process and the progression of AD [1,2]. Unfortunately, these methods make important simplifications to reduce their computational costs, such as simulating a single slice per subject or downsampling original images. More importantly, GAN-based methods usually lack anatomical plausibility in generated images due to the absence of biologically informed constraints. As an alternative, we used diffeomorphic registration in [3] for this task. The main advantage of our approach compared to GANs is that the anatomical plausibility of the synthetic images is guaranteed by design. However, the main drawback of our method is that it requires two images per subject.
In this study, we introduce Individualized Brain Synthesis (InBrainSyn), a MIG to synthesize high-resolution longitudinal MRI scans that faithfully replicate subject-specific neurodegeneration in AD and aging based on a single scan.
Methods:
In this study, we used T1-weighted (T1w) MRI from OASIS-3 dataset [4]. Fig.1, shows the proposed pipeline. First, T1w MRI scans were preprocessed and partitioned into cognitive normal (CN) and AD cohorts. Second, AtlasGAN [5], a DL-based template generation method, was employed to produce age-resolved high-quality templates for both the CN and AD cohorts. AtlasGAN uses a diffeomorphic registration model that estimates a stationary velocity field (SVF) that is used to create a diffeomorphic deformation field through an integration layer and a spatial transformer network (STN) [6]. Third, registration was used to estimate SVFs between every follow-up template and age-matched template of the given subject image, independently for the two cohorts. Also, an SVF was estimated between the image of the subject and its age-matched template. Then, parallel transport [7] was used to translate the SVFs from the templates to the SVF computed for the specific subject. This way, the trajectory of the cohort is translated to create the subject-specific trajectory. Lastly, STN and integration were applied to the subject-specific SVFs to generate images that simulate morphological atrophy over time due to normal aging, AD, or both, depending on the used templates.
Results:
We used 1,893 T1w MRI scans from 1,020 participants to train the cohort-level models and a separate test set of 473 MRI scans from 398 participants to evaluate it. Fig. 2 shows a comparison between the acquired images and the synthetic images generated using the CN template (InBrainSyn_CN), AD template (InBrainSyn_AD), and both (InBrainSyn_Inter). In the latter case, we use the CN template when the subject had a CDR=0 and the AD template for CDR>0. For comparison, we also show images generated with Simul@trophy [8]. As shown, InBrainSyn_Inter generates sharper images with a closer appearance to the ground truth. We also quantified the quality of synthetic images using two conventional similarity criteria, the structural similarity index (SSIM) and normalized cross-correlation (NCC). The results show the proposed InBrainSyn is superior to a baseline method in both the CN cohort (SSIM: 0.91 (±0.06) vs. 0.80 (±0.02); NCC: 0.98 (±0.02) vs. 0.94 (±0.01)) and the AD cohort (SSIM: 0.91 (±0.04) vs. 0.80 (±0.02); NCC: 0.98 (±0.01) vs. 0.93 (±0.01)).
Conclusions:
The proposed framework can synthesize individualized images that simulate normal aging or AD courses from a single scan. The main advantages of the framework are that it is efficient, the generated images are anatomically plausible by design, and it is flexible to simulate transitions from a healthy state to AD, as shown in Fig.2.
Disorders of the Nervous System:
Neurodegenerative/ Late Life (eg. Parkinson’s, Alzheimer’s) 2
Lifespan Development:
Aging
Modeling and Analysis Methods:
Image Registration and Computational Anatomy
Methods Development 1
Novel Imaging Acquisition Methods:
Anatomical MRI
Keywords:
Aging
Degenerative Disease
Machine Learning
STRUCTURAL MRI
1|2Indicates the priority used for review
Provide references using author date format
[1] Wegmayr et al. (2019), 'Generative Aging of Brain MR-Images and Prediction of Alzheimer Progression', Proc. DAGM German Conference on Pattern Recognition 2019. LNCS, vol 11824. pp. 247–260. Springer, Cham
[2] Ravi et al. (2022), 'Generative adversarial neuroimage nets for brain scan simulations: Application in ageing and dementia', Medical Image Analysis, vol. 75, pp. 102257
[3] Fu et al. (2023) 'Fast three-dimensional image generation for healthy brain aging using diffeomorphic registration', Human Brain Mapping, vol. 44, no. 4, pp. 1289-1308
[4] LaMontagne et al. (2019), 'Oasis-3: longitudinal neuroimaging, clinical, and cognitive dataset for normal aging and alzheimer disease', MedRxiv.
[5] Dey et al. (2021), 'Generative adversarial registration for improved conditional deformable templates', Proc. IEEE/CVF International Conference on Computer Vision (ICCV 2021), pp. 3929–3941
[6] Jaderberg et al. (2015), 'Spatial transformer networks', In Advances in Neural Information Processing Systems, vol. 28, Curran Associates, Inc.
[7] Lorenzi and Pennec. (2014), 'Efficient parallel transport of deformations in time series of images: from schild’s to pole ladder', Journal of Mathematical Imaging and Vision, vol. 50, pp. 5–17
[8] Khanal et al. (2017), 'Simulating longitudinal brain mris with known volume changes and realistic variations in image intensity', Frontiers in neuroscience, vol. 11