The diagnostic performance of AI-based algorithms to discriminate between NMOSD and MS using MRI features: A systematic review and meta-analysis

Abstract

Background: Magnetic resonance imaging MRI findings in Neuromyelitis optica spectrum disorder NMOSD and Multiple Sclerosis MS patients could lead us to discriminate toward them. For instance, U-fiber and Dawson's finger-type lesions are suggestive of MS, however linear ependymal lesions raise the possibility of NMOSD. Recently, artificial intelligence AI models have been used to discriminate between NMOSD and MS based on MRI features. In this study, we aim to systematically review the capability of AI algorithms in NMOSD and MS discrimination based on MRI features. Method: We searched PubMed, Scopus, Web of Sciences, Embase, and IEEE databases up to August 2023. All studies that used AI-based algorithms to discriminate between NMOSD and MS using MRI features were included, without any restriction in time, region, race, and age. Data on NMOSD and MS patients, Aquaporin-4 antibodies AQP4-Ab status, diagnosis criteria, performance metrics (accuracy, sensitivity, specificity, and AUC), artificial intelligence paradigm, MR imaging, and used features were extracted. This study is registered with PROSPERO, CRD42023465265. Results: Fifteen studies were included in this systematic review, with sample sizes ranging between 53 and 351. 1,362 MS patients and 1,118 NMOSD patients were included in our systematic review. AQP4-Ab was positive in 94.9% of NMOSD patients in 9 studies. Eight studies used machine learning ML as a classifier, while 7 used deep learning DL. AI models based on only MRI or MRI and clinical features yielded a pooled accuracy of 82% (95% CI: 78-86%), sensitivity of 83% (95% CI: 79-88%), and specificity of 80% (95% CI: 75-86%). In subgroup analysis, using only MRI features yielded an accuracy, sensitivity, and specificity of 83% (95% CI: 78-88%), 81% (95% CI: 76-87%), and 84% (95% CI: 79-89%), respectively. Conclusion: AI models based on MRI features showed a high potential to discriminate between NMOSD and MS. However, heterogeneity in MR imaging, model evaluation, and reporting performance metrics, among other confounders, affected the reliability of our results. Well-designed studies on multicentric datasets, standardized imaging and evaluation protocols, and detailed transparent reporting of results are needed to reach optimal performance.