A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients

Abstract Background Despite that machine learning (ML)-based MRI has been evaluated for diagnosis of axillary lymph node metastasis (ALNM) in breast cancer patients, diagnostic values they showed have been variable. In this study, we aimed to assess the use of ML to classify ALNM on MRI and to ident...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Chen Chen, Yuhui Qin, Haotian Chen, Dongyong Zhu, Fabao Gao, Xiaoyue Zhou
Formato: article
Lenguaje:EN
Publicado: SpringerOpen 2021
Materias:
Acceso en línea:https://doaj.org/article/0dce7e64b6d74345803205cf17539f04
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:0dce7e64b6d74345803205cf17539f04
record_format dspace
spelling oai:doaj.org-article:0dce7e64b6d74345803205cf17539f042021-11-07T12:14:30ZA meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients10.1186/s13244-021-01034-11869-4101https://doaj.org/article/0dce7e64b6d74345803205cf17539f042021-11-01T00:00:00Zhttps://doi.org/10.1186/s13244-021-01034-1https://doaj.org/toc/1869-4101Abstract Background Despite that machine learning (ML)-based MRI has been evaluated for diagnosis of axillary lymph node metastasis (ALNM) in breast cancer patients, diagnostic values they showed have been variable. In this study, we aimed to assess the use of ML to classify ALNM on MRI and to identify potential covariates that might influence the diagnostic performance of ML. Methods A systematic research of PubMed, Embase, Web of Science, and the Cochrane Library was conducted until 27 December 2020 to collect the included articles. Subgroup analysis was also performed. Findings Fourteen studies assessing a total of 2247 breast cancer patients were included in the analysis. The overall AUC for ML in the validation set was 0.80 (95% confidence interval [CI] 0.76–0.83) with a negative predictive value of 0.83. The pooled sensitivity and specificity were 0.79 (95% CI 0.74–0.84) and 0.77 (95% CI 0.73–0.81), respectively. In the subgroup analysis of the validation set, T1-weighted contrast-enhanced (T1CE) imaging with ML yielded a higher sensitivity (0.80 vs. 0.67 vs. 0.76) than the T2-weighted fat-suppressed (T2-FS) imaging and diffusion-weighted imaging (DWI). Support vector machines (SVMs) had a higher specificity than linear regression (LR) and linear discriminant analysis (LDA) (0.79 vs. 0.78 vs. 0.75), whereas LDA showed a higher sensitivity than LR and SVM (0.83 vs. 0.70 vs. 0.77). Interpretation MRI sequences and algorithms were the main factors that affect the diagnostic performance of ML. Although its results were encouraging with the pooled sensitivity of around 0.80, it meant that 1 in 5 women that would go with undetected metastases, which may have a detrimental effect on the overall survival for 20% of patients with positive SLN status. Despite that a high NPV of 0.83 meant that ML could potentially benefit those with negative SLN, it might also translate to 1 in 5 tests being false negative. We would like to suggest that ML may not be yet usable in clinical routine especially when patient survival is used as a primary measurement of its outcome.Chen ChenYuhui QinHaotian ChenDongyong ZhuFabao GaoXiaoyue ZhouSpringerOpenarticleArtificial intelligenceAxillary lymph node metastasisMachine learningMagnetic resonance imagingMedical physics. Medical radiology. Nuclear medicineR895-920ENInsights into Imaging, Vol 12, Iss 1, Pp 1-12 (2021)
institution DOAJ
collection DOAJ
language EN
topic Artificial intelligence
Axillary lymph node metastasis
Machine learning
Magnetic resonance imaging
Medical physics. Medical radiology. Nuclear medicine
R895-920
spellingShingle Artificial intelligence
Axillary lymph node metastasis
Machine learning
Magnetic resonance imaging
Medical physics. Medical radiology. Nuclear medicine
R895-920
Chen Chen
Yuhui Qin
Haotian Chen
Dongyong Zhu
Fabao Gao
Xiaoyue Zhou
A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients
description Abstract Background Despite that machine learning (ML)-based MRI has been evaluated for diagnosis of axillary lymph node metastasis (ALNM) in breast cancer patients, diagnostic values they showed have been variable. In this study, we aimed to assess the use of ML to classify ALNM on MRI and to identify potential covariates that might influence the diagnostic performance of ML. Methods A systematic research of PubMed, Embase, Web of Science, and the Cochrane Library was conducted until 27 December 2020 to collect the included articles. Subgroup analysis was also performed. Findings Fourteen studies assessing a total of 2247 breast cancer patients were included in the analysis. The overall AUC for ML in the validation set was 0.80 (95% confidence interval [CI] 0.76–0.83) with a negative predictive value of 0.83. The pooled sensitivity and specificity were 0.79 (95% CI 0.74–0.84) and 0.77 (95% CI 0.73–0.81), respectively. In the subgroup analysis of the validation set, T1-weighted contrast-enhanced (T1CE) imaging with ML yielded a higher sensitivity (0.80 vs. 0.67 vs. 0.76) than the T2-weighted fat-suppressed (T2-FS) imaging and diffusion-weighted imaging (DWI). Support vector machines (SVMs) had a higher specificity than linear regression (LR) and linear discriminant analysis (LDA) (0.79 vs. 0.78 vs. 0.75), whereas LDA showed a higher sensitivity than LR and SVM (0.83 vs. 0.70 vs. 0.77). Interpretation MRI sequences and algorithms were the main factors that affect the diagnostic performance of ML. Although its results were encouraging with the pooled sensitivity of around 0.80, it meant that 1 in 5 women that would go with undetected metastases, which may have a detrimental effect on the overall survival for 20% of patients with positive SLN status. Despite that a high NPV of 0.83 meant that ML could potentially benefit those with negative SLN, it might also translate to 1 in 5 tests being false negative. We would like to suggest that ML may not be yet usable in clinical routine especially when patient survival is used as a primary measurement of its outcome.
format article
author Chen Chen
Yuhui Qin
Haotian Chen
Dongyong Zhu
Fabao Gao
Xiaoyue Zhou
author_facet Chen Chen
Yuhui Qin
Haotian Chen
Dongyong Zhu
Fabao Gao
Xiaoyue Zhou
author_sort Chen Chen
title A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients
title_short A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients
title_full A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients
title_fullStr A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients
title_full_unstemmed A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients
title_sort meta-analysis of the diagnostic performance of machine learning-based mri in the prediction of axillary lymph node metastasis in breast cancer patients
publisher SpringerOpen
publishDate 2021
url https://doaj.org/article/0dce7e64b6d74345803205cf17539f04
work_keys_str_mv AT chenchen ametaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients
AT yuhuiqin ametaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients
AT haotianchen ametaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients
AT dongyongzhu ametaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients
AT fabaogao ametaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients
AT xiaoyuezhou ametaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients
AT chenchen metaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients
AT yuhuiqin metaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients
AT haotianchen metaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients
AT dongyongzhu metaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients
AT fabaogao metaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients
AT xiaoyuezhou metaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients
_version_ 1718443466255499264