A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients
Abstract Background Despite that machine learning (ML)-based MRI has been evaluated for diagnosis of axillary lymph node metastasis (ALNM) in breast cancer patients, diagnostic values they showed have been variable. In this study, we aimed to assess the use of ML to classify ALNM on MRI and to ident...
Guardado en:
Autores principales: | , , , , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
SpringerOpen
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/0dce7e64b6d74345803205cf17539f04 |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:0dce7e64b6d74345803205cf17539f04 |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:0dce7e64b6d74345803205cf17539f042021-11-07T12:14:30ZA meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients10.1186/s13244-021-01034-11869-4101https://doaj.org/article/0dce7e64b6d74345803205cf17539f042021-11-01T00:00:00Zhttps://doi.org/10.1186/s13244-021-01034-1https://doaj.org/toc/1869-4101Abstract Background Despite that machine learning (ML)-based MRI has been evaluated for diagnosis of axillary lymph node metastasis (ALNM) in breast cancer patients, diagnostic values they showed have been variable. In this study, we aimed to assess the use of ML to classify ALNM on MRI and to identify potential covariates that might influence the diagnostic performance of ML. Methods A systematic research of PubMed, Embase, Web of Science, and the Cochrane Library was conducted until 27 December 2020 to collect the included articles. Subgroup analysis was also performed. Findings Fourteen studies assessing a total of 2247 breast cancer patients were included in the analysis. The overall AUC for ML in the validation set was 0.80 (95% confidence interval [CI] 0.76–0.83) with a negative predictive value of 0.83. The pooled sensitivity and specificity were 0.79 (95% CI 0.74–0.84) and 0.77 (95% CI 0.73–0.81), respectively. In the subgroup analysis of the validation set, T1-weighted contrast-enhanced (T1CE) imaging with ML yielded a higher sensitivity (0.80 vs. 0.67 vs. 0.76) than the T2-weighted fat-suppressed (T2-FS) imaging and diffusion-weighted imaging (DWI). Support vector machines (SVMs) had a higher specificity than linear regression (LR) and linear discriminant analysis (LDA) (0.79 vs. 0.78 vs. 0.75), whereas LDA showed a higher sensitivity than LR and SVM (0.83 vs. 0.70 vs. 0.77). Interpretation MRI sequences and algorithms were the main factors that affect the diagnostic performance of ML. Although its results were encouraging with the pooled sensitivity of around 0.80, it meant that 1 in 5 women that would go with undetected metastases, which may have a detrimental effect on the overall survival for 20% of patients with positive SLN status. Despite that a high NPV of 0.83 meant that ML could potentially benefit those with negative SLN, it might also translate to 1 in 5 tests being false negative. We would like to suggest that ML may not be yet usable in clinical routine especially when patient survival is used as a primary measurement of its outcome.Chen ChenYuhui QinHaotian ChenDongyong ZhuFabao GaoXiaoyue ZhouSpringerOpenarticleArtificial intelligenceAxillary lymph node metastasisMachine learningMagnetic resonance imagingMedical physics. Medical radiology. Nuclear medicineR895-920ENInsights into Imaging, Vol 12, Iss 1, Pp 1-12 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Artificial intelligence Axillary lymph node metastasis Machine learning Magnetic resonance imaging Medical physics. Medical radiology. Nuclear medicine R895-920 |
spellingShingle |
Artificial intelligence Axillary lymph node metastasis Machine learning Magnetic resonance imaging Medical physics. Medical radiology. Nuclear medicine R895-920 Chen Chen Yuhui Qin Haotian Chen Dongyong Zhu Fabao Gao Xiaoyue Zhou A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients |
description |
Abstract Background Despite that machine learning (ML)-based MRI has been evaluated for diagnosis of axillary lymph node metastasis (ALNM) in breast cancer patients, diagnostic values they showed have been variable. In this study, we aimed to assess the use of ML to classify ALNM on MRI and to identify potential covariates that might influence the diagnostic performance of ML. Methods A systematic research of PubMed, Embase, Web of Science, and the Cochrane Library was conducted until 27 December 2020 to collect the included articles. Subgroup analysis was also performed. Findings Fourteen studies assessing a total of 2247 breast cancer patients were included in the analysis. The overall AUC for ML in the validation set was 0.80 (95% confidence interval [CI] 0.76–0.83) with a negative predictive value of 0.83. The pooled sensitivity and specificity were 0.79 (95% CI 0.74–0.84) and 0.77 (95% CI 0.73–0.81), respectively. In the subgroup analysis of the validation set, T1-weighted contrast-enhanced (T1CE) imaging with ML yielded a higher sensitivity (0.80 vs. 0.67 vs. 0.76) than the T2-weighted fat-suppressed (T2-FS) imaging and diffusion-weighted imaging (DWI). Support vector machines (SVMs) had a higher specificity than linear regression (LR) and linear discriminant analysis (LDA) (0.79 vs. 0.78 vs. 0.75), whereas LDA showed a higher sensitivity than LR and SVM (0.83 vs. 0.70 vs. 0.77). Interpretation MRI sequences and algorithms were the main factors that affect the diagnostic performance of ML. Although its results were encouraging with the pooled sensitivity of around 0.80, it meant that 1 in 5 women that would go with undetected metastases, which may have a detrimental effect on the overall survival for 20% of patients with positive SLN status. Despite that a high NPV of 0.83 meant that ML could potentially benefit those with negative SLN, it might also translate to 1 in 5 tests being false negative. We would like to suggest that ML may not be yet usable in clinical routine especially when patient survival is used as a primary measurement of its outcome. |
format |
article |
author |
Chen Chen Yuhui Qin Haotian Chen Dongyong Zhu Fabao Gao Xiaoyue Zhou |
author_facet |
Chen Chen Yuhui Qin Haotian Chen Dongyong Zhu Fabao Gao Xiaoyue Zhou |
author_sort |
Chen Chen |
title |
A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients |
title_short |
A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients |
title_full |
A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients |
title_fullStr |
A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients |
title_full_unstemmed |
A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients |
title_sort |
meta-analysis of the diagnostic performance of machine learning-based mri in the prediction of axillary lymph node metastasis in breast cancer patients |
publisher |
SpringerOpen |
publishDate |
2021 |
url |
https://doaj.org/article/0dce7e64b6d74345803205cf17539f04 |
work_keys_str_mv |
AT chenchen ametaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients AT yuhuiqin ametaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients AT haotianchen ametaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients AT dongyongzhu ametaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients AT fabaogao ametaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients AT xiaoyuezhou ametaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients AT chenchen metaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients AT yuhuiqin metaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients AT haotianchen metaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients AT dongyongzhu metaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients AT fabaogao metaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients AT xiaoyuezhou metaanalysisofthediagnosticperformanceofmachinelearningbasedmriinthepredictionofaxillarylymphnodemetastasisinbreastcancerpatients |
_version_ |
1718443466255499264 |