A study of generalization and compatibility performance of 3D U-Net segmentation on multiple heterogeneous liver CT datasets

Abstract Background Most existing algorithms have been focused on the segmentation from several public Liver CT datasets scanned regularly (no pneumoperitoneum and horizontal supine position). This study primarily segmented datasets with unconventional liver shapes and intensities deduced by contras...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Baochun He, Dalong Yin, Xiaoxia Chen, Huoling Luo, Deqiang Xiao, Mu He, Guisheng Wang, Chihua Fang, Lianxin Liu, Fucang Jia
Formato: article
Lenguaje:EN
Publicado: BMC 2021
Materias:
Acceso en línea:https://doaj.org/article/3c62fd767e564528817c671573a9db94
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:3c62fd767e564528817c671573a9db94
record_format dspace
spelling oai:doaj.org-article:3c62fd767e564528817c671573a9db942021-11-28T12:30:29ZA study of generalization and compatibility performance of 3D U-Net segmentation on multiple heterogeneous liver CT datasets10.1186/s12880-021-00708-y1471-2342https://doaj.org/article/3c62fd767e564528817c671573a9db942021-11-01T00:00:00Zhttps://doi.org/10.1186/s12880-021-00708-yhttps://doaj.org/toc/1471-2342Abstract Background Most existing algorithms have been focused on the segmentation from several public Liver CT datasets scanned regularly (no pneumoperitoneum and horizontal supine position). This study primarily segmented datasets with unconventional liver shapes and intensities deduced by contrast phases, irregular scanning conditions, different scanning objects of pigs and patients with large pathological tumors, which formed the multiple heterogeneity of datasets used in this study. Methods The multiple heterogeneous datasets used in this paper includes: (1) One public contrast-enhanced CT dataset and one public non-contrast CT dataset; (2) A contrast-enhanced dataset that has abnormal liver shape with very long left liver lobes and large-sized liver tumors with abnormal presets deduced by microvascular invasion; (3) One artificial pneumoperitoneum dataset under the pneumoperitoneum and three scanning profiles (horizontal/left/right recumbent position); (4) Two porcine datasets of Bama type and domestic type that contains pneumoperitoneum cases but with large anatomy discrepancy with humans. The study aimed to investigate the segmentation performances of 3D U-Net in: (1) generalization ability between multiple heterogeneous datasets by cross-testing experiments; (2) the compatibility when hybrid training all datasets in different sampling and encoder layer sharing schema. We further investigated the compatibility of encoder level by setting separate level for each dataset (i.e., dataset-wise convolutions) while sharing the decoder. Results Model trained on different datasets has different segmentation performance. The prediction accuracy between LiTS dataset and Zhujiang dataset was about 0.955 and 0.958 which shows their good generalization ability due to that they were all contrast-enhanced clinical patient datasets scanned regularly. For the datasets scanned under pneumoperitoneum, their corresponding datasets scanned without pneumoperitoneum showed good generalization ability. Dataset-wise convolution module in high-level can improve the dataset unbalance problem. The experimental results will facilitate researchers making solutions when segmenting those special datasets. Conclusions (1) Regularly scanned datasets is well generalized to irregularly ones. (2) The hybrid training is beneficial but the dataset imbalance problem always exits due to the multi-domain homogeneity. The higher levels encoded more domain specific information than lower levels and thus were less compatible in terms of our datasets.Baochun HeDalong YinXiaoxia ChenHuoling LuoDeqiang XiaoMu HeGuisheng WangChihua FangLianxin LiuFucang JiaBMCarticleLiver segmentationU-NetDataset-wise convolutionGeneralizationMedical technologyR855-855.5ENBMC Medical Imaging, Vol 21, Iss 1, Pp 1-13 (2021)
institution DOAJ
collection DOAJ
language EN
topic Liver segmentation
U-Net
Dataset-wise convolution
Generalization
Medical technology
R855-855.5
spellingShingle Liver segmentation
U-Net
Dataset-wise convolution
Generalization
Medical technology
R855-855.5
Baochun He
Dalong Yin
Xiaoxia Chen
Huoling Luo
Deqiang Xiao
Mu He
Guisheng Wang
Chihua Fang
Lianxin Liu
Fucang Jia
A study of generalization and compatibility performance of 3D U-Net segmentation on multiple heterogeneous liver CT datasets
description Abstract Background Most existing algorithms have been focused on the segmentation from several public Liver CT datasets scanned regularly (no pneumoperitoneum and horizontal supine position). This study primarily segmented datasets with unconventional liver shapes and intensities deduced by contrast phases, irregular scanning conditions, different scanning objects of pigs and patients with large pathological tumors, which formed the multiple heterogeneity of datasets used in this study. Methods The multiple heterogeneous datasets used in this paper includes: (1) One public contrast-enhanced CT dataset and one public non-contrast CT dataset; (2) A contrast-enhanced dataset that has abnormal liver shape with very long left liver lobes and large-sized liver tumors with abnormal presets deduced by microvascular invasion; (3) One artificial pneumoperitoneum dataset under the pneumoperitoneum and three scanning profiles (horizontal/left/right recumbent position); (4) Two porcine datasets of Bama type and domestic type that contains pneumoperitoneum cases but with large anatomy discrepancy with humans. The study aimed to investigate the segmentation performances of 3D U-Net in: (1) generalization ability between multiple heterogeneous datasets by cross-testing experiments; (2) the compatibility when hybrid training all datasets in different sampling and encoder layer sharing schema. We further investigated the compatibility of encoder level by setting separate level for each dataset (i.e., dataset-wise convolutions) while sharing the decoder. Results Model trained on different datasets has different segmentation performance. The prediction accuracy between LiTS dataset and Zhujiang dataset was about 0.955 and 0.958 which shows their good generalization ability due to that they were all contrast-enhanced clinical patient datasets scanned regularly. For the datasets scanned under pneumoperitoneum, their corresponding datasets scanned without pneumoperitoneum showed good generalization ability. Dataset-wise convolution module in high-level can improve the dataset unbalance problem. The experimental results will facilitate researchers making solutions when segmenting those special datasets. Conclusions (1) Regularly scanned datasets is well generalized to irregularly ones. (2) The hybrid training is beneficial but the dataset imbalance problem always exits due to the multi-domain homogeneity. The higher levels encoded more domain specific information than lower levels and thus were less compatible in terms of our datasets.
format article
author Baochun He
Dalong Yin
Xiaoxia Chen
Huoling Luo
Deqiang Xiao
Mu He
Guisheng Wang
Chihua Fang
Lianxin Liu
Fucang Jia
author_facet Baochun He
Dalong Yin
Xiaoxia Chen
Huoling Luo
Deqiang Xiao
Mu He
Guisheng Wang
Chihua Fang
Lianxin Liu
Fucang Jia
author_sort Baochun He
title A study of generalization and compatibility performance of 3D U-Net segmentation on multiple heterogeneous liver CT datasets
title_short A study of generalization and compatibility performance of 3D U-Net segmentation on multiple heterogeneous liver CT datasets
title_full A study of generalization and compatibility performance of 3D U-Net segmentation on multiple heterogeneous liver CT datasets
title_fullStr A study of generalization and compatibility performance of 3D U-Net segmentation on multiple heterogeneous liver CT datasets
title_full_unstemmed A study of generalization and compatibility performance of 3D U-Net segmentation on multiple heterogeneous liver CT datasets
title_sort study of generalization and compatibility performance of 3d u-net segmentation on multiple heterogeneous liver ct datasets
publisher BMC
publishDate 2021
url https://doaj.org/article/3c62fd767e564528817c671573a9db94
work_keys_str_mv AT baochunhe astudyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT dalongyin astudyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT xiaoxiachen astudyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT huolingluo astudyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT deqiangxiao astudyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT muhe astudyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT guishengwang astudyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT chihuafang astudyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT lianxinliu astudyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT fucangjia astudyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT baochunhe studyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT dalongyin studyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT xiaoxiachen studyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT huolingluo studyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT deqiangxiao studyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT muhe studyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT guishengwang studyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT chihuafang studyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT lianxinliu studyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
AT fucangjia studyofgeneralizationandcompatibilityperformanceof3dunetsegmentationonmultipleheterogeneousliverctdatasets
_version_ 1718407945696313344