Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases
Abstract Background Heart sound measurement is crucial for analyzing and diagnosing patients with heart diseases. This study employed phonocardiogram signals as the input signal for heart disease analysis due to the accessibility of the respective method. This study referenced preprocessing techniqu...
Guardado en:
Autores principales: | , , , , , , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
BMC
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/c619fe36f26449518864407d71102bcc |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:c619fe36f26449518864407d71102bcc |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:c619fe36f26449518864407d71102bcc2021-11-14T12:12:58ZRobust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases10.1186/s12859-021-04032-81471-2105https://doaj.org/article/c619fe36f26449518864407d71102bcc2021-11-01T00:00:00Zhttps://doi.org/10.1186/s12859-021-04032-8https://doaj.org/toc/1471-2105Abstract Background Heart sound measurement is crucial for analyzing and diagnosing patients with heart diseases. This study employed phonocardiogram signals as the input signal for heart disease analysis due to the accessibility of the respective method. This study referenced preprocessing techniques proposed by other researchers for the conversion of phonocardiogram signals into characteristic images composed using frequency subband. Image recognition was then conducted through the use of convolutional neural networks (CNNs), in order to classify the predicted of phonocardiogram signals as normal or abnormal. However, CNN requires the tuning of multiple hyperparameters, which entails an optimization problem for the hyperparameters in the model. To maximize CNN robustness, the uniform experiment design method and a science-based methodical experiment design were used to optimize CNN hyperparameters in this study. Results An artificial intelligence prediction model was constructed using CNN, and the uniform experiment design method was proposed to acquire hyperparameters for optimal CNN robustness. The results indicate Filters ( $${X}_{1}$$ X 1 ), Stride ( $${X}_{3}$$ X 3 ), Activation functions ( $${X}_{6}$$ X 6 ), and Dropout ( $${X}_{7}$$ X 7 ) to be significant factors considerably influencing the ability of CNN to distinguish among heart sound states. Finally, the confirmation experiment was conducted, and the hyperparameter combination for optimal model robustness was Filters ( $${X}_{1}$$ X 1 ) = 32, Kernel Size ( $${X}_{2})$$ X 2 ) = 3 × 3, Stride ( $${X}_{3}$$ X 3 ) = (1,1), Padding ( $${X}_{4})$$ X 4 ) as same, Optimizer ( $${X}_{5})$$ X 5 ) as the stochastic gradient descent, Activation functions ( $${X}_{6}$$ X 6 ) as relu, and Dropout ( $${X}_{7}$$ X 7 ) = 0.544. With this combination of parameters, the model had an average prediction accuracy rate of 0.787 and standard deviation of 0. Conclusion In this study, phonocardiogram signals were used for the early prediction of heart diseases. The science-based and methodical uniform experiment design was used for the optimization of CNN hyperparameters to construct a CNN with optimal robustness. The results revealed that the constructed model exhibited robustness and an acceptable accuracy rate. Other literature has failed to address hyperparameter optimization problems in CNN; a method is subsequently proposed for robust CNN optimization, thereby solving this problem.Wen-Hsien HoTian-Hsiang HuangPo-Yuan YangJyh-Horng ChouJin-Yi QuPo-Chih ChangFu-I. ChouJinn-Tsong TsaiBMCarticlePhonocardiogramHeart diseaseRobust optimizationConvolutional neural networkUniform designComputer applications to medicine. Medical informaticsR858-859.7Biology (General)QH301-705.5ENBMC Bioinformatics, Vol 22, Iss S5, Pp 1-11 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Phonocardiogram Heart disease Robust optimization Convolutional neural network Uniform design Computer applications to medicine. Medical informatics R858-859.7 Biology (General) QH301-705.5 |
spellingShingle |
Phonocardiogram Heart disease Robust optimization Convolutional neural network Uniform design Computer applications to medicine. Medical informatics R858-859.7 Biology (General) QH301-705.5 Wen-Hsien Ho Tian-Hsiang Huang Po-Yuan Yang Jyh-Horng Chou Jin-Yi Qu Po-Chih Chang Fu-I. Chou Jinn-Tsong Tsai Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases |
description |
Abstract Background Heart sound measurement is crucial for analyzing and diagnosing patients with heart diseases. This study employed phonocardiogram signals as the input signal for heart disease analysis due to the accessibility of the respective method. This study referenced preprocessing techniques proposed by other researchers for the conversion of phonocardiogram signals into characteristic images composed using frequency subband. Image recognition was then conducted through the use of convolutional neural networks (CNNs), in order to classify the predicted of phonocardiogram signals as normal or abnormal. However, CNN requires the tuning of multiple hyperparameters, which entails an optimization problem for the hyperparameters in the model. To maximize CNN robustness, the uniform experiment design method and a science-based methodical experiment design were used to optimize CNN hyperparameters in this study. Results An artificial intelligence prediction model was constructed using CNN, and the uniform experiment design method was proposed to acquire hyperparameters for optimal CNN robustness. The results indicate Filters ( $${X}_{1}$$ X 1 ), Stride ( $${X}_{3}$$ X 3 ), Activation functions ( $${X}_{6}$$ X 6 ), and Dropout ( $${X}_{7}$$ X 7 ) to be significant factors considerably influencing the ability of CNN to distinguish among heart sound states. Finally, the confirmation experiment was conducted, and the hyperparameter combination for optimal model robustness was Filters ( $${X}_{1}$$ X 1 ) = 32, Kernel Size ( $${X}_{2})$$ X 2 ) = 3 × 3, Stride ( $${X}_{3}$$ X 3 ) = (1,1), Padding ( $${X}_{4})$$ X 4 ) as same, Optimizer ( $${X}_{5})$$ X 5 ) as the stochastic gradient descent, Activation functions ( $${X}_{6}$$ X 6 ) as relu, and Dropout ( $${X}_{7}$$ X 7 ) = 0.544. With this combination of parameters, the model had an average prediction accuracy rate of 0.787 and standard deviation of 0. Conclusion In this study, phonocardiogram signals were used for the early prediction of heart diseases. The science-based and methodical uniform experiment design was used for the optimization of CNN hyperparameters to construct a CNN with optimal robustness. The results revealed that the constructed model exhibited robustness and an acceptable accuracy rate. Other literature has failed to address hyperparameter optimization problems in CNN; a method is subsequently proposed for robust CNN optimization, thereby solving this problem. |
format |
article |
author |
Wen-Hsien Ho Tian-Hsiang Huang Po-Yuan Yang Jyh-Horng Chou Jin-Yi Qu Po-Chih Chang Fu-I. Chou Jinn-Tsong Tsai |
author_facet |
Wen-Hsien Ho Tian-Hsiang Huang Po-Yuan Yang Jyh-Horng Chou Jin-Yi Qu Po-Chih Chang Fu-I. Chou Jinn-Tsong Tsai |
author_sort |
Wen-Hsien Ho |
title |
Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases |
title_short |
Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases |
title_full |
Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases |
title_fullStr |
Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases |
title_full_unstemmed |
Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases |
title_sort |
robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases |
publisher |
BMC |
publishDate |
2021 |
url |
https://doaj.org/article/c619fe36f26449518864407d71102bcc |
work_keys_str_mv |
AT wenhsienho robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases AT tianhsianghuang robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases AT poyuanyang robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases AT jyhhorngchou robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases AT jinyiqu robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases AT pochihchang robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases AT fuichou robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases AT jinntsongtsai robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases |
_version_ |
1718429373005037568 |