Automated color detection in orchids using color labels and deep learning.

The color of particular parts of a flower is often employed as one of the features to differentiate between flower types. Thus, color is also used in flower-image classification. Color labels, such as 'green', 'red', and 'yellow', are used by taxonomists and lay people...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Diah Harnoni Apriyanti, Luuk J Spreeuwers, Peter J F Lucas, Raymond N J Veldhuis
Formato: article
Lenguaje:EN
Publicado: Public Library of Science (PLoS) 2021
Materias:
R
Q
Acceso en línea:https://doaj.org/article/7bfe055128944aef928557623fc476b5
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:7bfe055128944aef928557623fc476b5
record_format dspace
spelling oai:doaj.org-article:7bfe055128944aef928557623fc476b52021-12-02T20:13:26ZAutomated color detection in orchids using color labels and deep learning.1932-620310.1371/journal.pone.0259036https://doaj.org/article/7bfe055128944aef928557623fc476b52021-01-01T00:00:00Zhttps://doi.org/10.1371/journal.pone.0259036https://doaj.org/toc/1932-6203The color of particular parts of a flower is often employed as one of the features to differentiate between flower types. Thus, color is also used in flower-image classification. Color labels, such as 'green', 'red', and 'yellow', are used by taxonomists and lay people alike to describe the color of plants. Flower image datasets usually only consist of images and do not contain flower descriptions. In this research, we have built a flower-image dataset, especially regarding orchid species, which consists of human-friendly textual descriptions of features of specific flowers, on the one hand, and digital photographs indicating how a flower looks like, on the other hand. Using this dataset, a new automated color detection model was developed. It is the first research of its kind using color labels and deep learning for color detection in flower recognition. As deep learning often excels in pattern recognition in digital images, we applied transfer learning with various amounts of unfreezing of layers with five different neural network architectures (VGG16, Inception, Resnet50, Xception, Nasnet) to determine which architecture and which scheme of transfer learning performs best. In addition, various color scheme scenarios were tested, including the use of primary and secondary color together, and, in addition, the effectiveness of dealing with multi-class classification using multi-class, combined binary, and, finally, ensemble classifiers were studied. The best overall performance was achieved by the ensemble classifier. The results show that the proposed method can detect the color of flower and labellum very well without having to perform image segmentation. The result of this study can act as a foundation for the development of an image-based plant recognition system that is able to offer an explanation of a provided classification.Diah Harnoni ApriyantiLuuk J SpreeuwersPeter J F LucasRaymond N J VeldhuisPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 16, Iss 10, p e0259036 (2021)
institution DOAJ
collection DOAJ
language EN
topic Medicine
R
Science
Q
spellingShingle Medicine
R
Science
Q
Diah Harnoni Apriyanti
Luuk J Spreeuwers
Peter J F Lucas
Raymond N J Veldhuis
Automated color detection in orchids using color labels and deep learning.
description The color of particular parts of a flower is often employed as one of the features to differentiate between flower types. Thus, color is also used in flower-image classification. Color labels, such as 'green', 'red', and 'yellow', are used by taxonomists and lay people alike to describe the color of plants. Flower image datasets usually only consist of images and do not contain flower descriptions. In this research, we have built a flower-image dataset, especially regarding orchid species, which consists of human-friendly textual descriptions of features of specific flowers, on the one hand, and digital photographs indicating how a flower looks like, on the other hand. Using this dataset, a new automated color detection model was developed. It is the first research of its kind using color labels and deep learning for color detection in flower recognition. As deep learning often excels in pattern recognition in digital images, we applied transfer learning with various amounts of unfreezing of layers with five different neural network architectures (VGG16, Inception, Resnet50, Xception, Nasnet) to determine which architecture and which scheme of transfer learning performs best. In addition, various color scheme scenarios were tested, including the use of primary and secondary color together, and, in addition, the effectiveness of dealing with multi-class classification using multi-class, combined binary, and, finally, ensemble classifiers were studied. The best overall performance was achieved by the ensemble classifier. The results show that the proposed method can detect the color of flower and labellum very well without having to perform image segmentation. The result of this study can act as a foundation for the development of an image-based plant recognition system that is able to offer an explanation of a provided classification.
format article
author Diah Harnoni Apriyanti
Luuk J Spreeuwers
Peter J F Lucas
Raymond N J Veldhuis
author_facet Diah Harnoni Apriyanti
Luuk J Spreeuwers
Peter J F Lucas
Raymond N J Veldhuis
author_sort Diah Harnoni Apriyanti
title Automated color detection in orchids using color labels and deep learning.
title_short Automated color detection in orchids using color labels and deep learning.
title_full Automated color detection in orchids using color labels and deep learning.
title_fullStr Automated color detection in orchids using color labels and deep learning.
title_full_unstemmed Automated color detection in orchids using color labels and deep learning.
title_sort automated color detection in orchids using color labels and deep learning.
publisher Public Library of Science (PLoS)
publishDate 2021
url https://doaj.org/article/7bfe055128944aef928557623fc476b5
work_keys_str_mv AT diahharnoniapriyanti automatedcolordetectioninorchidsusingcolorlabelsanddeeplearning
AT luukjspreeuwers automatedcolordetectioninorchidsusingcolorlabelsanddeeplearning
AT peterjflucas automatedcolordetectioninorchidsusingcolorlabelsanddeeplearning
AT raymondnjveldhuis automatedcolordetectioninorchidsusingcolorlabelsanddeeplearning
_version_ 1718374774398255104