Creation Greenhouse Environment Map Using Localization of Edge of Cultivation Platforms Based on Stereo Vision

Introduction Stereo vision means the capability of extracting the depth based on analysis of two images taken from different angles of one scene. The result of stereo vision is a collection of three-dimensional points which describes the details of scene proportional to the resolution of the obtaine...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	A Nasiri, H Mobli, S Hosseinpour, Sh Rafiee
Formato:	article
Lenguaje:	EN FA
Publicado:	Ferdowsi University of Mashhad 2017
Materias:	cultivation platform depth discontinuous edge obstacle stereo vision Agriculture (General) S1-972 Engineering (General). Civil engineering (General) TA1-2040
Acceso en línea:	https://doaj.org/article/6b5ec471c002461987b57abf8fdb3dee
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:6b5ec471c002461987b57abf8fdb3dee
record_format	dspace
institution	DOAJ
collection	DOAJ
language	EN FA
topic	cultivation platform depth discontinuous edge obstacle stereo vision Agriculture (General) S1-972 Engineering (General). Civil engineering (General) TA1-2040
spellingShingle	cultivation platform depth discontinuous edge obstacle stereo vision Agriculture (General) S1-972 Engineering (General). Civil engineering (General) TA1-2040 A Nasiri H Mobli S Hosseinpour Sh Rafiee Creation Greenhouse Environment Map Using Localization of Edge of Cultivation Platforms Based on Stereo Vision
description	Introduction Stereo vision means the capability of extracting the depth based on analysis of two images taken from different angles of one scene. The result of stereo vision is a collection of three-dimensional points which describes the details of scene proportional to the resolution of the obtained images. Vehicle automatic steering and crop growth monitoring are two important operations in agricultural precision. The essential aspects of an automated steering are position and orientation of the agricultural equipment in relation to crop row, detection of obstacles and design of path planning between the crop rows. The developed map can provide this information in the real time. Machine vision has the capabilities to perform these tasks in order to execute some operations such as cultivation, spraying and harvesting. In greenhouse environment, it is possible to develop a map and perform an automatic control by detecting and localizing the cultivation platforms as the main moving obstacle. The current work was performed to meet a method based on the stereo vision for detecting and localizing platforms, and then, providing a two-dimensional map for cultivation platforms in the greenhouse environment. Materials and Methods In this research, two webcams, made by Microsoft Corporation with the resolution of 960×544, are connected to the computer via USB2 in order to produce a stereo parallel camera. Due to the structure of cultivation platforms, the number of points in the point cloud will be decreased by extracting the only upper and lower edges of the platform. The proposed method in this work aims at extracting the edges based on depth discontinuous features in the region of platform edge. By getting the disparity image of the platform edges from the rectified stereo images and translating its data to 3D-space, the point cloud model of the environments is constructed. Then by projecting the points to XZ plane and putting local maps together based on the visual odometry, global map of the environment is constructed. To evaluate the accuracy of the obtained algorithm in estimation of the position of the corners, Euclidian distances of coordinates of the corners achieved by Leica Total Station and coordinates and resulted from local maps, were computed. Results and Discussion Results showed that the lower edges have been detected with better accuracy than the upper ones. Upper edges were not desirably extracted because of being close to the pots. In contrast, due to the distance between lower edge and the ground surface, lower edges were extracted with a higher quality. Since the upper and lower edges of the platform are in the same direction, the lower edges of the platform have been only used for producing an integrated map of the greenhouse environment. The total length of the edge of the cultivation platforms was 106.6 meter, that 94.79% of which, was detected by the proposed algorithm. Some regions of the edge of the platforms were not detected, since they were not located in the view angle of the stereo camera. By the proposed algorithm, 83.33% of cultivation platforms’ corners, were detected with the average error of 0.07309 meter and mean squared error of 0.0076. Non- detected corners are due the fact that they were not located in the camera view angle. The maximum and minimum errors in the localization, according to the Euclidian distance, were 0.169 and 0.0001 meters, respectively. Conclusions Stereo vision is the perception of the depth of 3D with the disparity of the two images. In navigation, stereo vision is used for localizing the obstacles of movement. Cultivation platforms are the main obstacle of movement in greenhouses. Therefore, it is possible to design an integrated map of greenhouse environment and perform automatic control by localization of the cultivation platforms. In this research, the depth discontinuity feature in the locations of the edges, was used for the localization of the cultivation platforms’ edges. Using this feature, the size of the points required for establishing the point cloud model and also the associated processing time decreased, resulting improvement in the accuracy of determining coordination of the platforms’ corners.
format	article
author	A Nasiri H Mobli S Hosseinpour Sh Rafiee
author_facet	A Nasiri H Mobli S Hosseinpour Sh Rafiee
author_sort	A Nasiri
title	Creation Greenhouse Environment Map Using Localization of Edge of Cultivation Platforms Based on Stereo Vision
title_short	Creation Greenhouse Environment Map Using Localization of Edge of Cultivation Platforms Based on Stereo Vision
title_full	Creation Greenhouse Environment Map Using Localization of Edge of Cultivation Platforms Based on Stereo Vision
title_fullStr	Creation Greenhouse Environment Map Using Localization of Edge of Cultivation Platforms Based on Stereo Vision
title_full_unstemmed	Creation Greenhouse Environment Map Using Localization of Edge of Cultivation Platforms Based on Stereo Vision
title_sort	creation greenhouse environment map using localization of edge of cultivation platforms based on stereo vision
publisher	Ferdowsi University of Mashhad
publishDate	2017
url	https://doaj.org/article/6b5ec471c002461987b57abf8fdb3dee
work_keys_str_mv	AT anasiri creationgreenhouseenvironmentmapusinglocalizationofedgeofcultivationplatformsbasedonstereovision AT hmobli creationgreenhouseenvironmentmapusinglocalizationofedgeofcultivationplatformsbasedonstereovision AT shosseinpour creationgreenhouseenvironmentmapusinglocalizationofedgeofcultivationplatformsbasedonstereovision AT shrafiee creationgreenhouseenvironmentmapusinglocalizationofedgeofcultivationplatformsbasedonstereovision
_version_	1718429839243870208
spelling	oai:doaj.org-article:6b5ec471c002461987b57abf8fdb3dee2021-11-14T06:34:10ZCreation Greenhouse Environment Map Using Localization of Edge of Cultivation Platforms Based on Stereo Vision2228-68292423-394310.22067/jam.v7i2.58475https://doaj.org/article/6b5ec471c002461987b57abf8fdb3dee2017-09-01T00:00:00Zhttps://jame.um.ac.ir/article_31983_0ba38ae8f4f6f66c0282c7375fb34935.pdfhttps://doaj.org/toc/2228-6829https://doaj.org/toc/2423-3943Introduction Stereo vision means the capability of extracting the depth based on analysis of two images taken from different angles of one scene. The result of stereo vision is a collection of three-dimensional points which describes the details of scene proportional to the resolution of the obtained images. Vehicle automatic steering and crop growth monitoring are two important operations in agricultural precision. The essential aspects of an automated steering are position and orientation of the agricultural equipment in relation to crop row, detection of obstacles and design of path planning between the crop rows. The developed map can provide this information in the real time. Machine vision has the capabilities to perform these tasks in order to execute some operations such as cultivation, spraying and harvesting. In greenhouse environment, it is possible to develop a map and perform an automatic control by detecting and localizing the cultivation platforms as the main moving obstacle. The current work was performed to meet a method based on the stereo vision for detecting and localizing platforms, and then, providing a two-dimensional map for cultivation platforms in the greenhouse environment. Materials and Methods In this research, two webcams, made by Microsoft Corporation with the resolution of 960×544, are connected to the computer via USB2 in order to produce a stereo parallel camera. Due to the structure of cultivation platforms, the number of points in the point cloud will be decreased by extracting the only upper and lower edges of the platform. The proposed method in this work aims at extracting the edges based on depth discontinuous features in the region of platform edge. By getting the disparity image of the platform edges from the rectified stereo images and translating its data to 3D-space, the point cloud model of the environments is constructed. Then by projecting the points to XZ plane and putting local maps together based on the visual odometry, global map of the environment is constructed. To evaluate the accuracy of the obtained algorithm in estimation of the position of the corners, Euclidian distances of coordinates of the corners achieved by Leica Total Station and coordinates and resulted from local maps, were computed. Results and Discussion Results showed that the lower edges have been detected with better accuracy than the upper ones. Upper edges were not desirably extracted because of being close to the pots. In contrast, due to the distance between lower edge and the ground surface, lower edges were extracted with a higher quality. Since the upper and lower edges of the platform are in the same direction, the lower edges of the platform have been only used for producing an integrated map of the greenhouse environment. The total length of the edge of the cultivation platforms was 106.6 meter, that 94.79% of which, was detected by the proposed algorithm. Some regions of the edge of the platforms were not detected, since they were not located in the view angle of the stereo camera. By the proposed algorithm, 83.33% of cultivation platforms’ corners, were detected with the average error of 0.07309 meter and mean squared error of 0.0076. Non- detected corners are due the fact that they were not located in the camera view angle. The maximum and minimum errors in the localization, according to the Euclidian distance, were 0.169 and 0.0001 meters, respectively. Conclusions Stereo vision is the perception of the depth of 3D with the disparity of the two images. In navigation, stereo vision is used for localizing the obstacles of movement. Cultivation platforms are the main obstacle of movement in greenhouses. Therefore, it is possible to design an integrated map of greenhouse environment and perform automatic control by localization of the cultivation platforms. In this research, the depth discontinuity feature in the locations of the edges, was used for the localization of the cultivation platforms’ edges. Using this feature, the size of the points required for establishing the point cloud model and also the associated processing time decreased, resulting improvement in the accuracy of determining coordination of the platforms’ corners.A NasiriH MobliS HosseinpourSh RafieeFerdowsi University of Mashhadarticlecultivation platformdepth discontinuousedgeobstaclestereo visionAgriculture (General)S1-972Engineering (General). Civil engineering (General)TA1-2040ENFAJournal of Agricultural Machinery, Vol 7, Iss 2, Pp 336-349 (2017)

Creation Greenhouse Environment Map Using Localization of Edge of Cultivation Platforms Based on Stereo Vision

Ejemplares similares