Simultaneous Localization and Mapping in Greenhouse with Stereo Vision

Introduction Increasing the production efficiency is an important goal in precision farming. The use of precision farming requires a lot of labor work. Also, due to the risk of agricultural operations, it is not recommended to do it directly by humans. Therefore, it is necessary for agricultural ope...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Z Khosrobeygi, Sh Rafiee, S. S Mohtasebi, A Nasiri
Formato: article
Lenguaje:EN
FA
Publicado: Ferdowsi University of Mashhad 2020
Materias:
ros
Acceso en línea:https://doaj.org/article/718f1851070a44e3b33928fca33848bc
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:718f1851070a44e3b33928fca33848bc
record_format dspace
institution DOAJ
collection DOAJ
language EN
FA
topic ros
greenhouse
simultaneous localization and mapping (slam)
stereo vision
Agriculture (General)
S1-972
Engineering (General). Civil engineering (General)
TA1-2040
spellingShingle ros
greenhouse
simultaneous localization and mapping (slam)
stereo vision
Agriculture (General)
S1-972
Engineering (General). Civil engineering (General)
TA1-2040
Z Khosrobeygi
Sh Rafiee
S. S Mohtasebi
A Nasiri
Simultaneous Localization and Mapping in Greenhouse with Stereo Vision
description Introduction Increasing the production efficiency is an important goal in precision farming. The use of precision farming requires a lot of labor work. Also, due to the risk of agricultural operations, it is not recommended to do it directly by humans. Therefore, it is necessary for agricultural operations to be carried out automatically. For this reason, the application of robotics in agricultural environments, especially in the greenhouse, is increasing. The first step in automatic farming is autonomous navigation. For autonomous navigation, a robot must be the ability to understand its environment and recognize its position. In other words, a robot must be able to create a map of an unknown environment, locate itself on this map and finally plane for the path. This problem is solvable by Simultaneous Localization and Mapping (SLAM). The SLAM problem is a recursive estimation process. In the other words, when a robot moves in an unknown environment, mapping and localization errors increase incrementally. To reduce these two errors, a recursive estimation process is used to solve the SLAM problem. Materials and Methods In this research, two webcams, made by Microsoft Corporation with the resolution of 960×544, are connected to the computer via USB2 in order to produce a stereo parallel camera. For this study, we used a greenhouse that was located the Arak, Iran. Before taking stereo images, a camera path was designed in the greenhouse. This path may be either straight or curved. The designed path was implemented in the greenhouse. The entire path traversed by a stereo camera was 32.7 m and 150 stereo images were taken. Graph-SLAM algorithm was used for Simultaneous Localization and Mapping in the greenhouse. Using the ROS framework, the SLAM algorithm was designed with nodes and network for connecting the nodes. Results and Discussion For evaluation, the stereo camera locations, every step was measured manually and compared with the stereo camera locations that were estimated in the graph-SLAM algorithm. The position error was calculated through the Euclidean distance (DE) between the estimated points and the actual points. The results of this study showed that, the proposed algorithm has an average of error 0.0679412, standard deviation of 0.0456431 and root mean square error (RMSE) of 0.0075569 for camera localization. In this research, only a stereo camera was used to prepare a map of the environment, but other researches have used multiple sensor combinations. Another advantage of this research related to others was created a 3D map (point cloud) of the environment and loop closer detection. In the 3D map, in addition to determining the exact location of the plant, the height of the plant can also be estimated. Plant height estimate is important in some agricultural operations such as spot spray, harvesting and pruning. Conclusions Due to the risk of agricultural activities, the use of robotics is essential. Autonomous navigation is one of the branches of the robotics. For autonomous navigation, a map of environment and localization in this map is need. The purpose of our research was to provide simultaneous localization and mapping (SLAM) in agricultural environments. ROS is a strong framework for solving the SLAM problem. So that, this problem can be solved by combining different nodes in ROS. The method depended only on the information from the stereo camera because stereo camera provided exact distance information. We believe that this study will contribute to the field of autonomous robot applications in agriculture. In future studies, it is possible to use an actual robot in the greenhouse with various sensors for SLAM and path planning.
format article
author Z Khosrobeygi
Sh Rafiee
S. S Mohtasebi
A Nasiri
author_facet Z Khosrobeygi
Sh Rafiee
S. S Mohtasebi
A Nasiri
author_sort Z Khosrobeygi
title Simultaneous Localization and Mapping in Greenhouse with Stereo Vision
title_short Simultaneous Localization and Mapping in Greenhouse with Stereo Vision
title_full Simultaneous Localization and Mapping in Greenhouse with Stereo Vision
title_fullStr Simultaneous Localization and Mapping in Greenhouse with Stereo Vision
title_full_unstemmed Simultaneous Localization and Mapping in Greenhouse with Stereo Vision
title_sort simultaneous localization and mapping in greenhouse with stereo vision
publisher Ferdowsi University of Mashhad
publishDate 2020
url https://doaj.org/article/718f1851070a44e3b33928fca33848bc
work_keys_str_mv AT zkhosrobeygi simultaneouslocalizationandmappingingreenhousewithstereovision
AT shrafiee simultaneouslocalizationandmappingingreenhousewithstereovision
AT ssmohtasebi simultaneouslocalizationandmappingingreenhousewithstereovision
AT anasiri simultaneouslocalizationandmappingingreenhousewithstereovision
_version_ 1718429842095996928
spelling oai:doaj.org-article:718f1851070a44e3b33928fca33848bc2021-11-14T06:35:26ZSimultaneous Localization and Mapping in Greenhouse with Stereo Vision2228-68292423-394310.22067/jam.v10i2.78256https://doaj.org/article/718f1851070a44e3b33928fca33848bc2020-09-01T00:00:00Zhttps://jame.um.ac.ir/article_34156_98002a5487a5853164ca1b6fd8cfbb5c.pdfhttps://doaj.org/toc/2228-6829https://doaj.org/toc/2423-3943Introduction Increasing the production efficiency is an important goal in precision farming. The use of precision farming requires a lot of labor work. Also, due to the risk of agricultural operations, it is not recommended to do it directly by humans. Therefore, it is necessary for agricultural operations to be carried out automatically. For this reason, the application of robotics in agricultural environments, especially in the greenhouse, is increasing. The first step in automatic farming is autonomous navigation. For autonomous navigation, a robot must be the ability to understand its environment and recognize its position. In other words, a robot must be able to create a map of an unknown environment, locate itself on this map and finally plane for the path. This problem is solvable by Simultaneous Localization and Mapping (SLAM). The SLAM problem is a recursive estimation process. In the other words, when a robot moves in an unknown environment, mapping and localization errors increase incrementally. To reduce these two errors, a recursive estimation process is used to solve the SLAM problem. Materials and Methods In this research, two webcams, made by Microsoft Corporation with the resolution of 960×544, are connected to the computer via USB2 in order to produce a stereo parallel camera. For this study, we used a greenhouse that was located the Arak, Iran. Before taking stereo images, a camera path was designed in the greenhouse. This path may be either straight or curved. The designed path was implemented in the greenhouse. The entire path traversed by a stereo camera was 32.7 m and 150 stereo images were taken. Graph-SLAM algorithm was used for Simultaneous Localization and Mapping in the greenhouse. Using the ROS framework, the SLAM algorithm was designed with nodes and network for connecting the nodes. Results and Discussion For evaluation, the stereo camera locations, every step was measured manually and compared with the stereo camera locations that were estimated in the graph-SLAM algorithm. The position error was calculated through the Euclidean distance (DE) between the estimated points and the actual points. The results of this study showed that, the proposed algorithm has an average of error 0.0679412, standard deviation of 0.0456431 and root mean square error (RMSE) of 0.0075569 for camera localization. In this research, only a stereo camera was used to prepare a map of the environment, but other researches have used multiple sensor combinations. Another advantage of this research related to others was created a 3D map (point cloud) of the environment and loop closer detection. In the 3D map, in addition to determining the exact location of the plant, the height of the plant can also be estimated. Plant height estimate is important in some agricultural operations such as spot spray, harvesting and pruning. Conclusions Due to the risk of agricultural activities, the use of robotics is essential. Autonomous navigation is one of the branches of the robotics. For autonomous navigation, a map of environment and localization in this map is need. The purpose of our research was to provide simultaneous localization and mapping (SLAM) in agricultural environments. ROS is a strong framework for solving the SLAM problem. So that, this problem can be solved by combining different nodes in ROS. The method depended only on the information from the stereo camera because stereo camera provided exact distance information. We believe that this study will contribute to the field of autonomous robot applications in agriculture. In future studies, it is possible to use an actual robot in the greenhouse with various sensors for SLAM and path planning.Z KhosrobeygiSh RafieeS. S MohtasebiA NasiriFerdowsi University of Mashhadarticlerosgreenhousesimultaneous localization and mapping (slam)stereo visionAgriculture (General)S1-972Engineering (General). Civil engineering (General)TA1-2040ENFAJournal of Agricultural Machinery, Vol 10, Iss 2, Pp 141-153 (2020)