Training birdsong recognition using virtual reality

Background: In mega-biodiverse environments, where different species are more likely to be heard than seen, species monitoring is generally performed using bioacoustics methodologies. Furthermore, since bird vocalizations are reasonable estimators of biodiversity, their monitoring is of great import...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Carlos Arce-Lopera, María José Arias, Gustavo Corrales
Formato: article
Lenguaje:EN
Publicado: KeAi Communications Co., Ltd. 2021
Materias:
Acceso en línea:https://doaj.org/article/339eaa32d9d9474094ae1dd51bd3f79d
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:339eaa32d9d9474094ae1dd51bd3f79d
record_format dspace
spelling oai:doaj.org-article:339eaa32d9d9474094ae1dd51bd3f79d2021-11-12T04:30:50ZTraining birdsong recognition using virtual reality2096-579610.1016/j.vrih.2021.09.001https://doaj.org/article/339eaa32d9d9474094ae1dd51bd3f79d2021-10-01T00:00:00Zhttp://www.sciencedirect.com/science/article/pii/S209657962100067Xhttps://doaj.org/toc/2096-5796Background: In mega-biodiverse environments, where different species are more likely to be heard than seen, species monitoring is generally performed using bioacoustics methodologies. Furthermore, since bird vocalizations are reasonable estimators of biodiversity, their monitoring is of great importance in the formulation of conservation policies. However, birdsong recognition is an arduous task that requires dedicated training in order to achieve mastery, which is costly in terms of time and money due to the lack of accessibility of relevant information in field trips or even specialized databases. Immersive technology based on virtual reality (VR) and spatial audio may improve species monitoring by enhancing information accessibility, interaction, and user engagement. Methods: This study used spatial audio, a Bluetooth controller, and a head-mounted display (HMD) to conduct an immersive training experience in VR. Participants moved inside a virtual world using a Bluetooth controller, while their task was to recognize targeted birdsongs. We measured the accuracy of recognition and user engagement according to the User Engagement Scale. Results: The experimental results revealed significantly higher engagement and accuracy for participants in the VR-based training system than in a traditional computer-based training system. All four dimensions of the user engagement scale received high ratings from the participants, suggesting that VR-based training provides a motivating and attractive environment for learning demanding tasks through appropriate design, exploiting the sensory system, and virtual reality interactivity. Conclusions: The accuracy and engagement of the VR-based training system were significantly high when tested against traditional training. Future research will focus on developing a variety of realistic ecosystems and their associated birds to increase the information on newer bird species within the training system. Finally, the proposed VR-based training system must be tested with additional participants and for a longer duration to measure information recall and recognition mastery among users.Carlos Arce-LoperaMaría José AriasGustavo CorralesKeAi Communications Co., Ltd.articleHuman computer interactionVirtual environmentBirdsongAudio trainingUser engagementComputer engineering. Computer hardwareTK7885-7895ENVirtual Reality & Intelligent Hardware, Vol 3, Iss 5, Pp 397-406 (2021)
institution DOAJ
collection DOAJ
language EN
topic Human computer interaction
Virtual environment
Birdsong
Audio training
User engagement
Computer engineering. Computer hardware
TK7885-7895
spellingShingle Human computer interaction
Virtual environment
Birdsong
Audio training
User engagement
Computer engineering. Computer hardware
TK7885-7895
Carlos Arce-Lopera
María José Arias
Gustavo Corrales
Training birdsong recognition using virtual reality
description Background: In mega-biodiverse environments, where different species are more likely to be heard than seen, species monitoring is generally performed using bioacoustics methodologies. Furthermore, since bird vocalizations are reasonable estimators of biodiversity, their monitoring is of great importance in the formulation of conservation policies. However, birdsong recognition is an arduous task that requires dedicated training in order to achieve mastery, which is costly in terms of time and money due to the lack of accessibility of relevant information in field trips or even specialized databases. Immersive technology based on virtual reality (VR) and spatial audio may improve species monitoring by enhancing information accessibility, interaction, and user engagement. Methods: This study used spatial audio, a Bluetooth controller, and a head-mounted display (HMD) to conduct an immersive training experience in VR. Participants moved inside a virtual world using a Bluetooth controller, while their task was to recognize targeted birdsongs. We measured the accuracy of recognition and user engagement according to the User Engagement Scale. Results: The experimental results revealed significantly higher engagement and accuracy for participants in the VR-based training system than in a traditional computer-based training system. All four dimensions of the user engagement scale received high ratings from the participants, suggesting that VR-based training provides a motivating and attractive environment for learning demanding tasks through appropriate design, exploiting the sensory system, and virtual reality interactivity. Conclusions: The accuracy and engagement of the VR-based training system were significantly high when tested against traditional training. Future research will focus on developing a variety of realistic ecosystems and their associated birds to increase the information on newer bird species within the training system. Finally, the proposed VR-based training system must be tested with additional participants and for a longer duration to measure information recall and recognition mastery among users.
format article
author Carlos Arce-Lopera
María José Arias
Gustavo Corrales
author_facet Carlos Arce-Lopera
María José Arias
Gustavo Corrales
author_sort Carlos Arce-Lopera
title Training birdsong recognition using virtual reality
title_short Training birdsong recognition using virtual reality
title_full Training birdsong recognition using virtual reality
title_fullStr Training birdsong recognition using virtual reality
title_full_unstemmed Training birdsong recognition using virtual reality
title_sort training birdsong recognition using virtual reality
publisher KeAi Communications Co., Ltd.
publishDate 2021
url https://doaj.org/article/339eaa32d9d9474094ae1dd51bd3f79d
work_keys_str_mv AT carlosarcelopera trainingbirdsongrecognitionusingvirtualreality
AT mariajosearias trainingbirdsongrecognitionusingvirtualreality
AT gustavocorrales trainingbirdsongrecognitionusingvirtualreality
_version_ 1718431282817400832