Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit

The successful development of a system realizing color sonification would enable auditory representation of the visual environment. The primary beneficiary of such a system would be people that cannot directly access visual information—the visually impaired community. Despite the plethora of sensory...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Dominik Osiński, Marta Łukowska, Dag Roar Hjelme, Michał Wierzchoń
Formato:	article
Lenguaje:	EN
Publicado:	MDPI AG 2021
Materias:	Colorophone sensory substitution color sonification multimodal perception wearable device assistive device Chemical technology TP1-1185
Acceso en línea:	https://doaj.org/article/1b3f8a322fcf4bfab0cb85a73d1eec21
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:1b3f8a322fcf4bfab0cb85a73d1eec21
record_format	dspace
spelling	oai:doaj.org-article:1b3f8a322fcf4bfab0cb85a73d1eec212021-11-11T19:17:38ZColorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit10.3390/s212173511424-8220https://doaj.org/article/1b3f8a322fcf4bfab0cb85a73d1eec212021-11-01T00:00:00Zhttps://www.mdpi.com/1424-8220/21/21/7351https://doaj.org/toc/1424-8220The successful development of a system realizing color sonification would enable auditory representation of the visual environment. The primary beneficiary of such a system would be people that cannot directly access visual information—the visually impaired community. Despite the plethora of sensory substitution devices, developing systems that provide intuitive color sonification remains a challenge. This paper presents design considerations, development, and the usability audit of a sensory substitution device that converts spatial color information into soundscapes. The implemented wearable system uses a dedicated color space and continuously generates natural, spatialized sounds based on the information acquired from a camera. We developed two head-mounted prototype devices and two graphical user interface (GUI) versions. The first GUI is dedicated to researchers, and the second has been designed to be easily accessible for visually impaired persons. Finally, we ran fundamental usability tests to evaluate the new spatial color sonification algorithm and to compare the two prototypes. Furthermore, we propose recommendations for the development of the next iteration of the system.Dominik OsińskiMarta ŁukowskaDag Roar HjelmeMichał WierzchońMDPI AGarticleColorophonesensory substitutioncolor sonificationmultimodal perceptionwearable deviceassistive deviceChemical technologyTP1-1185ENSensors, Vol 21, Iss 7351, p 7351 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	Colorophone sensory substitution color sonification multimodal perception wearable device assistive device Chemical technology TP1-1185
spellingShingle	Colorophone sensory substitution color sonification multimodal perception wearable device assistive device Chemical technology TP1-1185 Dominik Osiński Marta Łukowska Dag Roar Hjelme Michał Wierzchoń Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit
description	The successful development of a system realizing color sonification would enable auditory representation of the visual environment. The primary beneficiary of such a system would be people that cannot directly access visual information—the visually impaired community. Despite the plethora of sensory substitution devices, developing systems that provide intuitive color sonification remains a challenge. This paper presents design considerations, development, and the usability audit of a sensory substitution device that converts spatial color information into soundscapes. The implemented wearable system uses a dedicated color space and continuously generates natural, spatialized sounds based on the information acquired from a camera. We developed two head-mounted prototype devices and two graphical user interface (GUI) versions. The first GUI is dedicated to researchers, and the second has been designed to be easily accessible for visually impaired persons. Finally, we ran fundamental usability tests to evaluate the new spatial color sonification algorithm and to compare the two prototypes. Furthermore, we propose recommendations for the development of the next iteration of the system.
format	article
author	Dominik Osiński Marta Łukowska Dag Roar Hjelme Michał Wierzchoń
author_facet	Dominik Osiński Marta Łukowska Dag Roar Hjelme Michał Wierzchoń
author_sort	Dominik Osiński
title	Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit
title_short	Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit
title_full	Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit
title_fullStr	Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit
title_full_unstemmed	Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit
title_sort	colorophone 2.0: a wearable color sonification device generating live stereo-soundscapes—design, implementation, and usability audit
publisher	MDPI AG
publishDate	2021
url	https://doaj.org/article/1b3f8a322fcf4bfab0cb85a73d1eec21
work_keys_str_mv	AT dominikosinski colorophone20awearablecolorsonificationdevicegeneratinglivestereosoundscapesdesignimplementationandusabilityaudit AT martałukowska colorophone20awearablecolorsonificationdevicegeneratinglivestereosoundscapesdesignimplementationandusabilityaudit AT dagroarhjelme colorophone20awearablecolorsonificationdevicegeneratinglivestereosoundscapesdesignimplementationandusabilityaudit AT michałwierzchon colorophone20awearablecolorsonificationdevicegeneratinglivestereosoundscapesdesignimplementationandusabilityaudit
_version_	1718431571086671872

Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit

Ejemplares similares