Human-Centered Explainable Artificial Intelligence for Marine Autonomous Surface Vehicles

Explainable Artificial Intelligence (XAI) for Autonomous Surface Vehicles (ASVs) addresses developers’ needs for model interpretation, understandability, and trust. As ASVs approach wide-scale deployment, these needs are expanded to include end user interactions in real-world contexts. Despite recen...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Erik Veitch, Ole Andreas Alsos
Formato: article
Lenguaje:EN
Publicado: MDPI AG 2021
Materias:
Acceso en línea:https://doaj.org/article/a9ee8d00e35445d38f1f3ed8dc176a57
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:a9ee8d00e35445d38f1f3ed8dc176a57
record_format dspace
spelling oai:doaj.org-article:a9ee8d00e35445d38f1f3ed8dc176a572021-11-25T18:04:32ZHuman-Centered Explainable Artificial Intelligence for Marine Autonomous Surface Vehicles10.3390/jmse91112272077-1312https://doaj.org/article/a9ee8d00e35445d38f1f3ed8dc176a572021-11-01T00:00:00Zhttps://www.mdpi.com/2077-1312/9/11/1227https://doaj.org/toc/2077-1312Explainable Artificial Intelligence (XAI) for Autonomous Surface Vehicles (ASVs) addresses developers’ needs for model interpretation, understandability, and trust. As ASVs approach wide-scale deployment, these needs are expanded to include end user interactions in real-world contexts. Despite recent successes of technology-centered XAI for enhancing the explainability of AI techniques to expert users, these approaches do not necessarily carry over to non-expert end users. Passengers, other vessels, and remote operators will have XAI needs distinct from those of expert users targeted in a traditional technology-centered approach. We formulate a concept called ‘human-centered XAI’ to address emerging end user interaction needs for ASVs. To structure the concept, we adopt a model-based reasoning method for concept formation consisting of three processes: analogy, visualization, and mental simulation, drawing from examples of recent ASV research at the Norwegian University of Science and Technology (NTNU). The examples show how current research activities point to novel ways of addressing XAI needs for distinct end user interactions and underpin the human-centered XAI approach. Findings show how representations of (1) usability, (2) trust, and (3) safety make up the main processes in human-centered XAI. The contribution is the formation of human-centered XAI to help advance the research community’s efforts to expand the agenda of interpretability, understandability, and trust to include end user ASV interactions.Erik VeitchOle Andreas AlsosMDPI AGarticlehuman-AI interactionhuman-centered designautonomous surface vehiclesshore control centerexplainable AIautomation transparencyNaval architecture. Shipbuilding. Marine engineeringVM1-989OceanographyGC1-1581ENJournal of Marine Science and Engineering, Vol 9, Iss 1227, p 1227 (2021)
institution DOAJ
collection DOAJ
language EN
topic human-AI interaction
human-centered design
autonomous surface vehicles
shore control center
explainable AI
automation transparency
Naval architecture. Shipbuilding. Marine engineering
VM1-989
Oceanography
GC1-1581
spellingShingle human-AI interaction
human-centered design
autonomous surface vehicles
shore control center
explainable AI
automation transparency
Naval architecture. Shipbuilding. Marine engineering
VM1-989
Oceanography
GC1-1581
Erik Veitch
Ole Andreas Alsos
Human-Centered Explainable Artificial Intelligence for Marine Autonomous Surface Vehicles
description Explainable Artificial Intelligence (XAI) for Autonomous Surface Vehicles (ASVs) addresses developers’ needs for model interpretation, understandability, and trust. As ASVs approach wide-scale deployment, these needs are expanded to include end user interactions in real-world contexts. Despite recent successes of technology-centered XAI for enhancing the explainability of AI techniques to expert users, these approaches do not necessarily carry over to non-expert end users. Passengers, other vessels, and remote operators will have XAI needs distinct from those of expert users targeted in a traditional technology-centered approach. We formulate a concept called ‘human-centered XAI’ to address emerging end user interaction needs for ASVs. To structure the concept, we adopt a model-based reasoning method for concept formation consisting of three processes: analogy, visualization, and mental simulation, drawing from examples of recent ASV research at the Norwegian University of Science and Technology (NTNU). The examples show how current research activities point to novel ways of addressing XAI needs for distinct end user interactions and underpin the human-centered XAI approach. Findings show how representations of (1) usability, (2) trust, and (3) safety make up the main processes in human-centered XAI. The contribution is the formation of human-centered XAI to help advance the research community’s efforts to expand the agenda of interpretability, understandability, and trust to include end user ASV interactions.
format article
author Erik Veitch
Ole Andreas Alsos
author_facet Erik Veitch
Ole Andreas Alsos
author_sort Erik Veitch
title Human-Centered Explainable Artificial Intelligence for Marine Autonomous Surface Vehicles
title_short Human-Centered Explainable Artificial Intelligence for Marine Autonomous Surface Vehicles
title_full Human-Centered Explainable Artificial Intelligence for Marine Autonomous Surface Vehicles
title_fullStr Human-Centered Explainable Artificial Intelligence for Marine Autonomous Surface Vehicles
title_full_unstemmed Human-Centered Explainable Artificial Intelligence for Marine Autonomous Surface Vehicles
title_sort human-centered explainable artificial intelligence for marine autonomous surface vehicles
publisher MDPI AG
publishDate 2021
url https://doaj.org/article/a9ee8d00e35445d38f1f3ed8dc176a57
work_keys_str_mv AT erikveitch humancenteredexplainableartificialintelligenceformarineautonomoussurfacevehicles
AT oleandreasalsos humancenteredexplainableartificialintelligenceformarineautonomoussurfacevehicles
_version_ 1718411699096125440