Evaluating the Good Ontology Design Guideline (GoodOD) with the ontology quality requirements and evaluation method and metrics (OQuaRE).

<h4>Objective</h4>To (1) evaluate the GoodOD guideline for ontology development by applying the OQuaRE evaluation method and metrics to the ontology artefacts that were produced by students in a randomized controlled trial, and (2) informally compare the OQuaRE evaluation method with gol...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Astrid Duque-Ramos, Martin Boeker, Ludger Jansen, Stefan Schulz, Miguela Iniesta, Jesualdo Tomás Fernández-Breis
Formato: article
Lenguaje:EN
Publicado: Public Library of Science (PLoS) 2014
Materias:
R
Q
Acceso en línea:https://doaj.org/article/e1a3db713a284299a76e9a1ccd5a8c7c
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:e1a3db713a284299a76e9a1ccd5a8c7c
record_format dspace
spelling oai:doaj.org-article:e1a3db713a284299a76e9a1ccd5a8c7c2021-11-25T06:03:31ZEvaluating the Good Ontology Design Guideline (GoodOD) with the ontology quality requirements and evaluation method and metrics (OQuaRE).1932-620310.1371/journal.pone.0104463https://doaj.org/article/e1a3db713a284299a76e9a1ccd5a8c7c2014-01-01T00:00:00Zhttps://www.ncbi.nlm.nih.gov/pmc/articles/pmid/25148262/?tool=EBIhttps://doaj.org/toc/1932-6203<h4>Objective</h4>To (1) evaluate the GoodOD guideline for ontology development by applying the OQuaRE evaluation method and metrics to the ontology artefacts that were produced by students in a randomized controlled trial, and (2) informally compare the OQuaRE evaluation method with gold standard and competency questions based evaluation methods, respectively.<h4>Background</h4>In the last decades many methods for ontology construction and ontology evaluation have been proposed. However, none of them has become a standard and there is no empirical evidence of comparative evaluation of such methods. This paper brings together GoodOD and OQuaRE. GoodOD is a guideline for developing robust ontologies. It was previously evaluated in a randomized controlled trial employing metrics based on gold standard ontologies and competency questions as outcome parameters. OQuaRE is a method for ontology quality evaluation which adapts the SQuaRE standard for software product quality to ontologies and has been successfully used for evaluating the quality of ontologies.<h4>Methods</h4>In this paper, we evaluate the effect of training in ontology construction based on the GoodOD guideline within the OQuaRE quality evaluation framework and compare the results with those obtained for the previous studies based on the same data.<h4>Results</h4>Our results show a significant effect of the GoodOD training over developed ontologies by topics: (a) a highly significant effect was detected in three topics from the analysis of the ontologies of untrained and trained students; (b) both positive and negative training effects with respect to the gold standard were found for five topics.<h4>Conclusion</h4>The GoodOD guideline had a significant effect over the quality of the ontologies developed. Our results show that GoodOD ontologies can be effectively evaluated using OQuaRE and that OQuaRE is able to provide additional useful information about the quality of the GoodOD ontologies.Astrid Duque-RamosMartin BoekerLudger JansenStefan SchulzMiguela IniestaJesualdo Tomás Fernández-BreisPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 9, Iss 8, p e104463 (2014)
institution DOAJ
collection DOAJ
language EN
topic Medicine
R
Science
Q
spellingShingle Medicine
R
Science
Q
Astrid Duque-Ramos
Martin Boeker
Ludger Jansen
Stefan Schulz
Miguela Iniesta
Jesualdo Tomás Fernández-Breis
Evaluating the Good Ontology Design Guideline (GoodOD) with the ontology quality requirements and evaluation method and metrics (OQuaRE).
description <h4>Objective</h4>To (1) evaluate the GoodOD guideline for ontology development by applying the OQuaRE evaluation method and metrics to the ontology artefacts that were produced by students in a randomized controlled trial, and (2) informally compare the OQuaRE evaluation method with gold standard and competency questions based evaluation methods, respectively.<h4>Background</h4>In the last decades many methods for ontology construction and ontology evaluation have been proposed. However, none of them has become a standard and there is no empirical evidence of comparative evaluation of such methods. This paper brings together GoodOD and OQuaRE. GoodOD is a guideline for developing robust ontologies. It was previously evaluated in a randomized controlled trial employing metrics based on gold standard ontologies and competency questions as outcome parameters. OQuaRE is a method for ontology quality evaluation which adapts the SQuaRE standard for software product quality to ontologies and has been successfully used for evaluating the quality of ontologies.<h4>Methods</h4>In this paper, we evaluate the effect of training in ontology construction based on the GoodOD guideline within the OQuaRE quality evaluation framework and compare the results with those obtained for the previous studies based on the same data.<h4>Results</h4>Our results show a significant effect of the GoodOD training over developed ontologies by topics: (a) a highly significant effect was detected in three topics from the analysis of the ontologies of untrained and trained students; (b) both positive and negative training effects with respect to the gold standard were found for five topics.<h4>Conclusion</h4>The GoodOD guideline had a significant effect over the quality of the ontologies developed. Our results show that GoodOD ontologies can be effectively evaluated using OQuaRE and that OQuaRE is able to provide additional useful information about the quality of the GoodOD ontologies.
format article
author Astrid Duque-Ramos
Martin Boeker
Ludger Jansen
Stefan Schulz
Miguela Iniesta
Jesualdo Tomás Fernández-Breis
author_facet Astrid Duque-Ramos
Martin Boeker
Ludger Jansen
Stefan Schulz
Miguela Iniesta
Jesualdo Tomás Fernández-Breis
author_sort Astrid Duque-Ramos
title Evaluating the Good Ontology Design Guideline (GoodOD) with the ontology quality requirements and evaluation method and metrics (OQuaRE).
title_short Evaluating the Good Ontology Design Guideline (GoodOD) with the ontology quality requirements and evaluation method and metrics (OQuaRE).
title_full Evaluating the Good Ontology Design Guideline (GoodOD) with the ontology quality requirements and evaluation method and metrics (OQuaRE).
title_fullStr Evaluating the Good Ontology Design Guideline (GoodOD) with the ontology quality requirements and evaluation method and metrics (OQuaRE).
title_full_unstemmed Evaluating the Good Ontology Design Guideline (GoodOD) with the ontology quality requirements and evaluation method and metrics (OQuaRE).
title_sort evaluating the good ontology design guideline (goodod) with the ontology quality requirements and evaluation method and metrics (oquare).
publisher Public Library of Science (PLoS)
publishDate 2014
url https://doaj.org/article/e1a3db713a284299a76e9a1ccd5a8c7c
work_keys_str_mv AT astridduqueramos evaluatingthegoodontologydesignguidelinegoododwiththeontologyqualityrequirementsandevaluationmethodandmetricsoquare
AT martinboeker evaluatingthegoodontologydesignguidelinegoododwiththeontologyqualityrequirementsandevaluationmethodandmetricsoquare
AT ludgerjansen evaluatingthegoodontologydesignguidelinegoododwiththeontologyqualityrequirementsandevaluationmethodandmetricsoquare
AT stefanschulz evaluatingthegoodontologydesignguidelinegoododwiththeontologyqualityrequirementsandevaluationmethodandmetricsoquare
AT miguelainiesta evaluatingthegoodontologydesignguidelinegoododwiththeontologyqualityrequirementsandevaluationmethodandmetricsoquare
AT jesualdotomasfernandezbreis evaluatingthegoodontologydesignguidelinegoododwiththeontologyqualityrequirementsandevaluationmethodandmetricsoquare
_version_ 1718414252348276736