Effects of guideline-based training on the quality of formal ontologies: a randomized controlled trial.
<h4>Background</h4>The importance of ontologies in the biomedical domain is generally recognized. However, their quality is often too poor for large-scale use in critical applications, at least partially due to insufficient training of ontology developers.<h4>Objective</h4>To...
Guardado en:
Autores principales: | , , , , , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
Public Library of Science (PLoS)
2013
|
Materias: | |
Acceso en línea: | https://doaj.org/article/d1c878ea82394b009cda77c5a8179ae1 |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:d1c878ea82394b009cda77c5a8179ae1 |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:d1c878ea82394b009cda77c5a8179ae12021-11-18T07:46:44ZEffects of guideline-based training on the quality of formal ontologies: a randomized controlled trial.1932-620310.1371/journal.pone.0061425https://doaj.org/article/d1c878ea82394b009cda77c5a8179ae12013-01-01T00:00:00Zhttps://www.ncbi.nlm.nih.gov/pmc/articles/pmid/23667440/pdf/?tool=EBIhttps://doaj.org/toc/1932-6203<h4>Background</h4>The importance of ontologies in the biomedical domain is generally recognized. However, their quality is often too poor for large-scale use in critical applications, at least partially due to insufficient training of ontology developers.<h4>Objective</h4>To show the efficacy of guideline-based ontology development training on the performance of ontology developers. The hypothesis was that students who received training on top-level ontologies and design patterns perform better than those who only received training in the basic principles of formal ontology engineering.<h4>Methods</h4>A curriculum was implemented based on a guideline for ontology design. A randomized controlled trial on the efficacy of this curriculum was performed with 24 students from bioinformatics and related fields. After joint training on the fundamentals of ontology development the students were randomly allocated to two groups. During the intervention, each group received training on different topics in ontology development. In the assessment phase, all students were asked to solve modeling problems on topics taught differentially in the intervention phase. Primary outcome was the similarity of the students' ontology artefacts compared with gold standard ontologies developed by the authors before the experiment; secondary outcome was the intra-group similarity of group members' ontologies.<h4>Results</h4>The experiment showed no significant effect of the guideline-based training on the performance of ontology developers (a) the ontologies developed after specific training were only slightly but not significantly closer to the gold standard ontologies than the ontologies developed without prior specific training; (b) although significant differences for certain ontologies were detected, the intra-group similarity was not consistently influenced in one direction by the differential training.<h4>Conclusion</h4>Methodologically limited, this study cannot be interpreted as a general failure of a guideline-based approach to ontology development. Further research is needed to increase insight into whether specific development guidelines and practices in ontology design are effective.Martin BoekerLudger JansenNiels GreweJohannes RöhlDaniel SchoberDjamila Seddig-RaufieStefan SchulzPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 8, Iss 5, p e61425 (2013) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Medicine R Science Q |
spellingShingle |
Medicine R Science Q Martin Boeker Ludger Jansen Niels Grewe Johannes Röhl Daniel Schober Djamila Seddig-Raufie Stefan Schulz Effects of guideline-based training on the quality of formal ontologies: a randomized controlled trial. |
description |
<h4>Background</h4>The importance of ontologies in the biomedical domain is generally recognized. However, their quality is often too poor for large-scale use in critical applications, at least partially due to insufficient training of ontology developers.<h4>Objective</h4>To show the efficacy of guideline-based ontology development training on the performance of ontology developers. The hypothesis was that students who received training on top-level ontologies and design patterns perform better than those who only received training in the basic principles of formal ontology engineering.<h4>Methods</h4>A curriculum was implemented based on a guideline for ontology design. A randomized controlled trial on the efficacy of this curriculum was performed with 24 students from bioinformatics and related fields. After joint training on the fundamentals of ontology development the students were randomly allocated to two groups. During the intervention, each group received training on different topics in ontology development. In the assessment phase, all students were asked to solve modeling problems on topics taught differentially in the intervention phase. Primary outcome was the similarity of the students' ontology artefacts compared with gold standard ontologies developed by the authors before the experiment; secondary outcome was the intra-group similarity of group members' ontologies.<h4>Results</h4>The experiment showed no significant effect of the guideline-based training on the performance of ontology developers (a) the ontologies developed after specific training were only slightly but not significantly closer to the gold standard ontologies than the ontologies developed without prior specific training; (b) although significant differences for certain ontologies were detected, the intra-group similarity was not consistently influenced in one direction by the differential training.<h4>Conclusion</h4>Methodologically limited, this study cannot be interpreted as a general failure of a guideline-based approach to ontology development. Further research is needed to increase insight into whether specific development guidelines and practices in ontology design are effective. |
format |
article |
author |
Martin Boeker Ludger Jansen Niels Grewe Johannes Röhl Daniel Schober Djamila Seddig-Raufie Stefan Schulz |
author_facet |
Martin Boeker Ludger Jansen Niels Grewe Johannes Röhl Daniel Schober Djamila Seddig-Raufie Stefan Schulz |
author_sort |
Martin Boeker |
title |
Effects of guideline-based training on the quality of formal ontologies: a randomized controlled trial. |
title_short |
Effects of guideline-based training on the quality of formal ontologies: a randomized controlled trial. |
title_full |
Effects of guideline-based training on the quality of formal ontologies: a randomized controlled trial. |
title_fullStr |
Effects of guideline-based training on the quality of formal ontologies: a randomized controlled trial. |
title_full_unstemmed |
Effects of guideline-based training on the quality of formal ontologies: a randomized controlled trial. |
title_sort |
effects of guideline-based training on the quality of formal ontologies: a randomized controlled trial. |
publisher |
Public Library of Science (PLoS) |
publishDate |
2013 |
url |
https://doaj.org/article/d1c878ea82394b009cda77c5a8179ae1 |
work_keys_str_mv |
AT martinboeker effectsofguidelinebasedtrainingonthequalityofformalontologiesarandomizedcontrolledtrial AT ludgerjansen effectsofguidelinebasedtrainingonthequalityofformalontologiesarandomizedcontrolledtrial AT nielsgrewe effectsofguidelinebasedtrainingonthequalityofformalontologiesarandomizedcontrolledtrial AT johannesrohl effectsofguidelinebasedtrainingonthequalityofformalontologiesarandomizedcontrolledtrial AT danielschober effectsofguidelinebasedtrainingonthequalityofformalontologiesarandomizedcontrolledtrial AT djamilaseddigraufie effectsofguidelinebasedtrainingonthequalityofformalontologiesarandomizedcontrolledtrial AT stefanschulz effectsofguidelinebasedtrainingonthequalityofformalontologiesarandomizedcontrolledtrial |
_version_ |
1718423003224604672 |