Development, Validation, and Application of the Microbiology Concept Inventory

If we are to teach effectively, tools are needed to measure student learning. A widely used method for quickly measuring student understanding of core concepts in a discipline is the concept inventory (CI). Using the American Society for Microbiology Curriculum Guidelines (ASMCG) for microbiology, f...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Timothy D. Paustian, Amy G. Briggs, Robert E. Brennan, Nancy Boury, John Buchner, Shannon Harris, Rachel E. A. Horak, Lee E. Hughes, D. Sue Katz-Amburn, Maria J. Massimelli, Ann H. McDonald, Todd P. Primm, Ann C. Smith, Ann M. Stevens, Sunny B. Yung
Formato: article
Lenguaje:EN
Publicado: American Society for Microbiology 2017
Materias:
Acceso en línea:https://doaj.org/article/a1a4f59421f54c85ba3e41c48ef948d4
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:a1a4f59421f54c85ba3e41c48ef948d4
record_format dspace
spelling oai:doaj.org-article:a1a4f59421f54c85ba3e41c48ef948d42021-11-15T15:04:07ZDevelopment, Validation, and Application of the Microbiology Concept Inventory10.1128/jmbe.v18i3.13201935-78851935-7877https://doaj.org/article/a1a4f59421f54c85ba3e41c48ef948d42017-12-01T00:00:00Zhttps://journals.asm.org/doi/10.1128/jmbe.v18i3.1320https://doaj.org/toc/1935-7877https://doaj.org/toc/1935-7885If we are to teach effectively, tools are needed to measure student learning. A widely used method for quickly measuring student understanding of core concepts in a discipline is the concept inventory (CI). Using the American Society for Microbiology Curriculum Guidelines (ASMCG) for microbiology, faculty from 11 academic institutions created and validated a new microbiology concept inventory (MCI). The MCI was developed in three phases. In phase one, learning outcomes and fundamental statements from the ASMCG were used to create T/F questions coupled with open responses. In phase two, the 743 responses to MCI 1.0 were examined to find the most common misconceptions, which were used to create distractors for multiple-choice questions. MCI 2.0 was then administered to 1,043 students. The responses of these students were used to create MCI 3.0, a 23-question CI that measures students’ understanding of all 27 fundamental statements. MCI 3.0 was found to be reliable, with a Cronbach’s alpha score of 0.705 and Ferguson’s delta of 0.97. Test item analysis demonstrated good validity and discriminatory power as judged by item difficulty, item discrimination, and point-biserial correlation coefficient. Comparison of pre- and posttest scores showed that microbiology students at 10 institutions showed an increase in understanding of concepts after instruction, except for questions probing metabolism (average normalized learning gain was 0.15). The MCI will enable quantitative analysis of student learning gains in understanding microbiology, help to identify misconceptions, and point toward areas where efforts should be made to develop teaching approaches to overcome them.Timothy D. PaustianAmy G. BriggsRobert E. BrennanNancy BouryJohn BuchnerShannon HarrisRachel E. A. HorakLee E. HughesD. Sue Katz-AmburnMaria J. MassimelliAnn H. McDonaldTodd P. PrimmAnn C. SmithAnn M. StevensSunny B. YungAmerican Society for MicrobiologyarticleSpecial aspects of educationLC8-6691Biology (General)QH301-705.5ENJournal of Microbiology & Biology Education, Vol 18, Iss 3 (2017)
institution DOAJ
collection DOAJ
language EN
topic Special aspects of education
LC8-6691
Biology (General)
QH301-705.5
spellingShingle Special aspects of education
LC8-6691
Biology (General)
QH301-705.5
Timothy D. Paustian
Amy G. Briggs
Robert E. Brennan
Nancy Boury
John Buchner
Shannon Harris
Rachel E. A. Horak
Lee E. Hughes
D. Sue Katz-Amburn
Maria J. Massimelli
Ann H. McDonald
Todd P. Primm
Ann C. Smith
Ann M. Stevens
Sunny B. Yung
Development, Validation, and Application of the Microbiology Concept Inventory
description If we are to teach effectively, tools are needed to measure student learning. A widely used method for quickly measuring student understanding of core concepts in a discipline is the concept inventory (CI). Using the American Society for Microbiology Curriculum Guidelines (ASMCG) for microbiology, faculty from 11 academic institutions created and validated a new microbiology concept inventory (MCI). The MCI was developed in three phases. In phase one, learning outcomes and fundamental statements from the ASMCG were used to create T/F questions coupled with open responses. In phase two, the 743 responses to MCI 1.0 were examined to find the most common misconceptions, which were used to create distractors for multiple-choice questions. MCI 2.0 was then administered to 1,043 students. The responses of these students were used to create MCI 3.0, a 23-question CI that measures students’ understanding of all 27 fundamental statements. MCI 3.0 was found to be reliable, with a Cronbach’s alpha score of 0.705 and Ferguson’s delta of 0.97. Test item analysis demonstrated good validity and discriminatory power as judged by item difficulty, item discrimination, and point-biserial correlation coefficient. Comparison of pre- and posttest scores showed that microbiology students at 10 institutions showed an increase in understanding of concepts after instruction, except for questions probing metabolism (average normalized learning gain was 0.15). The MCI will enable quantitative analysis of student learning gains in understanding microbiology, help to identify misconceptions, and point toward areas where efforts should be made to develop teaching approaches to overcome them.
format article
author Timothy D. Paustian
Amy G. Briggs
Robert E. Brennan
Nancy Boury
John Buchner
Shannon Harris
Rachel E. A. Horak
Lee E. Hughes
D. Sue Katz-Amburn
Maria J. Massimelli
Ann H. McDonald
Todd P. Primm
Ann C. Smith
Ann M. Stevens
Sunny B. Yung
author_facet Timothy D. Paustian
Amy G. Briggs
Robert E. Brennan
Nancy Boury
John Buchner
Shannon Harris
Rachel E. A. Horak
Lee E. Hughes
D. Sue Katz-Amburn
Maria J. Massimelli
Ann H. McDonald
Todd P. Primm
Ann C. Smith
Ann M. Stevens
Sunny B. Yung
author_sort Timothy D. Paustian
title Development, Validation, and Application of the Microbiology Concept Inventory
title_short Development, Validation, and Application of the Microbiology Concept Inventory
title_full Development, Validation, and Application of the Microbiology Concept Inventory
title_fullStr Development, Validation, and Application of the Microbiology Concept Inventory
title_full_unstemmed Development, Validation, and Application of the Microbiology Concept Inventory
title_sort development, validation, and application of the microbiology concept inventory
publisher American Society for Microbiology
publishDate 2017
url https://doaj.org/article/a1a4f59421f54c85ba3e41c48ef948d4
work_keys_str_mv AT timothydpaustian developmentvalidationandapplicationofthemicrobiologyconceptinventory
AT amygbriggs developmentvalidationandapplicationofthemicrobiologyconceptinventory
AT robertebrennan developmentvalidationandapplicationofthemicrobiologyconceptinventory
AT nancyboury developmentvalidationandapplicationofthemicrobiologyconceptinventory
AT johnbuchner developmentvalidationandapplicationofthemicrobiologyconceptinventory
AT shannonharris developmentvalidationandapplicationofthemicrobiologyconceptinventory
AT racheleahorak developmentvalidationandapplicationofthemicrobiologyconceptinventory
AT leeehughes developmentvalidationandapplicationofthemicrobiologyconceptinventory
AT dsuekatzamburn developmentvalidationandapplicationofthemicrobiologyconceptinventory
AT mariajmassimelli developmentvalidationandapplicationofthemicrobiologyconceptinventory
AT annhmcdonald developmentvalidationandapplicationofthemicrobiologyconceptinventory
AT toddpprimm developmentvalidationandapplicationofthemicrobiologyconceptinventory
AT anncsmith developmentvalidationandapplicationofthemicrobiologyconceptinventory
AT annmstevens developmentvalidationandapplicationofthemicrobiologyconceptinventory
AT sunnybyung developmentvalidationandapplicationofthemicrobiologyconceptinventory
_version_ 1718428264824832000