Development, Validation, and Application of the Microbiology Concept Inventory
If we are to teach effectively, tools are needed to measure student learning. A widely used method for quickly measuring student understanding of core concepts in a discipline is the concept inventory (CI). Using the American Society for Microbiology Curriculum Guidelines (ASMCG) for microbiology, f...
Guardado en:
Autores principales: | , , , , , , , , , , , , , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
American Society for Microbiology
2017
|
Materias: | |
Acceso en línea: | https://doaj.org/article/a1a4f59421f54c85ba3e41c48ef948d4 |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:a1a4f59421f54c85ba3e41c48ef948d4 |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:a1a4f59421f54c85ba3e41c48ef948d42021-11-15T15:04:07ZDevelopment, Validation, and Application of the Microbiology Concept Inventory10.1128/jmbe.v18i3.13201935-78851935-7877https://doaj.org/article/a1a4f59421f54c85ba3e41c48ef948d42017-12-01T00:00:00Zhttps://journals.asm.org/doi/10.1128/jmbe.v18i3.1320https://doaj.org/toc/1935-7877https://doaj.org/toc/1935-7885If we are to teach effectively, tools are needed to measure student learning. A widely used method for quickly measuring student understanding of core concepts in a discipline is the concept inventory (CI). Using the American Society for Microbiology Curriculum Guidelines (ASMCG) for microbiology, faculty from 11 academic institutions created and validated a new microbiology concept inventory (MCI). The MCI was developed in three phases. In phase one, learning outcomes and fundamental statements from the ASMCG were used to create T/F questions coupled with open responses. In phase two, the 743 responses to MCI 1.0 were examined to find the most common misconceptions, which were used to create distractors for multiple-choice questions. MCI 2.0 was then administered to 1,043 students. The responses of these students were used to create MCI 3.0, a 23-question CI that measures students’ understanding of all 27 fundamental statements. MCI 3.0 was found to be reliable, with a Cronbach’s alpha score of 0.705 and Ferguson’s delta of 0.97. Test item analysis demonstrated good validity and discriminatory power as judged by item difficulty, item discrimination, and point-biserial correlation coefficient. Comparison of pre- and posttest scores showed that microbiology students at 10 institutions showed an increase in understanding of concepts after instruction, except for questions probing metabolism (average normalized learning gain was 0.15). The MCI will enable quantitative analysis of student learning gains in understanding microbiology, help to identify misconceptions, and point toward areas where efforts should be made to develop teaching approaches to overcome them.Timothy D. PaustianAmy G. BriggsRobert E. BrennanNancy BouryJohn BuchnerShannon HarrisRachel E. A. HorakLee E. HughesD. Sue Katz-AmburnMaria J. MassimelliAnn H. McDonaldTodd P. PrimmAnn C. SmithAnn M. StevensSunny B. YungAmerican Society for MicrobiologyarticleSpecial aspects of educationLC8-6691Biology (General)QH301-705.5ENJournal of Microbiology & Biology Education, Vol 18, Iss 3 (2017) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Special aspects of education LC8-6691 Biology (General) QH301-705.5 |
spellingShingle |
Special aspects of education LC8-6691 Biology (General) QH301-705.5 Timothy D. Paustian Amy G. Briggs Robert E. Brennan Nancy Boury John Buchner Shannon Harris Rachel E. A. Horak Lee E. Hughes D. Sue Katz-Amburn Maria J. Massimelli Ann H. McDonald Todd P. Primm Ann C. Smith Ann M. Stevens Sunny B. Yung Development, Validation, and Application of the Microbiology Concept Inventory |
description |
If we are to teach effectively, tools are needed to measure student learning. A widely used method for quickly measuring student understanding of core concepts in a discipline is the concept inventory (CI). Using the American Society for Microbiology Curriculum Guidelines (ASMCG) for microbiology, faculty from 11 academic institutions created and validated a new microbiology concept inventory (MCI). The MCI was developed in three phases. In phase one, learning outcomes and fundamental statements from the ASMCG were used to create T/F questions coupled with open responses. In phase two, the 743 responses to MCI 1.0 were examined to find the most common misconceptions, which were used to create distractors for multiple-choice questions. MCI 2.0 was then administered to 1,043 students. The responses of these students were used to create MCI 3.0, a 23-question CI that measures students’ understanding of all 27 fundamental statements. MCI 3.0 was found to be reliable, with a Cronbach’s alpha score of 0.705 and Ferguson’s delta of 0.97. Test item analysis demonstrated good validity and discriminatory power as judged by item difficulty, item discrimination, and point-biserial correlation coefficient. Comparison of pre- and posttest scores showed that microbiology students at 10 institutions showed an increase in understanding of concepts after instruction, except for questions probing metabolism (average normalized learning gain was 0.15). The MCI will enable quantitative analysis of student learning gains in understanding microbiology, help to identify misconceptions, and point toward areas where efforts should be made to develop teaching approaches to overcome them. |
format |
article |
author |
Timothy D. Paustian Amy G. Briggs Robert E. Brennan Nancy Boury John Buchner Shannon Harris Rachel E. A. Horak Lee E. Hughes D. Sue Katz-Amburn Maria J. Massimelli Ann H. McDonald Todd P. Primm Ann C. Smith Ann M. Stevens Sunny B. Yung |
author_facet |
Timothy D. Paustian Amy G. Briggs Robert E. Brennan Nancy Boury John Buchner Shannon Harris Rachel E. A. Horak Lee E. Hughes D. Sue Katz-Amburn Maria J. Massimelli Ann H. McDonald Todd P. Primm Ann C. Smith Ann M. Stevens Sunny B. Yung |
author_sort |
Timothy D. Paustian |
title |
Development, Validation, and Application of the Microbiology Concept Inventory |
title_short |
Development, Validation, and Application of the Microbiology Concept Inventory |
title_full |
Development, Validation, and Application of the Microbiology Concept Inventory |
title_fullStr |
Development, Validation, and Application of the Microbiology Concept Inventory |
title_full_unstemmed |
Development, Validation, and Application of the Microbiology Concept Inventory |
title_sort |
development, validation, and application of the microbiology concept inventory |
publisher |
American Society for Microbiology |
publishDate |
2017 |
url |
https://doaj.org/article/a1a4f59421f54c85ba3e41c48ef948d4 |
work_keys_str_mv |
AT timothydpaustian developmentvalidationandapplicationofthemicrobiologyconceptinventory AT amygbriggs developmentvalidationandapplicationofthemicrobiologyconceptinventory AT robertebrennan developmentvalidationandapplicationofthemicrobiologyconceptinventory AT nancyboury developmentvalidationandapplicationofthemicrobiologyconceptinventory AT johnbuchner developmentvalidationandapplicationofthemicrobiologyconceptinventory AT shannonharris developmentvalidationandapplicationofthemicrobiologyconceptinventory AT racheleahorak developmentvalidationandapplicationofthemicrobiologyconceptinventory AT leeehughes developmentvalidationandapplicationofthemicrobiologyconceptinventory AT dsuekatzamburn developmentvalidationandapplicationofthemicrobiologyconceptinventory AT mariajmassimelli developmentvalidationandapplicationofthemicrobiologyconceptinventory AT annhmcdonald developmentvalidationandapplicationofthemicrobiologyconceptinventory AT toddpprimm developmentvalidationandapplicationofthemicrobiologyconceptinventory AT anncsmith developmentvalidationandapplicationofthemicrobiologyconceptinventory AT annmstevens developmentvalidationandapplicationofthemicrobiologyconceptinventory AT sunnybyung developmentvalidationandapplicationofthemicrobiologyconceptinventory |
_version_ |
1718428264824832000 |