Evaluating the validity and applicability of automated essay scoring in two massive open online courses

The use of massive open online courses (MOOCs) to expand students’ access to higher education has raised questions regarding the extent to which this course model can provide and assess authentic, higher level student learning. In response to this need, MOOC platforms have begun utilizing automated...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Erin Dawna Reilly, Rose Eleanore Stafford, Kyle Marie Williams, Stephanie Brooks Corliss
Formato: article
Lenguaje:EN
Publicado: Athabasca University Press 2014
Materias:
Acceso en línea:https://doaj.org/article/0f6eb45b48a24187871450b031ba6f11
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
Descripción
Sumario:The use of massive open online courses (MOOCs) to expand students’ access to higher education has raised questions regarding the extent to which this course model can provide and assess authentic, higher level student learning. In response to this need, MOOC platforms have begun utilizing automated essay scoring (AES) systems that allow students to engage in critical writing and free-response activities. However, there is a lack of research investigating the validity of such systems in MOOCs. This research examined the effectiveness of an AES tool to score writing assignments in two MOOCs. Results indicated that some significant differences existed between Instructor grading, AES-Holistic scores, and AES-Rubric Total scores within two MOOC courses. However, use of the AES system may still be useful given instructors’ assessment needs and intent. Findings from this research have implications for instructional technology administrators, educational designers, and instructors implementing AES learning activities in MOOC courses.