About the effects of combining Latent Semantic Analysis with natural language processing techniques for free-text assessment
This article presents the combination of Latent Semantic Analysis (LSA) with other natural language processing techniques (stemming, removal of closed-class words and word sense disambiguation) to improve the automatic assessment of students' free-text answers. The combinational schema has been...
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Lenguaje: | English |
| Publicado: |
Pontificia Universidad Católica de Valparaíso. Instituto de Literatura y Ciencias del Lenguaje
2005
|
| Materias: | |
| Acceso en línea: | http://www.scielo.cl/scielo.php?script=sci_arttext&pid=S0718-09342005000300004 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| id |
oai:scielo:S0718-09342005000300004 |
|---|---|
| record_format |
dspace |
| spelling |
oai:scielo:S0718-093420050003000042005-12-23About the effects of combining Latent Semantic Analysis with natural language processing techniques for free-text assessmentPérez,DianaAlfonseca,EnriqueRodríguez,PilarGliozzo,AlfioStrapparava,CarloMagnini,Bernardo LSA free-text assessment computer assisted assessment e-learning This article presents the combination of Latent Semantic Analysis (LSA) with other natural language processing techniques (stemming, removal of closed-class words and word sense disambiguation) to improve the automatic assessment of students' free-text answers. The combinational schema has been tested in the experimental framework provided by the free-text Computer Assisted Assessment (CAA) system called Atenea (Alfonseca & Pérez, 2004). This system is able to ask randomly or according to the students' profile an open-ended question to the student and then, assign a score to it. The results prove that for all datasets, when the NLP techniques are combined with LSA, the Pearson correlation between the scores given by Atenea and the scores given by the teachers for the same dataset of questions improves. We believe that this is due to the complementarity between LSA, which works more at a shallow semantic level, and the rest of the NLP techniques used in Atenea, which are more focused on the lexical and syntactical levels.info:eu-repo/semantics/openAccessPontificia Universidad Católica de Valparaíso. Instituto de Literatura y Ciencias del LenguajeRevista signos v.38 n.59 20052005-01-01text/htmlhttp://www.scielo.cl/scielo.php?script=sci_arttext&pid=S0718-09342005000300004en10.4067/S0718-09342005000300004 |
| institution |
Scielo Chile |
| collection |
Scielo Chile |
| language |
English |
| topic |
LSA free-text assessment computer assisted assessment e-learning |
| spellingShingle |
LSA free-text assessment computer assisted assessment e-learning Pérez,Diana Alfonseca,Enrique Rodríguez,Pilar Gliozzo,Alfio Strapparava,Carlo Magnini,Bernardo About the effects of combining Latent Semantic Analysis with natural language processing techniques for free-text assessment |
| description |
This article presents the combination of Latent Semantic Analysis (LSA) with other natural language processing techniques (stemming, removal of closed-class words and word sense disambiguation) to improve the automatic assessment of students' free-text answers. The combinational schema has been tested in the experimental framework provided by the free-text Computer Assisted Assessment (CAA) system called Atenea (Alfonseca & Pérez, 2004). This system is able to ask randomly or according to the students' profile an open-ended question to the student and then, assign a score to it. The results prove that for all datasets, when the NLP techniques are combined with LSA, the Pearson correlation between the scores given by Atenea and the scores given by the teachers for the same dataset of questions improves. We believe that this is due to the complementarity between LSA, which works more at a shallow semantic level, and the rest of the NLP techniques used in Atenea, which are more focused on the lexical and syntactical levels. |
| author |
Pérez,Diana Alfonseca,Enrique Rodríguez,Pilar Gliozzo,Alfio Strapparava,Carlo Magnini,Bernardo |
| author_facet |
Pérez,Diana Alfonseca,Enrique Rodríguez,Pilar Gliozzo,Alfio Strapparava,Carlo Magnini,Bernardo |
| author_sort |
Pérez,Diana |
| title |
About the effects of combining Latent Semantic Analysis with natural language processing techniques for free-text assessment |
| title_short |
About the effects of combining Latent Semantic Analysis with natural language processing techniques for free-text assessment |
| title_full |
About the effects of combining Latent Semantic Analysis with natural language processing techniques for free-text assessment |
| title_fullStr |
About the effects of combining Latent Semantic Analysis with natural language processing techniques for free-text assessment |
| title_full_unstemmed |
About the effects of combining Latent Semantic Analysis with natural language processing techniques for free-text assessment |
| title_sort |
about the effects of combining latent semantic analysis with natural language processing techniques for free-text assessment |
| publisher |
Pontificia Universidad Católica de Valparaíso. Instituto de Literatura y Ciencias del Lenguaje |
| publishDate |
2005 |
| url |
http://www.scielo.cl/scielo.php?script=sci_arttext&pid=S0718-09342005000300004 |
| work_keys_str_mv |
AT perezdiana abouttheeffectsofcombininglatentsemanticanalysiswithnaturallanguageprocessingtechniquesforfreetextassessment AT alfonsecaenrique abouttheeffectsofcombininglatentsemanticanalysiswithnaturallanguageprocessingtechniquesforfreetextassessment AT rodriguezpilar abouttheeffectsofcombininglatentsemanticanalysiswithnaturallanguageprocessingtechniquesforfreetextassessment AT gliozzoalfio abouttheeffectsofcombininglatentsemanticanalysiswithnaturallanguageprocessingtechniquesforfreetextassessment AT strapparavacarlo abouttheeffectsofcombininglatentsemanticanalysiswithnaturallanguageprocessingtechniquesforfreetextassessment AT magninibernardo abouttheeffectsofcombininglatentsemanticanalysiswithnaturallanguageprocessingtechniquesforfreetextassessment |
| _version_ |
1714201809974722560 |