Lessons Learned from EVALITA 2020 and Thirteen Years of Evaluation of Italian Language Technology

This paper provides a summary of the 7th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian (EVALITA2020) which was held online on December 17th, due to the 2020 COVID-19 pandemic. The 2020 edition of Evalita included 14 different tasks belonging to five research areas,...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Lucia C. Passaro, Maria Di Maro, Valerio Basile, Danilo Croce
Formato:	article
Lenguaje:	EN
Publicado:	Accademia University Press 2020
Materias:	Social Sciences H Computational linguistics. Natural language processing P98-98.5
Acceso en línea:	https://doaj.org/article/de9b512d04b74a4b875c01e9e22d7281
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:de9b512d04b74a4b875c01e9e22d7281
record_format	dspace
spelling	oai:doaj.org-article:de9b512d04b74a4b875c01e9e22d72812021-12-02T09:52:20ZLessons Learned from EVALITA 2020 and Thirteen Years of Evaluation of Italian Language Technology2499-455310.4000/ijcol.740https://doaj.org/article/de9b512d04b74a4b875c01e9e22d72812020-12-01T00:00:00Zhttp://journals.openedition.org/ijcol/740https://doaj.org/toc/2499-4553This paper provides a summary of the 7th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian (EVALITA2020) which was held online on December 17th, due to the 2020 COVID-19 pandemic. The 2020 edition of Evalita included 14 different tasks belonging to five research areas, namely: (i) Affect, Hate, and Stance, (ii) Creativity and Style, (iii) New Challenges in Long-standing Tasks, (iv) Semantics and Multimodality, (v) Time and Diachrony. This paper provides a description of the tasks and the key findings from the analysis of participant outcomes. Moreover, it provides a detailed analysis of the participants and task organizers which demonstrates the growing interest with respect to this campaign. Finally, a detailed analysis of the evaluation of tasks across the past seven editions is provided; this allows to assess how the research carried out by the Italian community dealing with Computational Linguistics has evolved in terms of popular tasks and paradigms during the last 13 years.Lucia C. PassaroMaria Di MaroValerio BasileDanilo CroceAccademia University PressarticleSocial SciencesHComputational linguistics. Natural language processingP98-98.5ENIJCoL, Vol 6, Iss 2, Pp 79-102 (2020)
institution	DOAJ
collection	DOAJ
language	EN
topic	Social Sciences H Computational linguistics. Natural language processing P98-98.5
spellingShingle	Social Sciences H Computational linguistics. Natural language processing P98-98.5 Lucia C. Passaro Maria Di Maro Valerio Basile Danilo Croce Lessons Learned from EVALITA 2020 and Thirteen Years of Evaluation of Italian Language Technology
description	This paper provides a summary of the 7th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian (EVALITA2020) which was held online on December 17th, due to the 2020 COVID-19 pandemic. The 2020 edition of Evalita included 14 different tasks belonging to five research areas, namely: (i) Affect, Hate, and Stance, (ii) Creativity and Style, (iii) New Challenges in Long-standing Tasks, (iv) Semantics and Multimodality, (v) Time and Diachrony. This paper provides a description of the tasks and the key findings from the analysis of participant outcomes. Moreover, it provides a detailed analysis of the participants and task organizers which demonstrates the growing interest with respect to this campaign. Finally, a detailed analysis of the evaluation of tasks across the past seven editions is provided; this allows to assess how the research carried out by the Italian community dealing with Computational Linguistics has evolved in terms of popular tasks and paradigms during the last 13 years.
format	article
author	Lucia C. Passaro Maria Di Maro Valerio Basile Danilo Croce
author_facet	Lucia C. Passaro Maria Di Maro Valerio Basile Danilo Croce
author_sort	Lucia C. Passaro
title	Lessons Learned from EVALITA 2020 and Thirteen Years of Evaluation of Italian Language Technology
title_short	Lessons Learned from EVALITA 2020 and Thirteen Years of Evaluation of Italian Language Technology
title_full	Lessons Learned from EVALITA 2020 and Thirteen Years of Evaluation of Italian Language Technology
title_fullStr	Lessons Learned from EVALITA 2020 and Thirteen Years of Evaluation of Italian Language Technology
title_full_unstemmed	Lessons Learned from EVALITA 2020 and Thirteen Years of Evaluation of Italian Language Technology
title_sort	lessons learned from evalita 2020 and thirteen years of evaluation of italian language technology
publisher	Accademia University Press
publishDate	2020
url	https://doaj.org/article/de9b512d04b74a4b875c01e9e22d7281
work_keys_str_mv	AT luciacpassaro lessonslearnedfromevalita2020andthirteenyearsofevaluationofitalianlanguagetechnology AT mariadimaro lessonslearnedfromevalita2020andthirteenyearsofevaluationofitalianlanguagetechnology AT valeriobasile lessonslearnedfromevalita2020andthirteenyearsofevaluationofitalianlanguagetechnology AT danilocroce lessonslearnedfromevalita2020andthirteenyearsofevaluationofitalianlanguagetechnology
_version_	1718397975848288256

Lessons Learned from EVALITA 2020 and Thirteen Years of Evaluation of Italian Language Technology

Ejemplares similares