EVALITA Goes Social: Tasks, Data, and Community at the 2016 Edition

EVALITA, the evaluation campaign of Natural Language Processing and Speech Tools for the Italian language, was organised for the fifth time in 2016. Six tasks, covering both re-reruns as well as completely new tasks, and an IBM-sponsored challenge, attracted a total of 34 submissions. An innovative...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Pierpaolo Basile, Viviana Patti, Francesco Cutugno, Malvina Nissim, Rachele Sprugnoli
Formato:	article
Lenguaje:	EN
Publicado:	Accademia University Press 2017
Materias:	Social Sciences H Computational linguistics. Natural language processing P98-98.5
Acceso en línea:	https://doaj.org/article/da7879f6d6ea4c1dbfd03851546e3fd4
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:da7879f6d6ea4c1dbfd03851546e3fd4
record_format	dspace
spelling	oai:doaj.org-article:da7879f6d6ea4c1dbfd03851546e3fd42021-12-02T09:52:19ZEVALITA Goes Social: Tasks, Data, and Community at the 2016 Edition2499-455310.4000/ijcol.441https://doaj.org/article/da7879f6d6ea4c1dbfd03851546e3fd42017-06-01T00:00:00Zhttp://journals.openedition.org/ijcol/441https://doaj.org/toc/2499-4553EVALITA, the evaluation campaign of Natural Language Processing and Speech Tools for the Italian language, was organised for the fifth time in 2016. Six tasks, covering both re-reruns as well as completely new tasks, and an IBM-sponsored challenge, attracted a total of 34 submissions. An innovative aspect at this edition was the focus on social media data, especially Twitter, and the use of shared data across tasks, yielding a test set with layers of annotation concerning PoS tags, sentiment information, named entities and linking, and factuality information. Differently from the previous edition(s), many systems relied on a neural architecture, and achieved best results when used. From the experience and success of this edition, also in terms of dissemination of information and data, and in terms of collaboration between organisers of different tasks, we collected some reflections and suggestions that prospective EVALITA chairs might be willing to take into account for future editions.Pierpaolo BasileViviana PattiFrancesco CutugnoMalvina NissimRachele SprugnoliAccademia University PressarticleSocial SciencesHComputational linguistics. Natural language processingP98-98.5ENIJCoL, Vol 3, Iss 1, Pp 93-127 (2017)
institution	DOAJ
collection	DOAJ
language	EN
topic	Social Sciences H Computational linguistics. Natural language processing P98-98.5
spellingShingle	Social Sciences H Computational linguistics. Natural language processing P98-98.5 Pierpaolo Basile Viviana Patti Francesco Cutugno Malvina Nissim Rachele Sprugnoli EVALITA Goes Social: Tasks, Data, and Community at the 2016 Edition
description	EVALITA, the evaluation campaign of Natural Language Processing and Speech Tools for the Italian language, was organised for the fifth time in 2016. Six tasks, covering both re-reruns as well as completely new tasks, and an IBM-sponsored challenge, attracted a total of 34 submissions. An innovative aspect at this edition was the focus on social media data, especially Twitter, and the use of shared data across tasks, yielding a test set with layers of annotation concerning PoS tags, sentiment information, named entities and linking, and factuality information. Differently from the previous edition(s), many systems relied on a neural architecture, and achieved best results when used. From the experience and success of this edition, also in terms of dissemination of information and data, and in terms of collaboration between organisers of different tasks, we collected some reflections and suggestions that prospective EVALITA chairs might be willing to take into account for future editions.
format	article
author	Pierpaolo Basile Viviana Patti Francesco Cutugno Malvina Nissim Rachele Sprugnoli
author_facet	Pierpaolo Basile Viviana Patti Francesco Cutugno Malvina Nissim Rachele Sprugnoli
author_sort	Pierpaolo Basile
title	EVALITA Goes Social: Tasks, Data, and Community at the 2016 Edition
title_short	EVALITA Goes Social: Tasks, Data, and Community at the 2016 Edition
title_full	EVALITA Goes Social: Tasks, Data, and Community at the 2016 Edition
title_fullStr	EVALITA Goes Social: Tasks, Data, and Community at the 2016 Edition
title_full_unstemmed	EVALITA Goes Social: Tasks, Data, and Community at the 2016 Edition
title_sort	evalita goes social: tasks, data, and community at the 2016 edition
publisher	Accademia University Press
publishDate	2017
url	https://doaj.org/article/da7879f6d6ea4c1dbfd03851546e3fd4
work_keys_str_mv	AT pierpaolobasile evalitagoessocialtasksdataandcommunityatthe2016edition AT vivianapatti evalitagoessocialtasksdataandcommunityatthe2016edition AT francescocutugno evalitagoessocialtasksdataandcommunityatthe2016edition AT malvinanissim evalitagoessocialtasksdataandcommunityatthe2016edition AT rachelesprugnoli evalitagoessocialtasksdataandcommunityatthe2016edition
_version_	1718397974135963648

EVALITA Goes Social: Tasks, Data, and Community at the 2016 Edition

Ejemplares similares