A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid

Discourse coherence is strongly associated with text quality, making it important to natural language generation and understanding. However, existing coherence models focus on measuring individual aspects of coherence, such as lexical overlap, entity centralization, rhetorical structure, etc., lacki...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Lanlan Jiang, Shengjun Yuan, Jun Li
Formato: article
Lenguaje:EN
Publicado: Hindawi-Wiley 2021
Materias:
Acceso en línea:https://doaj.org/article/50980c0e8a68459093f46e6c3bca8eac
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:50980c0e8a68459093f46e6c3bca8eac
record_format dspace
spelling oai:doaj.org-article:50980c0e8a68459093f46e6c3bca8eac2021-11-15T01:19:54ZA Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid1099-052610.1155/2021/6654925https://doaj.org/article/50980c0e8a68459093f46e6c3bca8eac2021-01-01T00:00:00Zhttp://dx.doi.org/10.1155/2021/6654925https://doaj.org/toc/1099-0526Discourse coherence is strongly associated with text quality, making it important to natural language generation and understanding. However, existing coherence models focus on measuring individual aspects of coherence, such as lexical overlap, entity centralization, rhetorical structure, etc., lacking measurement of the semantics of text. In this paper, we propose a discourse coherence analysis method combining sentence embedding and the dimension grid, we obtain sentence-level vector representation by deep learning, and we introduce a coherence model that captures the fine-grained semantic transitions in text. Our work is based on the hypothesis that each dimension in the embedding vector is exactly assigned a stated certainty and specific semantic. We take every dimension as an equal grid and compute its transition probabilities. The document feature vector is also enriched to model the coherence. Finally, the experimental results demonstrate that our method achieves excellent performance on two coherence-related tasks.Lanlan JiangShengjun YuanJun LiHindawi-WileyarticleElectronic computers. Computer scienceQA75.5-76.95ENComplexity, Vol 2021 (2021)
institution DOAJ
collection DOAJ
language EN
topic Electronic computers. Computer science
QA75.5-76.95
spellingShingle Electronic computers. Computer science
QA75.5-76.95
Lanlan Jiang
Shengjun Yuan
Jun Li
A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid
description Discourse coherence is strongly associated with text quality, making it important to natural language generation and understanding. However, existing coherence models focus on measuring individual aspects of coherence, such as lexical overlap, entity centralization, rhetorical structure, etc., lacking measurement of the semantics of text. In this paper, we propose a discourse coherence analysis method combining sentence embedding and the dimension grid, we obtain sentence-level vector representation by deep learning, and we introduce a coherence model that captures the fine-grained semantic transitions in text. Our work is based on the hypothesis that each dimension in the embedding vector is exactly assigned a stated certainty and specific semantic. We take every dimension as an equal grid and compute its transition probabilities. The document feature vector is also enriched to model the coherence. Finally, the experimental results demonstrate that our method achieves excellent performance on two coherence-related tasks.
format article
author Lanlan Jiang
Shengjun Yuan
Jun Li
author_facet Lanlan Jiang
Shengjun Yuan
Jun Li
author_sort Lanlan Jiang
title A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid
title_short A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid
title_full A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid
title_fullStr A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid
title_full_unstemmed A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid
title_sort discourse coherence analysis method combining sentence embedding and dimension grid
publisher Hindawi-Wiley
publishDate 2021
url https://doaj.org/article/50980c0e8a68459093f46e6c3bca8eac
work_keys_str_mv AT lanlanjiang adiscoursecoherenceanalysismethodcombiningsentenceembeddinganddimensiongrid
AT shengjunyuan adiscoursecoherenceanalysismethodcombiningsentenceembeddinganddimensiongrid
AT junli adiscoursecoherenceanalysismethodcombiningsentenceembeddinganddimensiongrid
AT lanlanjiang discoursecoherenceanalysismethodcombiningsentenceembeddinganddimensiongrid
AT shengjunyuan discoursecoherenceanalysismethodcombiningsentenceembeddinganddimensiongrid
AT junli discoursecoherenceanalysismethodcombiningsentenceembeddinganddimensiongrid
_version_ 1718428921494503424