The Impact of Corpus Quality and Type on Topic based Text Segmentation Evaluation - LIRMM - Laboratoire d’Informatique, de Robotique et de Microélectronique de Montpellier
Conference Papers Year : 2008

The Impact of Corpus Quality and Type on Topic based Text Segmentation Evaluation

Abstract

In this paper, we try to fathom the real impact of corpus quality on methods performances and their evaluations. The considered task is topic-based text segmentation, and two highly different unsupervised algorithms are compared: C99, a word-based system, augmented with LSA, and Transeg, a sentence-based system. Two main characteristics of corpora have been investigated: Data quality (clean vs raw corpora), corpora manipulation (natural vs artificial data sets). The corpus size has also been subject to variation, and experiments related in this paper have shown that corpora characteristics highly impact recall and precision values for both algorithms.
Fichier principal
Vignette du fichier
CLA.pdf (177.35 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

lirmm-00336165 , version 1 (03-11-2008)

Identifiers

Cite

Alexandre Labadié, Violaine Prince. The Impact of Corpus Quality and Type on Topic based Text Segmentation Evaluation. IMCSIT: International Multiconference on Computer Science and Information Technology, Oct 2008, Wisia, Poland. pp.313-319, ⟨10.1109/IMCSIT.2008.4747258⟩. ⟨lirmm-00336165⟩
88 View
343 Download

Altmetric

Share

More