The Impact of Corpus Quality and Type on Topic based Text Segmentation Evaluation - LIRMM - Laboratoire d’Informatique, de Robotique et de Microélectronique de Montpellier
Communication Dans Un Congrès Année : 2008

The Impact of Corpus Quality and Type on Topic based Text Segmentation Evaluation

Résumé

In this paper, we try to fathom the real impact of corpus quality on methods performances and their evaluations. The considered task is topic-based text segmentation, and two highly different unsupervised algorithms are compared: C99, a word-based system, augmented with LSA, and Transeg, a sentence-based system. Two main characteristics of corpora have been investigated: Data quality (clean vs raw corpora), corpora manipulation (natural vs artificial data sets). The corpus size has also been subject to variation, and experiments related in this paper have shown that corpora characteristics highly impact recall and precision values for both algorithms.
Fichier principal
Vignette du fichier
CLA.pdf (177.35 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

lirmm-00336165 , version 1 (03-11-2008)

Identifiants

Citer

Alexandre Labadié, Violaine Prince. The Impact of Corpus Quality and Type on Topic based Text Segmentation Evaluation. IMCSIT: International Multiconference on Computer Science and Information Technology, Oct 2008, Wisia, Poland. pp.313-319, ⟨10.1109/IMCSIT.2008.4747258⟩. ⟨lirmm-00336165⟩
92 Consultations
352 Téléchargements

Altmetric

Partager

More