Skip to Main content Skip to Navigation
Conference papers

The Impact of Corpus Quality and Type on Topic based Text Segmentation Evaluation

Abstract : In this paper, we try to fathom the real impact of corpus quality on methods performances and their evaluations. The considered task is topic-based text segmentation, and two highly different unsupervised algorithms are compared: C99, a word-based system, augmented with LSA, and Transeg, a sentence-based system. Two main characteristics of corpora have been investigated: Data quality (clean vs raw corpora), corpora manipulation (natural vs artificial data sets). The corpus size has also been subject to variation, and experiments related in this paper have shown that corpora characteristics highly impact recall and precision values for both algorithms.
Document type :
Conference papers
Complete list of metadata

https://hal-lirmm.ccsd.cnrs.fr/lirmm-00336165
Contributor : Alexandre Labadié <>
Submitted on : Monday, November 3, 2008 - 9:18:19 AM
Last modification on : Friday, September 20, 2019 - 12:35:07 PM
Long-term archiving on: : Monday, June 7, 2010 - 10:37:39 PM

File

CLA.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Alexandre Labadié, Violaine Prince. The Impact of Corpus Quality and Type on Topic based Text Segmentation Evaluation. IMCSIT: International Multiconference on Computer Science and Information Technology, Oct 2008, Wisia, Poland. pp.313-319, ⟨10.1109/IMCSIT.2008.4747258⟩. ⟨lirmm-00336165⟩

Share

Metrics

Record views

212

Files downloads

553