Shallow Text Clustering Does Not Mean Weak Topics: How Topic Identification Can Leverage Bigram Features

Julien Velcin; Mathieu Roche; Pascal Poncelet

Shallow Text Clustering Does Not Mean Weak Topics: How Topic Identification Can Leverage Bigram Features

Julien Velcin ¹ Mathieu Roche ^{2, 3} Pascal Poncelet ²

1 ERIC - Entrepôts, Représentation et Ingénierie des Connaissances

2 ADVANSE - ADVanced Analytics for data SciencE

LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier

3 UMR TETIS - Territoires, Environnement, Télédétection et Information Spatiale

Abstract : Text clustering and topic learning are two closely related tasks. In this paper, we show that the topics can be learnt without the absolute need of an exact categorization. In particular, the experiments performed on two real case studies with a vocabulary based on bigram features lead to extracting readable topics that cover most of the documents. Precision at 10 is up to 74% for a dataset of scientific abstracts with 10,000 features, which is 4% less than when using unigrams only but provides more interpretable topics.

Document type :

Conference papers

Domain :

Computer Science [cs] / Databases [cs.DB]

Complete list of metadatas

Cited literature [29 references] Display Hide Download

https://hal-lirmm.ccsd.cnrs.fr/lirmm-01362434
Contributor : Pascal Poncelet <>
Submitted on : Thursday, September 8, 2016 - 5:20:55 PM
Last modification on : Tuesday, June 18, 2019 - 8:15:49 PM
Long-term archiving on : Friday, December 9, 2016 - 1:10:17 PM

dmnlp revisedJulienVelcin2016....

Files produced by the author(s)

Shallow Text Clustering Does Not Mean Weak Topics: How Topic Identification Can Leverage Bigram Features

File

Identifiers

Collections

Citation

Export

Metrics

240

326

Contact

Shallow Text Clustering Does Not Mean Weak Topics: How Topic Identification Can Leverage Bigram Features

File

Identifiers

Collections

Citation

Export

Share

Metrics

240

326

Contact