Towards Electronic SMS Dictionary Construction: An Alignment-based Approach

Abstract : In this paper, we propose a method for aligning text messages (entitled AlignSMS) in order to automatically build an SMS dictionary. An extract of 100 text messages from the 88milSMS corpus (Panckhurst el al., 2013, 2014) was used as an initial test. More than 90,000 authentic text messages in French were collected from the general public by a group of academics in the south of France in the context of the sud4science project (http://www.sud4science.org). This project is itself part of a vast international SMS data collection project, entitled sms4science (http://www.sms4science.org, Fairon et al. 2006, Cougnon, 2014). After corpus collation, pre-processing and anonymisation (Accorsi et al., 2012, Patel et al., 2013), we discuss how "raw" anonymised text messages can be transcoded into normalised text messages, using a statistical alignment method. The future objective is to set up a hybrid (symbolic/statistic) approach based on both grammar rules and our statistical AlignSMS method.
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download

https://hal-lirmm.ccsd.cnrs.fr/lirmm-01054899
Contributor : Mathieu Roche <>
Submitted on : Saturday, August 9, 2014 - 6:45:14 PM
Last modification on : Thursday, June 6, 2019 - 2:31:48 PM
Long-term archiving on : Wednesday, November 26, 2014 - 4:55:36 PM

File

753_Paper.pdf
Publisher files allowed on an open archive

Identifiers

  • HAL Id : lirmm-01054899, version 1

Citation

Cédric Lopez, Reda Bestandji, Mathieu Roche, Rachel Panckhurst. Towards Electronic SMS Dictionary Construction: An Alignment-based Approach. LREC: Language Resources and Evaluation Conference, May 2014, Reykjavik, Iceland. pp.2833-2838. ⟨lirmm-01054899⟩

Share

Metrics

Record views

659

Files downloads

505