Recognition of logical units in log files - LIRMM - Laboratoire d’Informatique, de Robotique et de Microélectronique de Montpellier Access content directly
Journal Articles Intelligent Data Analysis Year : 2015

Recognition of logical units in log files


With the development of new technologies more and more information is stored in log files. Analyzing such logs can be very useful for the decision maker. One of the probably best known example is the Web log file analysis where lots of efficient tools have been proposed to extract the top-k accessed pages, the best users or even the patterns describing the behaviors of users on a Web site. These tools take advantages of the well-formed structures of the data. Unfortunately, logs files from the industrial world have very heterogeneous complex structures (e.g., tables, lists, data blocks). For experts, analyzing logs to find messages helping to better understand causes of a failure, if a problem have already occurred in the past or even knowing the main consequences of a failure is a hard, tedious, time-consuming and error-prone task. There is thus a need for new tools helping the experts to easily recognize the appropriate part in logs. Passage retrieval methods have proved to be very useful for extracting relevant parts in documents. In this paper we propose a new approach for automatically split logs files into relevant segments based on their logical units. We characterize the complex logical units found in logs according to their syntactic characteristics. We also introduce the notion of generalized vs-grams which is used to automatically extract the syntactic characteristics of special structures found in log files. Conducted experiments are performed on real datasets from the industrial world to demonstrate the efficiency of our proposal on the recognition of complex logical units.
Fichier principal
Vignette du fichier
Lirmm-01054913.pdf (586.13 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

lirmm-01054913 , version 1 (06-11-2018)



Hassan Saneifar, Stéphane Bonniol, Pascal Poncelet, Mathieu Roche. Recognition of logical units in log files. Intelligent Data Analysis, 2015, 19 (2), pp.431-448. ⟨10.3233/IDA-150724⟩. ⟨lirmm-01054913⟩
367 View
161 Download



Gmail Mastodon Facebook X LinkedIn More