BestNeighbor: Efficient Evaluation of kNN Queries on Large Time Series Databases - LIRMM - Laboratoire d’Informatique, de Robotique et de Microélectronique de Montpellier
Journal Articles Knowledge and Information Systems (KAIS) Year : 2021

BestNeighbor: Efficient Evaluation of kNN Queries on Large Time Series Databases

Oleksandra Levchenko
Boyan Kolev
Djamel-Edine Edine Yagoubi
  • Function : Author
  • PersonId : 1086292
Reza Akbarinia
Florent Masseglia
Patrick Valduriez
Dennis Shasha
  • Function : Author
  • PersonId : 833427

Abstract

This paper presents parallel solutions (developed based on two state-of-the-art algorithms iSAX and sketch) for evaluating kNN (k nearest neighbor) queries on large databases of time series, compares them based on various measures of quality and time performance, offers a tool that uses the characteristics of application data to determine which algorithm to choose for that application and how to set the parameters for that algorithm. Specifically, our experiments show that: (i) iSAX and its derivatives perform best in both time and quality when the time series can be characterized by a few low frequency Fourier Coefficients , a regime where the iSAX pruning approach works well. (ii) iSAX performs significantly less well when high frequency Fourier Coefficients have much of the energy of the time series. (iii) A random projection approach based on sketches by contrast is more or less independent of the frequency power spectrum. The experiments show the close relationship between pruning ratio and time for exact iSAX as well as between pruning ratio and the quality of approximate iSAX. Our toolkit analyzes typical time series of an application (i) to determine optimal segment sizes for iSAX and (ii) when to use Parallel Sketches instead of iSAX. Our algorithms have been implemented using Spark, evaluated over a cluster of nodes, and have been applied to both real and synthetic data. The results apply to any databases of numerical sequences, whether or not they relate to time.
Fichier principal
Vignette du fichier
BestNeighbor_KAIS.pdf (1.18 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

lirmm-02973633 , version 1 (21-10-2020)
lirmm-02973633 , version 2 (17-12-2020)

Identifiers

Cite

Oleksandra Levchenko, Boyan Kolev, Djamel-Edine Edine Yagoubi, Reza Akbarinia, Florent Masseglia, et al.. BestNeighbor: Efficient Evaluation of kNN Queries on Large Time Series Databases. Knowledge and Information Systems (KAIS), 2021, 63 (2), pp.349-378. ⟨10.1007/s10115-020-01518-4⟩. ⟨lirmm-02973633v2⟩
245 View
396 Download

Altmetric

Share

More