Parallel Query Processing in a Polystore - LIRMM - Laboratoire d’Informatique, de Robotique et de Microélectronique de Montpellier
Journal Articles Distributed and Parallel Databases Year : 2021

Parallel Query Processing in a Polystore

Pavlos Kranas
  • Function : Author
  • PersonId : 1091554
Boyan Kolev
Oleksandra Levchenko
Esther Pacitti
Patrick Valduriez
Marta Patiño-Martinez

Abstract

The blooming of different data stores has made polystores a major topic in the cloud and big data landscape. As the amount of data grows rapidly, it becomes critical to exploit the inherent parallel processing capabilities of underlying data stores and data processing platforms. To fully achieve this, a polystore should: (i) preserve the expressivity of each data store's native query or scripting language and (ii) leverage a distributed architecture to enable parallel data integration, i.e. joins, on top of parallel retrieval of underlying partitioned datasets. In this paper, we address these points by: (i) using the polyglot approach of the CloudMdsQL query language that allows native queries to be expressed as inline scripts and combined with SQL statements for ad-hoc integration and (ii) incorporating the approach within the LeanXcale distributed query engine, thus allowing for native scripts to be processed in parallel at data store shards. In addition, (iii) efficient optimization techniques, such as bind join, can take place to improve the performance of selective joins. We evaluate the performance benefits of exploiting parallelism in combination with high expressivity and optimization through our experimental validation.
Fichier principal
Vignette du fichier
PMSQP_v4.4.pdf (1.7 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

lirmm-03148271 , version 1 (22-02-2021)

Identifiers

Cite

Pavlos Kranas, Boyan Kolev, Oleksandra Levchenko, Esther Pacitti, Patrick Valduriez, et al.. Parallel Query Processing in a Polystore. Distributed and Parallel Databases, 2021, 39, pp.939-977. ⟨10.1007/s10619-021-07322-5⟩. ⟨lirmm-03148271⟩
179 View
461 Download

Altmetric

Share

More