Efficiently Mining Large Gradual Patterns Using Chunked Storage Layout - LIRMM - Laboratoire d’Informatique, de Robotique et de Microélectronique de Montpellier
Conference Papers Year : 2021

Efficiently Mining Large Gradual Patterns Using Chunked Storage Layout

Abstract

Existing approaches for extracting gradual patterns become inefficient in terms of memory usage when applied on data sets with huge numbers of objects. This inefficiency is caused by the contiguous nature of loading binary matrices into main memory as single blocks when validating candidate gradual patterns. This paper proposes an efficient storage layout that allows these matrices to be split and loaded into/from memory in multiple smaller chunks. We show how HDF5 (Hierarchical Data Format version 5) may be used to implement this chunked layout and our experiments reveal a great improvement in memory usage efficiency especially on huge data sets.
Fichier principal
Vignette du fichier
adbis2021_owuor.pdf (356.03 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

lirmm-03320961 , version 1 (16-08-2021)

Identifiers

Cite

Dickson Odhiambo Owuor, Anne Laurent. Efficiently Mining Large Gradual Patterns Using Chunked Storage Layout. ADBIS 2021 - 25th European Conference on Advances in Databases and Information Systems, Aug 2021, Tartu, Estonia. pp.30-42, ⟨10.1007/978-3-030-82472-3_4⟩. ⟨lirmm-03320961⟩
46 View
97 Download

Altmetric

Share

More