Efficiently Mining Large Gradual Patterns Using Chunked Storage Layout - LIRMM - Laboratoire d’Informatique, de Robotique et de Microélectronique de Montpellier
Communication Dans Un Congrès Année : 2021

Efficiently Mining Large Gradual Patterns Using Chunked Storage Layout

Résumé

Existing approaches for extracting gradual patterns become inefficient in terms of memory usage when applied on data sets with huge numbers of objects. This inefficiency is caused by the contiguous nature of loading binary matrices into main memory as single blocks when validating candidate gradual patterns. This paper proposes an efficient storage layout that allows these matrices to be split and loaded into/from memory in multiple smaller chunks. We show how HDF5 (Hierarchical Data Format version 5) may be used to implement this chunked layout and our experiments reveal a great improvement in memory usage efficiency especially on huge data sets.
Fichier principal
Vignette du fichier
adbis2021_owuor.pdf (356.03 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

lirmm-03320961 , version 1 (16-08-2021)

Identifiants

Citer

Dickson Odhiambo Owuor, Anne Laurent. Efficiently Mining Large Gradual Patterns Using Chunked Storage Layout. ADBIS 2021 - 25th European Conference on Advances in Databases and Information Systems, Aug 2021, Tartu, Estonia. pp.30-42, ⟨10.1007/978-3-030-82472-3_4⟩. ⟨lirmm-03320961⟩
80 Consultations
105 Téléchargements

Altmetric

Partager

More