A Prime Number Based Approach for Closed Frequent Itemset Mining in Big Data

Abstract : Mining big datasets poses a number of challenges which are not easily addressed by traditional mining methods, since both memory and computational requirements are hard to satisfy. One solution for dealing with such requirements is to take advantage of parallel frameworks , such as MapReduce, that allow to make powerful computing and storage units on top of ordinary machines. In this paper, we address the issue of mining closed frequent itemsets (CFI) from big datasets in such environments. We introduce a new parallel algorithm, called CloPN, for CFI mining. One of the worth of cite features of CloPN is that it uses a prime number based approach to transform the data into numerical form, and then to mine closed frequent itemsets by using only multiplication and division operations. We carried out exhaustive experiments over big real world datasets to assess the performance of CloPN. The obtained results highlight that our algorithm is very efficient in CFI mining from large real world datasets with up to 53 million articles.
Document type :
Conference papers
Complete list of metadatas

Cited literature [11 references]  Display  Hide  Download

https://hal-lirmm.ccsd.cnrs.fr/lirmm-01169606
Contributor : Florent Masseglia <>
Submitted on : Monday, June 29, 2015 - 6:37:07 PM
Last modification on : Thursday, April 18, 2019 - 2:55:09 PM
Long-term archiving on : Wednesday, September 16, 2015 - 6:27:26 AM

File

DexaCameraPaper.pdf
Files produced by the author(s)

Identifiers

Citation

Mehdi Zitouni, Reza Akbarinia, Sadok Ben Yahia, Florent Masseglia. A Prime Number Based Approach for Closed Frequent Itemset Mining in Big Data. DEXA: Database and Expert Systems Applications, Sep 2015, Valencia, Spain. pp.509-516, ⟨10.1007/978-3-319-22849-5_35⟩. ⟨lirmm-01169606⟩

Share

Metrics

Record views

939

Files downloads

2077