Analysis of sampling techniques for association rule mining
Proceedings of the 12th international conference on database theory, 2009•dl.acm.org
In this paper, we present a comprehensive theoretical analysis of the sampling technique for
the association rule mining problem. Most of the previous works have concentrated only on
the empirical evaluation of the effectiveness of sampling for the step of finding frequent
itemsets. To the best of our knowledge, a theoretical framework to analyze the quality of the
solutions obtained by sampling has not been studied. Our contributions are two-fold. First,
we present the notions of ε-close frequent itemset mining and ε-close association rule …
the association rule mining problem. Most of the previous works have concentrated only on
the empirical evaluation of the effectiveness of sampling for the step of finding frequent
itemsets. To the best of our knowledge, a theoretical framework to analyze the quality of the
solutions obtained by sampling has not been studied. Our contributions are two-fold. First,
we present the notions of ε-close frequent itemset mining and ε-close association rule …
In this paper, we present a comprehensive theoretical analysis of the sampling technique for the association rule mining problem. Most of the previous works have concentrated only on the empirical evaluation of the effectiveness of sampling for the step of finding frequent itemsets. To the best of our knowledge, a theoretical framework to analyze the quality of the solutions obtained by sampling has not been studied. Our contributions are two-fold. First, we present the notions of ε-close frequent itemset mining and ε-close association rule mining that help assess the quality of the solutions obtained by sampling. Secondly, we show that both the frequent items mining and association rule mining problems can be solved satisfactorily with a sample size that is independent of both the number of transactions size and the number of items. Let θ be the required support, ε the closeness parameter, and 1/h the desired bound on the probability of failure. We show that the sampling based analysis succeeds in solving both ε-close frequent itemset mining and ε-close association rule mining with a probability of at least (1 - 1/h) with a sample of size S = O(1/ε2θ [Δ + log h/(1 - ε)θ]), where Δ is the maximum number of items present in any transaction. Thus, we establish that it is possible to speed up the entire process of association rule mining for massive databases by working with a small sample while retaining any desired degree of accuracy. Our work gives a comprehensive explanation for the well known empirical successes of sampling for association rule mining.
ACM Digital Library
以上显示的是最相近的搜索结果。 查看全部搜索结果