Self-adaptive attribute weighting for Naive Bayes classification
Naive Bayes (NB) is a popular machine learning tool for classification, due to its simplicity,
high computational efficiency, and good classification accuracy, especially for high
dimensional data such as texts. In reality, the pronounced advantage of NB is often
challenged by the strong conditional independence assumption between attributes, which
may deteriorate the classification performance. Accordingly, numerous efforts have been
made to improve NB, by using approaches such as structure extension, attribute selection …
high computational efficiency, and good classification accuracy, especially for high
dimensional data such as texts. In reality, the pronounced advantage of NB is often
challenged by the strong conditional independence assumption between attributes, which
may deteriorate the classification performance. Accordingly, numerous efforts have been
made to improve NB, by using approaches such as structure extension, attribute selection …
Abstract
Naive Bayes (NB) is a popular machine learning tool for classification, due to its simplicity, high computational efficiency, and good classification accuracy, especially for high dimensional data such as texts. In reality, the pronounced advantage of NB is often challenged by the strong conditional independence assumption between attributes, which may deteriorate the classification performance. Accordingly, numerous efforts have been made to improve NB, by using approaches such as structure extension, attribute selection, attribute weighting, instance weighting, local learning and so on. In this paper, we propose a new Artificial Immune System (AIS) based self-adaptive attribute weighting method for Naive Bayes classification. The proposed method, namely AISWNB, uses immunity theory in Artificial Immune Systems to search optimal attribute weight values, where self-adjusted weight values will alleviate the conditional independence assumption and help calculate the conditional probability in an accurate way. One noticeable advantage of AISWNB is that the unique immune system based evolutionary computation process, including initialization, clone, section, and mutation, ensures that AISWNB can adjust itself to the data without explicit specification of functional or distributional forms of the underlying model. As a result, AISWNB can obtain good attribute weight values during the learning process. Experiments and comparisons on 36 machine learning benchmark data sets and six image classification data sets demonstrate that AISWNB significantly outperforms its peers in classification accuracy, class probability estimation, and class ranking performance.
Elsevier
以上显示的是最相近的搜索结果。 查看全部搜索结果