Margin analysis of the LVQ algorithm

K Crammer, R Gilad-Bachrach… - Advances in neural …, 2002 - proceedings.neurips.cc
Advances in neural information processing systems, 2002proceedings.neurips.cc
Prototypes based algorithms are commonly used to reduce the computational complexity of
Nearest-Neighbour (NN) classifiers. In this paper we discuss theoretical and algorithmical
aspects of such algorithms. On the theory side, we present margin based generalization
bounds that suggest that these kinds of classifiers can be more accurate then the 1-NN rule.
Furthermore, we derived a training algorithm that selects a good set of prototypes using
large margin principles. We also show that the 20 years old Learning Vector Quantization …
Abstract
Prototypes based algorithms are commonly used to reduce the computational complexity of Nearest-Neighbour (NN) classifiers. In this paper we discuss theoretical and algorithmical aspects of such algorithms. On the theory side, we present margin based generalization bounds that suggest that these kinds of classifiers can be more accurate then the 1-NN rule. Furthermore, we derived a training algorithm that selects a good set of prototypes using large margin principles. We also show that the 20 years old Learning Vector Quantization (LVQ) algorithm emerges naturally from our framework.
proceedings.neurips.cc
以上显示的是最相近的搜索结果。 查看全部搜索结果