Comparison of multilayer neural network and Nearest Neighbor Classifiers for handwritten digit recognition

Abstract

The basic Nearest Neighbor Classifier (NNC) is often inefficient for classification in terms of memory space and computing time needed if all training samples are used as prototypes. These problems can be solved by reducing the number of prototypes using clustering algorithms and optimizing the prototypes using a special neural network model. In this paper, we compare the performance of the multilayer neural network and an Optimized Nearest Neighbor Classifier (ONNC) for handwritten digit recognition applications. We show that an ONNC can have the same recognition performance as an equivalent neural network classifier. The ONNC can be efficiently implemented using prototype and variable ranking, partial summation and distance triangular inequality based strategies. It requires the same memory space as, but less, training time and classification time than the neural network.