Home

Calculation of the learning curve of Bayes optimal classification algorithm for learning a perceptron with noise


Author(s) : David Haussler, 
Publisher : N/A
Publication Date : 1991
ISSN : N/A
Abstract : The learning curve of Bayes optimal classification algorithm when learning a perceptron from noisy random training examples is calculated exactly in the limit of large training sample size and large instance space dimension using methods of statistical mechanics. It is shown that under certain assumptions, in this "thermodynamic " limit, the probability of misclassification of Bayes optimal algorithm is less than that of a canonical stochastic learning algorithm, by a factor approaching,