|
Abstract : |
In many machine learning applications, the source of the training data can be modeled as an oracle. An oracle has the ability, when presented with an example (query), to give a correct classification. Through interaction with a partially trained classifier, efficient query learning uses an oracle to produce training data with high information content. This paper presents a novel approach for query based neural network learning. Consider a layered perceptton partially trained for binary classification. The single output neuron is trained to be either a 0 or a 1. A test decision is made by thresholdlug the output at, say,. The set of inputs that produce an output of, forms the classification boundary. We adopted an inversion algorithm for the neural network that allows generation of this boundary. In addition, for each boundary point, we can generate the classification gradient. The gradient provides a useful measure of the sharpness of the multi-dimensional decision surfaces. Using the boundary point and gradient information, conjugate input pair locations are generated and presented to an oracle for proper classification. This new data is used to further refine the classification boundary thereby increasing the classification accuracy. The result can be a significant reduction in the training set cardinality in comparison with, for example, randomly generated data points. An application example to power security assessment is given., |
