
Accession Number : AD0647045
Title : ESTIMATION BY THE NEARESTNEIGHBOR RULE.
Descriptive Note : Technical rept.,
Corporate Author : STANFORD UNIV CALIF STANFORD ELECTRONICS LABS
Personal Author(s) : Cover,Thomas M.
Report Date : SEP 1966
Pagination or Media Count : 24
Abstract : The nearestneighbor estimate of the random parameter associated with a given observation is defined to be the parameter associated with the nearest observation in some training set. This paper is concerned with the infinite parameter problem (estimation) as opposed to the finite parameter problem (classification). Because of the unboundedness of the loss function in the general estimation problem, certain new considerations are required. For a wide range of probability distributions, the largesample risk of the nearestneighbor estimate is shown here to be less than twice the Bayes risk for metric loss functions and equal to twice the Bayes risk for squarederror loss functions. In this sense, at least half the information in the training set is contained in the nearest neighbor. (Author)
Descriptors : (*DECISION THEORY, *RANDOM VARIABLES), PROBABILITY, PATTERN RECOGNITION, STATISTICAL FUNCTIONS
Subject Categories : Statistics and Probability
Cybernetics
Distribution Statement : APPROVED FOR PUBLIC RELEASE