Accession Number:

ADA247725

Title:

Criteria for Choosing the Best Neural Network: Part 1

Descriptive Note:

Final rept.,

Corporate Author:

NAVAL HEALTH RESEARCH CENTER SAN DIEGO CA

Personal Author(s):

Report Date:

1991-07-24

Pagination or Media Count:

28.0

Abstract:

An investigation into the problem of determining a parsimonious neural network for use in predictiongeneralization based on a given fixed learning sample was undertaken. Both the classification and nonlinear regression contexts were addressed. An exposition and survey of the problem and past research on model selection techniques in other statistical settings was compiled, and algorithms for selecting the number of hidden layer nodes in a three layer, feedforward neural network were developed. The selection criteria developed attempt to grow the networks beginning with a small initial number of hidden layer nodes as opposed to pruning a relatively large network. For the nonlinear regression problem, the method is based on cross-validation estimates of the prediction mean squared error for the candidate networks. For the classification problem, the method is based on a cost complexity measure of the candidate networks based on resubstitution estimates of the probability of misclassification and a penalty function of the number of hidden layer nodes. Also considered was the use of principal.

Subject Categories:

  • Operations Research

Distribution Statement:

APPROVED FOR PUBLIC RELEASE