Accession Number : ADA257935


Title :   An Information Theoretic Approach to Distributed Inference and Learning


Descriptive Note : Final rept. 1 Feb 1990-31 May 1992


Corporate Author : CALIFORNIA INST OF TECHNOLOGY PASADENA JET PROPULSION LAB


Personal Author(s) : Smyth, Padhraic


Full Text : https://apps.dtic.mil/dtic/tr/fulltext/u2/a257935.pdf


Report Date : 01 Oct 1992


Pagination or Media Count : 36


Abstract : This report describes research work which was funded under grant number AFOSR90-00199 during the period February 1st 1990 to May 31st 1992. Our work has focused on developing information-theoretic and probabilistic models for neural network computation. This theoretical basis is then used to develop novel hybrid network architectures, which combine techniques from the fields of statistics and artificial intelligence with neural approaches. The report describes a number of significant results including identification of the general class of energy functions which lead to proper probability estimation, a new algorithm which builds hybrid rule-based network models from data, Markov random field theory and algorithms for constructing network models from large databases, new results on sparse Markov models, a new hybrid unsupervised/supervised learning algorithm with applications to computer vision problems, a novel recurrent network structure, and prototype VLSI hardware implementations of these ideas. A Total of 30 technical papers have resulted from this grant.


Descriptors :   *NEURAL NETS , *INFORMATION THEORY , DATA BASES , MATHEMATICAL MODELS , COMPUTATIONS , MODELS , COMPUTERS , PROBABILITY , STRUCTURES , COMPUTER ARCHITECTURE , NUMBERS , ARCHITECTURE , VISION , COMPUTER VISION , WORK , ARTIFICIAL INTELLIGENCE , IDENTIFICATION , PROTOTYPES , VERY LARGE SCALE INTEGRATION , GRANTS , APPROACH , FIELD THEORY , LEARNING , STATISTICS , ENERGY , THEORY , NETWORKS , INTELLIGENCE , ALGORITHMS , FUNCTIONS


Subject Categories : Computer Systems
      Cybernetics


Distribution Statement : APPROVED FOR PUBLIC RELEASE