Accession Number:

ADA523027

Title:

Gibbs Sampling for the Uninitiated

Descriptive Note:

Research rept.

Corporate Author:

MARYLAND UNIV COLLEGE PARK INST FOR ADVANCED COMPUTER STUDIES

Personal Author(s):

Report Date:

2010-04-01

Pagination or Media Count:

24.0

Abstract:

This document is intended for computer scientists who would like to try out a Markov Chain Monte Carlo MCMC technique, particularly to do inference with Bayesian models on problems related to text processing. We try to keep theory to the absolute minimum needed, though we work through the details much more explicitly than you usually see even in introductory explanations. That means weve attempted to be ridiculously explicit in our exposition and notation. After providing the reasons and reasoning behind Gibbs sampling and at least nodding our heads in the direction of theory, we work through an example application in detail -- the derivation of a Gibbs sampler for a Naive Bayes model. Along with the example, we discuss some practical implementation issues, including the integrating out of continuous parameters when possible. We conclude with some pointers to literature that weve found to be somewhat more friendly to uninitiated readers.

Subject Categories:

  • Linguistics
  • Numerical Mathematics
  • Statistics and Probability

Distribution Statement:

APPROVED FOR PUBLIC RELEASE