Accession Number:

ADA478094

Title:

Localized Smoothing for Multinomial Language Models

Descriptive Note:

Technical rept.

Corporate Author:

MASSACHUSETTS UNIV AMHERST CENTER FOR INTELLIGENT INFORMATION RETRIEVAL

Personal Author(s):

Report Date:

2000-05-01

Pagination or Media Count:

10.0

Abstract:

We explore a formal approach to dealing with the zero frequency problem that arises in applications of probabilistic models to language. In this report we introduce the zero frequency problem in the context of probabilistic language models, describe several popular solutions, and introduce localized smoothing, a potentially better alternative. We formulate localized smoothing as a two-step maximization process, outline the estimation details for both steps and present the experiments which show the technique to have potential for improving performance.

Subject Categories:

  • Information Science
  • Cybernetics
  • Statistics and Probability

Distribution Statement:

APPROVED FOR PUBLIC RELEASE