Accession Number:

ADA459234

Title:

The Web as a Parallel Corpus

Descriptive Note:

Technical rept.

Corporate Author:

MARYLAND UNIV COLLEGE PARK INST FOR ADVANCED COMPUTER STUDIES

Personal Author(s):

Report Date:

2002-07-01

Pagination or Media Count:

31.0

Abstract:

Parallel corpora have become an essential resource for work in multi-lingual natural language processing. In this report, we describe our work using the STRAND system for mining parallel text on the World Wide Web, first reviewing the original algorithm and results and then presenting a set of significant enhancements. These enhancements include the use of supervised learning based on structural features of documents to improve classification performance, a new content-based measure of translational equivalence, and adaptation of the system to take advantage of the Internet Archive for mining parallel text from the Web on a large scale. Finally, the value of these techniques is demonstrated in the construction of a significant parallel corpus for a low-density language pair.

Subject Categories:

  • Information Science
  • Linguistics
  • Computer Systems

Distribution Statement:

APPROVED FOR PUBLIC RELEASE