Accession Number:

ADA561948

Title:

A Method for Correcting Broken Hyphenations in Noisy English Text

Descriptive Note:

Final rept.

Corporate Author:

ARMY RESEARCH LAB ADELPHI MD COMPUTATIONAL AND INFORMATION SCIENCES DIRECTORATE/BATTLEFIELD ENVIRONMENT DIV

Personal Author(s):

• Micher, Jeffrey C.

Report Date:

2012-04-01

Pagination or Media Count:

18.0

Abstract:

The problem of rejoining broken hyphenations in processed English text is addressed. A basic algorithm is developed, which makes use of a word validation step. Results of running the algorithm over an English military training text is presented and analyzed. Precision and recall scores show that the algorithm works well for correcting broken hyphenations, but fails when certain types of noise are encountered in the data.

Descriptors:

• *ENGLISH LANGUAGE
• ALGORITHMS
• COMPUTER PROGRAMS
• MILITARY TRAINING
• NATURAL LANGUAGE

Subject Categories:

• Linguistics

Distribution Statement:

APPROVED FOR PUBLIC RELEASE