A Method for Correcting Broken Hyphenations in Noisy English Text

reportActive / Technical Report | Accession Number: ADA561948 | Open PDF

Abstract:

The problem of rejoining broken hyphenations in processed English text is addressed. A basic algorithm is developed, which makes use of a word validation step. Results of running the algorithm over an English military training text is presented and analyzed. Precision and recall scores show that the algorithm works well for correcting broken hyphenations, but fails when certain types of noise are encountered in the data.

Author(s):
Micher, Jeffrey C.
Author Organization(s):
ARMY RESEARCH LAB ADELPHI MD COMPUTATIONAL AND INFORMATION SCIENCES DIRECTORATE/BATTLEFIELD ENVIRONMENT DIV
Descriptive Note:
Final rept.
Supplementary Note:
The original document contains color images. DOI: 10.21236/ADA561948
Pagination:
0018

Security Markings

DOCUMENT & CONTEXTUAL SUMMARY

Distribution:
Approved For Public Release
Distribution Statement:
Approved For Public Release; Distribution Is Unlimited.

RECORD

Collection: TR
Identifying Numbers
Report Number(s):
ARL-TN-0481
Monitor Series:
CISD/BED/MD
 Subject Terms
Joint Capability Areas:
JCA_5_Command and Control; JCA_5.3_Planning; JCA_3.2_Engagement; JCA_3_Force Application; JCA_1.2_Force Preparation; JCA_1_Force Support; JCA_1.2.1_Training; JCA_3.2.1_Kinetic Means; JCA_8_Building Partnerships
Modernization Areas:
AI and Machine Learning
Communities of Interest:
No COI(s) Identified
Descriptor(s):
*ENGLISH LANGUAGE, ALGORITHMS, COMPUTER PROGRAMS, MILITARY TRAINING, NATURAL LANGUAGE
Field(s)/Group(s):
Linguistics
Keyword(s):
HYPHENATION, NATURAL LANGUAGE PROCESSING
Report Date:
2012 Apr 01
Creation Date:
2012 Aug 01