Accurate Arabic Script Language/Dialect Classification

reportActive / Technical Report | Accession Number: ADA597898 | Open PDF

Abstract:

Correctly identifying the languagedialect of a text is a critical first step for many natural language processing systems, including machine translation systems. To date, most language identification efforts have focused on distinguishing between European languages. Increasingly, historically-unwrittenArabic dialects are appearing online in social media. This report describes state-of-the-art classifiers for automatically distinguishing between Arabic script languages and between Arabic dialects.

Author(s):
Tratz, Stephen C.
Author Organization(s):
ARMY RESEARCH LAB ADELPHI MD
Supplementary Note:
The original document contains color images.
Pagination:
0030

Security Markings

DOCUMENT & CONTEXTUAL SUMMARY

Distribution:
Approved For Public Release
Distribution Statement:
Approved For Public Release; Distribution Is Unlimited.

RECORD

Collection: TR
Identifying Numbers
Report Number(s):
ARL-TR-6761
Monitor Series:
ARL
 Subject Terms
Joint Capability Areas:
JCA_1.2_Force Preparation; JCA_1_Force Support; JCA_1.2.1_Training; JCA_1.2.7_Experimentation; JCA_6.1.3_Switching and Routing; JCA_6_Net Centric; JCA_6.1_Information Transport; JCA_8_Building Partnerships; JCA_8.2_Shape
Modernization Areas:
AI and Machine Learning
Communities of Interest:
Autonomy
Descriptor(s):
*CLASSIFICATION, *DIALECTS, *NATURAL LANGUAGE, ARABIC LANGUAGE, ARABS, IDENTIFICATION, INFORMATION PROCESSING, LANGUAGE, MACHINE TRANSLATION, ONLINE SYSTEMS, REPORTS, STATE OF THE ART
Field(s)/Group(s):
Information Science, Linguistics
Keyword(s):
LANGUAGE IDENTIFICATION, ARABIC, DIALECT, NATURAL LANGUAGE PROCESSING, MACHINE LEARNING, FOREIGN REPORTS
Report Date:
2014 Jan 01
Creation Date:
2014 Apr 30