Accession Number:

ADA626579

Title:

Methods for Evaluating Text Extraction Toolkits: An Exploratory Investigation

Descriptive Note:

Technical rept.

Corporate Author:

MITRE CORP MCLEAN VA

Personal Author(s):

Report Date:

2015-01-22

Pagination or Media Count:

10.0

Abstract:

Text extraction tools are vital for obtaining the textual content of computer files and for using the electronic text in a wide variety of applications, including search and natural language processing. However, when extraction tools fail, they convert once reliable electronic text into garbled text, or no text at all. The techniques and tools for validating the accuracy of these text extraction tools are conspicuously absent from academia and industry. This paper contributes to closing this gap. We discuss an exploratory investigation into a method and a set of tools for evaluating a text extraction toolkit. Although this effort focuses on the popular open source Apache Tika toolkit and the govdocs1 corpus, the method generally applies to other text extraction toolkits and corpora.

Subject Categories:

  • Linguistics
  • Statistics and Probability
  • Computer Programming and Software

Distribution Statement:

APPROVED FOR PUBLIC RELEASE