Accession Number:

ADA458875

Title:

Plans for a Task-Oriented Evaluation of Natural Language Understanding Systems

Descriptive Note:

Conference paper

Corporate Author:

NAVAL OCEAN SYSTEMS CENTER SAN DIEGO CA

Personal Author(s):

Report Date:

1989-01-01

Pagination or Media Count:

7.0

Abstract:

A plan is presented for evaluating natural language processing NLP systems that have focused on the issues of text understanding as exemplified in short texts from military messages. The plan includes definition of bodies of text to use as development and test data, namely the narrative lines from one type of naval message, and definition of a simulated database update task that requires NLP systems to fill a template with information found in the texts. Documentation related to the naval messages and examples of filled templates have been prepared to assist NLP system developers. It is anticipated that developers of a number of different NLP systems will participate in the evaluation and will meet afterwards to present and interpret the results and to critique the test design.

Subject Categories:

  • Linguistics
  • Human Factors Engineering and Man Machine Systems

Distribution Statement:

APPROVED FOR PUBLIC RELEASE