Accession Number:

ADA028231

Title:

Cancellation and Rounding Errors.

Descriptive Note:

Technical summary rept.,

Corporate Author:

WISCONSIN UNIV MADISON MATHEMATICS RESEARCH CENTER

Personal Author(s):

Report Date:

1976-04-01

Pagination or Media Count:

30.0

Abstract:

The fact that a calculating machine can usually hold only an approximation to the number that one is concerned with leads to cancellation errors and rounding errors. These concepts are defined precisely and examples are given. Suggestions are given for reducing when possible the size of errors arising from these two effects.

Subject Categories:

  • Theoretical Mathematics
  • Computer Hardware

Distribution Statement:

APPROVED FOR PUBLIC RELEASE