Accession Number : ADA258046


Title :   Numeric Precision in FORTRAN Computing


Descriptive Note : Final rept.


Corporate Author : NAVAL OCEANOGRAPHIC AND ATMOSPHERIC RESEARCH LAB STENNIS SPACE CENTER MS


Personal Author(s) : Meredith, Roger W


Full Text : https://apps.dtic.mil/dtic/tr/fulltext/u2/a258046.pdf


Report Date : Oct 1992


Pagination or Media Count : 8


Abstract : This article compares both real and complex outputs from sizeable numeric computations using identical code on several computer systems. The digital signal processing technique known as the modified covariance method was used as the computational engine. It is a recursive algorithm for solving the covariance equations of a linear predictor that seeks to predict an input signal by a linear combination of past signal samples. Single precision and double precision results are presented but the study focuses primarily on differences between the VAX Fortran 4.8 and MacFortran/020 compilers. Differences in the first digit for single precision arithmetic were found and double precision differences occurred in the eighth digit. Arithmetic with complex data types was found to be less precise than with real data types. Although differences exist among various computer systems, they all show the same order of magnitude accuracy with respect to CRAY-YMP results. The algorithm used here required a double precision implementation to obtain agreement between different computer systems. Acoustic propagation, sea ice, noise.


Descriptors :   *COMPUTATIONS , *FORTRAN , *COMPILERS , ALGORITHMS , SIGNAL PROCESSING , INPUT , COMPUTERS , ICE , PRECISION , ACOUSTICS , SEA ICE , ARITHMETIC , EQUATIONS , OCEANS , AGREEMENTS , NOISE , COVARIANCE , ENGINES , SIGNALS , ACCURACY , PROCESSING , OUTPUT , PROPAGATION , REPRINTS


Subject Categories : Computer Programming and Software


Distribution Statement : APPROVED FOR PUBLIC RELEASE