Published December 1993 | Version v1
Report Open

Numerical precision and roundoff considerations concerning computer code migration

Description

Code conversion between different computer platforms may not be as straightforward or as simple as some people might think. When migrating computer codes between different computers, thought must be given to the importance of numerical precision. Some applications require greater numerical precision than others. Cray architecture treats floating-point numbers and operations as double precision compared to most other platforms, many of which are based on a 32-bit architecture. In some systems, only 32-bit compilers are available, even though the hardware is 64 bit. The default floating-point representation on the Cray is 15-place accuracy, as compared to 8 places on most workstations. Some applications do not inherently require accuracy to the 15th decimal place. Examples in nuclear engineering include Monte Carlo simulations, where numerical round-off error generated in the tracking of one neutron does not propagate seriously to neutrons in succeeding generations. Other applications, particularly time-dependent simulations, are susceptible to the cumulative effects of round-off errors. In addition, multidimensional transient simulations require an iterative solution methodology, whether the simulation is of groundwater contamination, space-time nuclear kinetics, fluid flow, or chemical migration. This paper will at least partially address the concerns of numerical precision by illustrating by example what differences in precision can do to the running of a simulation

Availability note (English)

MF available from INIS under the Report Number; Also available from OSTI as DE94005421; NTIS; US Govt. Printing Office Dep.

Files

25041018.pdf

Files (618.4 kB)

Name Size Download all
md5:615c9f454af3f82b4161659707c73c5d
618.4 kB Preview Download

Additional details

Publishing Information

Imprint Pagination
9 p.
Report number
WHC-SA--2178

Conference

Title
Simulation multi conference.
Dates
11-15 Apr 1994.
Place
San Diego, CA (United States).

INIS

Country of Publication
United States
Country of Input or Organization
United States
INIS RN
25041018
Subject category
S99: GENERAL AND MISCELLANEOUS;
Resource subtype / Literary indicator
Conference
Descriptors DEI
ACCURACY; COMPUTER CODES; COMPUTERIZED SIMULATION; CONVERGENCE; SERIES EXPANSION; TIME DEPENDENCE
Descriptors DEC
SIMULATION

Optional Information

Contract/Grant/Project number
Contract AC06-87RL10930
Funding organization
USDOE, Washington, DC (United States).
Secondary number(s)
CONF-940456--6.