2 calculation algorithms, Calculation algorithms – Metrohm tiBase 1.1 User Manual
Page 26

2.4 Formula editor
■■■■■■■■■■■■■■■■■■■■■■
18
■■■■■■■■
tiBase 1.1
Round parentheses
Undo last action
Redo last action
Entry via selection
The element selected in the fields Variables or Operators can be added
to the formula by double clicking or [Insert].
2.4.2
Calculation algorithms
Dialog window: Formula editor
Numerical format
The standard IEEE 754 (1985) for binary floating point arithmetic is imple-
mented in "double precision" (64 Bit) in the software.
Rounding off process
Measured values and results are rounded off symmetrically (commercial
rounding). In so doing, 1, 2, 3, 4 are always rounded down and 5, 6, 7,
8, 9 always rounded up.
Examples
2.33 yields 2.3
2.35 yields 2.4
2.47 yields 2.5
-2.38 yields -2.4
-2.45 yields -2.5
Statistics
The mean value, absolute and relative standard deviation of results R are
calculated using the following formula: