File: introExample44.tex

package info (click to toggle)
sollya 7.0%2Bds-3
  • links: PTS, VCS
  • area: main
  • in suites: bullseye, buster
  • size: 13,864 kB
  • sloc: ansic: 117,441; yacc: 8,822; lex: 2,419; makefile: 870; cpp: 76
file content (38 lines) | stat: -rw-r--r-- 1,238 bytes parent folder | download | duplicates (4)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
\begin{center}\begin{minipage}{15cm}\begin{Verbatim}[frame=single]
> prec = 24;
The precision has been set to 24 bits.
> a = 0.1;
Warning: Rounding occurred when converting the constant "0.1" to floating-point 
with 24 bits.
If safe computation is needed, try to increase the precision.
> b = 33554433;
> prec = 64;
The precision has been set to 64 bits.
> display = binary;
Display mode is binary numbers.
> a;
1.10011001100110011001101_2 * 2^(-4)
> 0.1;
Warning: Rounding occurred when converting the constant "0.1" to floating-point 
with 64 bits.
If safe computation is needed, try to increase the precision.
1.100110011001100110011001100110011001100110011001100110011001101_2 * 2^(-4)
> %24%0.1;
Warning: Rounding occurred when converting the constant "0.1" to floating-point 
with 24 bits.
If safe computation is needed, try to increase the precision.
1.10011001100110011001101_2 * 2^(-4)
> c = 33554433;
> b;
1.0000000000000000000000001_2 * 2^(25)
> c;
1.0000000000000000000000001_2 * 2^(25)
> %24%33554433;
Warning: Rounding occurred when converting the constant "33554433" to floating-p
oint with 24 bits.
If safe computation is needed, try to increase the precision.
1_2 * 2^(25)
> 
> 
\end{Verbatim}
\end{minipage}\end{center}