[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
bc: Accuracy bug?
From: |
Rogier Wolff |
Subject: |
bc: Accuracy bug? |
Date: |
Sun, 15 Apr 2001 18:39:03 +0200 (MEST) |
Hi,
/home/wolff> bc -l
bc 1.03 (Nov 2, 1994)
Copyright (C) 1991, 1992, 1993, 1994 Free Software Foundation, Inc.
This is free software with ABSOLUTELY NO WARRANTY.
For details type `warranty'.
.3333333333*12
3.9999999996
.3333333334*12
4.0000000008
ibase=16
obase=10
.5555555555*C
3.FFFFFFFE4
.5555555556*C
3.FFFFFFFE4
.5555555566*C
3.FFFFFFFE4
.55555555666*C
4.0000000057
As far as I can see, the calculation of "scale" is slightly off (by
nearly two digits!) when in "HEX" mode.
Note that I don't see this with 1/x * x ...
Roger.
--
** address@hidden ** http://www.BitWizard.nl/ ** +31-15-2137555 **
*-- BitWizard writes Linux device drivers for any device you may have! --*
* There are old pilots, and there are bold pilots.
* There are also old, bald pilots.
- bc: Accuracy bug?,
Rogier Wolff <=