[Octave-bug-tracker] [bug #31872] mod/rem innacurate for non-integer real values

[Rik]

URL:
  <http://savannah.gnu.org/bugs/?31872>

                 Summary: mod/rem innacurate for non-integer real values
                 Project: GNU Octave
            Submitted by: rik5
            Submitted on: Mon 13 Dec 2010 08:48:07 PM PST
                Category: Interpreter
                Severity: 3 - Normal
                Priority: 5 - Normal
              Item Group: Incorrect Result
                  Status: None
             Assigned to: None
         Originator Name: 
        Originator Email: 
             Open/Closed: Open
         Discussion Lock: Any
                 Release: dev
        Operating System: GNU/Linux

    _______________________________________________________

Details:

There appears to be an implicit cast to 'single' in the calculation of
mod/rem for non-integer real values.


format long
mod (2.1, 0.2)
ans =  0.100000001490116
2.1 - 0.2*fix (2.1/0.2)
ans =  0.100000000000000
single(0.1)
ans =  0.100000001490116






    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?31872>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/