octave-bug-tracker
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #34893] conv2 produces different results for s


From: Sunghyun Cho
Subject: [Octave-bug-tracker] [bug #34893] conv2 produces different results for shape 'valid' depending on the orientation of matrix B
Date: Sun, 22 Apr 2012 02:54:43 +0000
User-agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.19 (KHTML, like Gecko) Chrome/18.0.1025.162 Safari/535.19

Follow-up Comment #14, bug #34893 (project octave):


Hi.
I took a look a little bit more.
It seems like *conv2o and *conv2i use different algorithms for computing
convolution.
*conv2o uses scattering, and *conv2i uses gathering, and this can result in
small difference in computation of floating-point numbers.
Hope this helps.


    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?34893>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/




reply via email to

[Prev in Thread] Current Thread [Next in Thread]