[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Axiom-developer] unit testing
From: |
Martin Rubey |
Subject: |
Re: [Axiom-developer] unit testing |
Date: |
22 Feb 2007 13:09:00 +0100 |
User-agent: |
Gnus/5.09 (Gnus v5.9.0) Emacs/21.4 |
Waldek Hebisch <address@hidden> writes:
> > Dear all,
> >
> > I'm discussing with Christian Aistleitner unit testing in Axiom, and I
> > wondered, how the regression tests are currently run. I only found the
> > .input
> > files, but cannot find any files containing the corresponding "should be"
> > output.
> >
> > Furthermore, how is "should be" and "is" currently compared?
> >
>
> The procedure I use for wh-sandbox is as follows. First, when a change
> is developed I use ad hoc methods to verify that the change is having
> intended effect typically going trough many iterations. When I am
> satisfied with change I do a full build and compare test output and
> generated .pht pages. For recent changes to algebra bootstrap and to
> interpreter (switch from boot to Shoe) I also compared generated Lisp.
Oh, I meant, results of computations using axiom...
> - big problem is how to find correct answer to compare with test result. For
> indefinite integrals we can just integrate derivatives. For definite
> integrals (and possibly some other expressions) we may compare numerical
> evaluation of symbolic result with result of numerical integration. Another
> possibility is are multi-CAS competitions: compare outputs of different
> systems.
Yes, that's what I have in mind - although, for the moment, static only. I.e.,
a rather large database of results, which are checked after a change in the
algebra is made
Martin