Re: [Chicken-users] need regex benchmark

[Tobia Conforto]

Alex Shinn wrote:
> Tobia Conforto writes:
> > The file perltestdata in Edi Weitz's cl-ppcre contains a big PCRE  
> > stress test (15,000 tests) already formatted for lisp.
>
> What Felix is looking for, however, is a benchmark.

What's wrong with repeating 1000 times each of those test cases, at  
least the ones that are not supposed to fail, and record the CPU time  
used?

Then you can compare two different engines and get both their average  
speed, and which of the test cases are much faster/slower in one with  
respect to the other.  That should give you enough hints as to what to  
expect from the libraries, or what to improve in yours ;-)

Regexes are used for so many different purposes, that such a benchmark  
on 15,000 test cases IMHO is as "realistic" as it can get.

If, on the other hand, one wants to optimize a particular application  
on some kind of "standard" input data, then it's a different matter: I  
would do a test run of the application, recording every invocation of  
the regex library, and start from there.


Tobia