Re: Tests (Was: Classpath post from address@hidden requires approval)

[Mark Wielaard]

Hi Thomas,

On Thu, 2004-03-25 at 21:40, Thomas Zander wrote:
> On Thursday 25 March 2004 19:44, Mark Wielaard wrote:
> > Writing tests and documentation is fine. And really appreciated!
> ...
> > If you would like to help with testing then please check out the Mauve
> > project which we use for much of our testing purposes.
> > http://sources.redhat.com/mauve/
> 
> I downloaded the snapshot and got it running; I'll try to find out how this 
> works and see what I can add. Thanx.
> First impression was a bit strange; 70195 of 3581269 tests failed on Suns 
> JDK 1.4.2_02...
> seems like lots of tests copy-pasted but not finished.

There is one gigantic test that is currently bogus.
java.lang.Character.unicode It was written for an older Unicode version
then current java standards dictate (and it tests every unicode char,
which explains the millions of tests...) Sorry about that.

Attached is a little analysis of the tests that currently FAIL with
Classpath CVS and JamVM 1.1.2-pre (which I hope Robert will finalize and
release today). With KEYS set as in the run_batch script
# Include every key/tag we can think of but always exclude the unicode test.
KEYS="JDK1.0 JDK1.1 JDK1.2 JDK1.3 JDK1.4 JLS1.0 JLS1.2 JDBC1.0 JDBC2.0 JAVA2"
KEYS="$KEYS !java.lang.Character.unicode"
(This gives 13317 PASS and 213 FAIL.)

The analysis isn't really complete since I haven't gone very deep into
some of the FAILs. If someone knows more about a particular FAILure
please write to the list about it. I would also love to see other
analysis of the mauve PASSes/FAILures against other VM/library
combinations.

> > Also taking an existing free program written in the java language and
> > trying to make it work with gcj, kaffe or another VM based on classpath
> > is really appreciated.
> Hmm; my projects use lots of Swing code; so that seems like a no-go idea 
> for some time to come..

It might be interesting to know what parts of Swing you need. That would
give people hints what to concentrate on (Swing is large and although we
do make progress there, thanks to the libgcj hackers!, we still have to
pick and choose what is important to work on first.
(Although another option is rewriting the GUI using java-gnome.)

> Is the Apache licence considered Free for you guys (I'm really an open 
> source programmer, not a free-software one..).

Yes, it certainly is a Free Software license.
But it is currently not compatible with the GPL.
So creating a derived larger work of some GPLed and Apache licensed code
is not distributable (since there are some restrictions with respect to
patent licensing that are not allowed by the GPL).

See the comments about the Apache license at:
http://www.gnu.org/licenses/license-list.html
And the analysis of the incompatibility at:
http://www.apache.org/licenses/GPL-compatibility.html

The good news is that the FSF and the Apache Foundation are in talks
about resolving the above issues. But that might take a long time
unfortunately. Till it is resolved however we don't really recommend
releasing and/or combining larger works under the Apache license.

> When I have some time (yeah-right!) I'll try to get my pet-project 
> http://uic.sf.net running. But this requires to setup something like 
> kaffe; I'll see how well this is apt-gettable..

If you run Debian unstable then your choice of kaffe will be a good one.
There is a lot of interactivity now between some of the Debian kaffe
maintainers and some of the Kaffe hackers (hang out on #kaffe at
irc.gnu.org to see what I mean).

> > On the documentation front we are missing a good overview document.
> Something like this?:
>   You never heard of Suns Java; then here is the documentation that
>   introduces you to Java! The Free libraries provided in Gnu Classpath
>   can be used as an extensive library to allow any task to be programmed
>   in Java.
>   As the Gnu Classpath is just a library for the Java language, you will
>   want to have a application which can run Java code (called a Runtime
>   Environment), as well as a compiler to compile your code to be run by
>   anyone that has a Runtime Environment installed as well.
> etc.

Yes. Although I would like to see something a bit more concrete. "Here
is a runtime environment that I tried and is known to work. This is how
you install it on the following free system..."
See also the "Documenting Programs" section in the GNU Coding Standards:
http://www.gnu.org/prep/standards_32.html#SEC32

> > We do already have some nice API documentation (although it can
> > certainly use more attention for some packages/classes):
> > http://www.klomp.org/mark/classpath/doc/api/html/
> 
> Editing this is done by editing the sources?

Yes. And then using gjdoc to produce either info, xml or html files.
gjdoc isn't very friendly to setup currently though. But there is a
little description in the FAQ about it:
http://www.gnu.org/software/classpath/faq/faq.html#faq5_1

> So checking out the sources and posting a diff will allow me to send you 
> updates/fixes etc.

Yes.

> What about images?

Sadly gjdoc doesn't work with images currently.
Although we always hope someone adds that support. Hint :)

> I suggested to the Sun people at one time that things 
> like the rotate(double rad) should have an image which displays the 
> rotation.  This is needed since the Graphics object has a coordinate 
> system which is opposite to the one you learned in math school..  
> Classical programmers mistake (which IMO means bad docu)

That would be a very nice addition!
(And it would hopefully inspire someone to add image support to gjdoc.)

Thanks for your interest in GNU Classpath!

Cheers,

Mark

grep FAIL jamvm-1.1.2.results+inner_acces+hci+bcp+tccl+afa+caload
(That is all my patches applied plus your OP_CALOAD fix) gives:

FAIL: gnu.testlet.java.io.PrintStream.subclass (number 1)
- Classpath bug.

FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Surrogate Pairs (number 1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Surrogate Pairs (number 2)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Surrogate Pairs (number 3)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Surrogate Pairs (number 4)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Four Byte Range Error (0) (number 
1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Four Byte Range Error (1) (number 
1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Five Bytes (0) (number 1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Five Bytes (1) (number 1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Six Bytes (0) (number 1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Six Bytes (1) (number 1)
FAIL: gnu.testlet.java.io.Utf8Encoding.mojo: Four Byte Range Error (2) (number 
1)
- Believed to be unicode/character testsuite mixups.

FAIL: gnu.testlet.java.io.File.security: dir.canWrite - unexpected exception 
(number 1)
FAIL: gnu.testlet.java.io.File.security: createTempFile(2-args) - unexpected 
exception (number 1)
FAIL: gnu.testlet.java.io.File.security: createTempFile(3-args) - unexpected 
exception (number 1)
FAIL: gnu.testlet.java.io.File.security: dir.setReadOnly - unexpected exception 
(number 1)
FAIL: gnu.testlet.java.io.File.security: file.renameTo (number 1)
- Probably testsuite strangeness

FAIL: gnu.testlet.java.io.ObjectInputOutput.InputTest: 
gnu.testlet.java.io.ObjectInputOutput.Test$CallDefault (number 1)
FAIL: gnu.testlet.java.io.ObjectInputOutput.InputTest: 
gnu.testlet.java.io.ObjectInputOutput.Test$NoCallDefault (number 1)
FAIL: gnu.testlet.java.io.ObjectInputOutput.InputTest: 
gnu.testlet.java.io.ObjectInputOutput.Test$GetPutField (number 1)
FAIL: gnu.testlet.java.io.ObjectInputOutput.InputTest: 
gnu.testlet.java.io.ObjectInputOutput.Test$GetPutField (number 2)
FAIL: gnu.testlet.java.io.ObjectInputOutput.OutputTest: 
gnu.testlet.java.io.ObjectInputOutput.Test$CallDefault (number 1)
FAIL: gnu.testlet.java.io.ObjectInputOutput.OutputTest: 
gnu.testlet.java.io.ObjectInputOutput.Test$NoCallDefault (number 1)
FAIL: gnu.testlet.java.io.ObjectInputOutput.OutputTest: Serializable: 
test(str=null, x=0) (number 2)
FAIL: gnu.testlet.java.io.ObjectInputOutput.Compat1: Compatibility test for 
BigInteger (number 2)
FAIL: gnu.testlet.java.io.ObjectInputOutput.Compat1: Compatibility test for 
BigInteger (number 3)
FAIL: gnu.testlet.java.io.ObjectInputOutput.Compat2: Compatibility test for 
type mismatch when calling get methods (number 2)
FAIL: gnu.testlet.java.io.ObjectInputOutput.Compat2: Compatibility test for 
type mismatch when calling get methods (number 3)
- Serialization issues, pending Method.invoke thingy on JNI AllocObject
  + readObject().

FAIL: gnu.testlet.java.io.FileReader.jdk11: Can't open file 'choices' (number 1)
FAIL: gnu.testlet.java.io.FileReader.jdk11: Can't open file 'choices' (number 1)
- Probably Testsuite bloopers.

FAIL: gnu.testlet.java.io.OutputStreamWriter.jdk11: null encoding after close 
(number 1)
FAIL: gnu.testlet.java.io.OutputStreamWriter.jdk11: OutputStreamWriter(writer, 
encoding) (number 1)
FAIL: gnu.testlet.java.io.OutputStreamWriter.jdk11: OutputStreamWriter(writer, 
encoding) // alias (number 1)
- Unanalyzed.

FAIL: gnu.testlet.java.io.PrintWriter.checkError (number 3)
- Known Classpath bug.

FAIL: gnu.testlet.java.lang.Thread.stop: ThreadDeath properly thrown and caught 
(number 1)
FAIL: gnu.testlet.java.lang.Thread.stop: Initial thread count matches stopped 
thread count (number 1)
FAIL: gnu.testlet.java.lang.Thread.stop: Stopped thread has null thread group 
(number 1)
FAIL: gnu.testlet.java.lang.Thread.daemon: Can change daemon state on an 
exitted Thread (number 1)
FAIL: gnu.testlet.java.lang.Thread.daemon: Daemon status changed when set on an 
exitted Thread (number 1)
- Unanalyzed, but believed to be Classpath/VM-reference class bugs.

FAIL: gnu.testlet.java.lang.Character.classify12 (number 1)
FAIL: gnu.testlet.java.lang.Character.getType (number 11)
FAIL: gnu.testlet.java.lang.Character.getType (number 20)
FAIL: gnu.testlet.java.lang.Character.getType (number 22)
- Most probably old unicode tests that are no longer valid.

FAIL: gnu.testlet.java.lang.Double.DoubleTest: Error: test_intValue returned 
wrong results CYGNUS: Float to int conversions - 1 (number 1)
FAIL: gnu.testlet.java.lang.Double.DoubleTest: Error: test_longValue returned 
wrong results CYGNUS: Float to int conversions - 1 (number 1)
FAIL: gnu.testlet.java.lang.Float.FloatTest: Error: test_intValue returned 
wrong results - 1 (number 1)
- This are similar to the DT.java (float/double VM conversion failures) tests I 
send.

FAIL: gnu.testlet.java.lang.Math.MathTest: Error : test_pow failed - 9 (number 
1)
FAIL: gnu.testlet.java.lang.Math.MathTest: Error :  test_round failed - 5 
(number 1)
FAIL: gnu.testlet.java.lang.Math.MathTest: Error :  test_round failed - 7 
(number 1)
FAIL: gnu.testlet.java.lang.Math.sin (number 1)
- Unanalyzed. These could be real bugs either in the VM or in the Classpath 
implementation.

FAIL: gnu.testlet.java.lang.String.surrogate (number 1)
FAIL: gnu.testlet.java.lang.String.surrogate (number 2)
FAIL: gnu.testlet.java.lang.String.surrogate (number 3)
FAIL: gnu.testlet.java.lang.String.surrogate (number 4)
FAIL: gnu.testlet.java.lang.String.surrogate (number 5)
FAIL: gnu.testlet.java.lang.String.surrogate: uncaught exception at  number 6
- Classpath bug.

FAIL: gnu.testlet.java.lang.String.getBytes13: String.getBytes("ASCII") (number 
1)
FAIL: gnu.testlet.java.lang.String.getBytes13: String.getBytes("Cp1252") 
(number 1)
FAIL: gnu.testlet.java.lang.String.getBytes13: String.getBytes("UTF-16") 
(number 1)
FAIL: gnu.testlet.java.lang.String.getBytes13: String.getBytes("UnicodeBig") 
(number 1)
FAIL: gnu.testlet.java.lang.String.getBytes13: 
String.getBytes("UnicodeBigUnmarked") (number 1)
FAIL: gnu.testlet.java.lang.String.getBytes13: String.getBytes("UnicodeLittle") 
(number 1)
FAIL: gnu.testlet.java.lang.String.getBytes13: 
String.getBytes("UnicodeLittleUnmarked") (number 1)
FAIL: gnu.testlet.java.lang.String.getBytes14: String.getBytes("US-ASCII") 
(number 1)
FAIL: gnu.testlet.java.lang.String.getBytes14: String.getBytes("windows-1252") 
(number 1)
FAIL: gnu.testlet.java.lang.String.getBytes14: String.getBytes("ISO-8859-15") 
(number 1)
FAIL: gnu.testlet.java.lang.String.getBytes14: String.getBytes("ISO8859_15") 
(number 1)
FAIL: gnu.testlet.java.lang.String.getBytes14: String.getBytes("UTF-16BE") 
(number 1)
FAIL: gnu.testlet.java.lang.String.getBytes14: String.getBytes("UTF-16LE") 
(number 1)
- Probably partly Classpath bugs. We need to setup all aliases correctly.
  But we probably also don't have all the above encodings yet.

FAIL: gnu.testlet.java.lang.ref.PhantomReference.phantom: unreachable (number 1)
FAIL: gnu.testlet.java.lang.ref.PhantomReference.phantom: object finalized 
(number 1)
FAIL: gnu.testlet.java.lang.ref.WeakReference.weakref: unreachable (number 1)
FAIL: gnu.testlet.java.lang.ref.WeakReference.weakref: contents of weak 
reference (number 1)
- Unknown. Probably Testsuite + VM problems. Not sure how to accurately test 
this.

FAIL: gnu.testlet.java.lang.reflect.Array.newInstance: multi-dimensional 
(number 5)
- You claim to have fixed this one. (Common VM bug when multianewarray is
  implemented recursively.)

FAIL: gnu.testlet.java.lang.reflect.Method.toString (number 2)
FAIL: gnu.testlet.java.lang.reflect.Method.toString: method with multiple array 
dims in argument (number 1)
- Classpath bug.

FAIL: gnu.testlet.java.lang.reflect.ReflectAccess: static void gnu.testlet. 
java.lang.reflect.sub.OtherPkg.g() should not be accessible (number 1)
FAIL: gnu.testlet.java.lang.reflect.ReflectAccess:  void 
gnu.testlet.java.lang.reflect.sub.OtherPkg.h() should not be accessible (number 
1)
FAIL: gnu.testlet.java.lang.reflect.ReflectAccess: protected void 
gnu.testlet.java.lang.reflect.sub.OtherPkg.i() should not be accessible (number 
1)
FAIL: gnu.testlet.java.lang.reflect.ReflectAccess: static char gnu.testlet. 
java.lang.reflect.sub.OtherPkg.j should not be accessible (number 1)
FAIL: gnu.testlet.java.lang.reflect.ReflectAccess:  char 
gnu.testlet.java.lang.reflect.sub.OtherPkg.k should not be accessible (number 1)
FAIL: gnu.testlet.java.lang.reflect.ReflectAccess: protected char 
gnu.testlet.java.lang.reflect.sub.OtherPkg.l should not be accessible (number 1)
FAIL: gnu.testlet.java.lang.reflect.ReflectAccess: private final void 
gnu.testlet.java.lang.reflect.Other.o() should not be accessible (number 1)
FAIL: gnu.testlet.java.lang.reflect.ReflectAccess: private char 
gnu.testlet.java.lang.reflect.Other.r should not be accessible (number 1)
FAIL: gnu.testlet.java.lang.reflect.ReflectAccess:  void 
gnu.testlet.java.lang.reflect.sub.Super.s() should not be accessible (number 1)
FAIL: gnu.testlet.java.lang.reflect.ReflectAccess: private final void 
gnu.testlet.java.lang.reflect.sub.Super.v() should not be accessible (number 1)
FAIL: gnu.testlet.java.lang.reflect.ReflectAccess: static char gnu.testlet. 
java.lang.reflect.sub.Super.y should not be accessible (number 1)
FAIL: gnu.testlet.java.lang.reflect.ReflectAccess: private char 
gnu.testlet.java.lang.reflect.sub.Super.z should not be accessible (number 1)
- Not analyzed yet.

FAIL: gnu.testlet.java.net.DatagramPacket.DatagramPacketReceive2: 
DatagramPacket receive Test B errorCount=15 (number 1)
FAIL: gnu.testlet.java.net.DatagramSocket.DatagramSocketTest abnormal 
termination 142 CRASH or TIMEOUT
FAIL: gnu.testlet.java.net.DatagramSocket.DatagramSocketTest2: uncaught 
exception at "invalid_port" number 1
FAIL: gnu.testlet.java.net.MulticastSocket.MulticastSocketTest: 
joinGroup()twice. (number 1)
FAIL: gnu.testlet.java.net.Socket.SocketTest: Error : test_params failed - 2 
get /set timeout did not return proper values (number 1)
FAIL: gnu.testlet.java.net.Socket.SocketTest: Error : test_params failed - 4 
(number 1)
FAIL: gnu.testlet.java.net.Socket.SocketTest: Error : test_params failed - 5 
(number 1)
FAIL: gnu.testlet.java.net.Socket.SocketTest: Error : BasicSocketServer::run 
failed - 2exception was thrown: java.io.IOException: Internal error: 
_javanet_accept():  (number 1)
FAIL: gnu.testlet.java.net.Socket.SocketTest: Error : test_BasicServer failed - 
11 exception was thrown. (number 1)
FAIL: gnu.testlet.java.net.URL.URLTest: getContent() threw Exception (number 1)
FAIL: gnu.testlet.java.net.URL.URLTest:  Error in test_toString  - 5  exception 
should not be thrown here (number 1)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 1)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 2)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 3)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 7)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 10)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 11)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 12)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 19)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 20)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 21)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 25)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 31)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 33)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 34)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 37)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 40)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 42)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 43)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 46)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 1)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 5)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 9)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 
13)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 
21)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 
29)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 
33)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 
37)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 
41)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 
49)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 
57)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 
61)
FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 
65)
FAIL: gnu.testlet.java.net.URLConnection.URLConnectionTest: Error in 
test_getContentFunctions  - 5  should not have raised  exception here  (number 
1)
FAIL: gnu.testlet.java.net.URLConnection.URLConnectionTest: Error in 
test_getHeaderField  - 2  4 header field wrong (number 1)
FAIL: gnu.testlet.java.net.URLConnection.URLConnectionTest: Error in 
test_URLConnection  - 23  should not have raised  exception here  (number 1)
FAIL: gnu.testlet.java.net.InetSocketAddress.InetSocketAddressTest: Error : 
test_Basics failed - 5 Resolveable hostname got not resolved (number 1)
- All java.net tests are a bit flaky... :{

FAIL: gnu.testlet.java.text.DateFormatSymbols.Test: invalid locale (number 1)
FAIL: gnu.testlet.java.text.DecimalFormat.format: pattern #.# (number 2)
FAIL: gnu.testlet.java.text.DecimalFormat.parse: pattern 0.0000E0 (number 2)
FAIL: gnu.testlet.java.text.DecimalFormat.formatExp: pattern ##0.####E0 (number 
2)
FAIL: gnu.testlet.java.text.DecimalFormat.formatExp: pattern ##.###E0 (number 2)
FAIL: gnu.testlet.java.text.DecimalFormatSymbols.serial (number 1)
FAIL: gnu.testlet.java.text.DecimalFormatSymbols.serial (number 2)
FAIL: gnu.testlet.java.text.DecimalFormatSymbols.serial (number 3)
FAIL: gnu.testlet.java.text.RuleBasedCollator.jdk11: expansion ordering (number 
56)
FAIL: gnu.testlet.java.text.RuleBasedCollator.jdk11: expansion ordering (number 
57)
FAIL: gnu.testlet.java.text.RuleBasedCollator.jdk11: expansion ordering (number 
76)
FAIL: gnu.testlet.java.text.RuleBasedCollator.jdk11: expansion ordering (number 
77)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: next() 3 test 
string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: no primary 
difference 3 test string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: next() 5 test 
string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: no primary 
difference 5 test string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: next() 6 test 
string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: no primary 
difference 6 test string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: next() 8 test 
string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: no primary 
difference 8 test string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: next() 9 test 
string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: no primary 
difference 9 test string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: next() 11 test 
string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: no primary 
difference 11 test string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: next() 13 test 
string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: no primary 
difference 13 test string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: next() 14 test 
string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: no primary 
difference 14 test string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: next() 21 test 
string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: no primary 
difference 21 test string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: next() 22 test 
string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: no primary 
difference 22 test string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: next() 25 test 
string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: no primary 
difference 25 test string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: next() 26 test 
string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: no primary 
difference 26 test string #4 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: next() 2 test 
string #5 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: no tertiary 
difference2 test string #5 (number 1)
FAIL: gnu.testlet.java.text.CollationElementIterator.jdk11: not tertiary 
ordered0, 2 test set #0 (number 1)
- Believed to be Classpath and/or Testsuite problems.

FAIL: gnu.testlet.java.util.ArrayList.serial (number 1)
FAIL: gnu.testlet.java.util.ArrayList.serial (number 2)
- More serialization issues. (Probably issue with jamvm Method.invoke again...)

FAIL: gnu.testlet.java.util.Properties.AcuniaPropertiesTest: checkvalue --  
got:$ents=$ (number 1)
FAIL: gnu.testlet.java.util.Properties.AcuniaPropertiesTest: check if all 
elements were found -- got: [!comment=, #morec=omments] (number 1)
- Classpath bug (should be fixed now in CVS).

FAIL: gnu.testlet.java.util.regex.PatternSplit: test: (?=[a-z]) (number 1)
- Classpath bug.

FAIL: gnu.testlet.java.util.logging.Logger.getAnonymousLogger: uncaught 
exception at  number 8
FAIL: gnu.testlet.java.util.logging.Logger.getLogger: uncaught exception at 
number 8
FAIL: gnu.testlet.java.util.logging.Logger.hierarchyChecks: uncaught exception 
at  number 1
FAIL: gnu.testlet.java.util.logging.Logger.securityChecks: 
Logger.getAnonymousLogger() (number 7)
FAIL: gnu.testlet.java.util.logging.Logger.securityChecks: 
Logger.getAnonymousLogger(null) (number 7)
FAIL: gnu.testlet.java.util.logging.SocketHandler.getFilter: uncaught exception 
at  number 1
FAIL: gnu.testlet.java.util.logging.SocketHandler.getFormatter: uncaught 
exception at  number 1
FAIL: gnu.testlet.java.util.logging.SocketHandler.publish: uncaught exception 
at  number 1
FAIL: gnu.testlet.java.util.logging.XMLFormatter.formatMessage (number 2)
FAIL: gnu.testlet.java.util.logging.XMLFormatter.formatMessage (number 3)
FAIL: gnu.testlet.java.util.logging.XMLFormatter.formatMessage (number 4)
FAIL: gnu.testlet.java.util.logging.XMLFormatter.formatMessage (number 5)
FAIL: gnu.testlet.java.util.logging.XMLFormatter.formatMessage (number 6)
FAIL: gnu.testlet.java.util.logging.XMLFormatter.getHead: no encoding set 
(number 1)
- Unknown. Have to ask Sascha.

FAIL: gnu.testlet.java.awt.geom.QuadCurve2D.subdivide: array (number 1)
FAIL: gnu.testlet.java.awt.geom.QuadCurve2D.subdivide: array (number 3)
FAIL: gnu.testlet.java.awt.geom.QuadCurve2D.subdivide: array (number 4)
FAIL: gnu.testlet.java.awt.geom.CubicCurve2D.subdivide: array (number 1)
FAIL: gnu.testlet.java.awt.geom.CubicCurve2D.subdivide: array (number 3)
FAIL: gnu.testlet.java.awt.geom.CubicCurve2D.subdivide: array (number 4)
FAIL: gnu.testlet.java.awt.geom.RoundRectangle2D.intersects (number 10)
FAIL: gnu.testlet.java.awt.geom.RoundRectangle2D.intersects (number 11)
FAIL: gnu.testlet.java.awt.geom.RoundRectangle2D.intersects (number 12)
FAIL: gnu.testlet.java.awt.geom.RoundRectangle2D.intersects (number 16)
FAIL: gnu.testlet.java.awt.geom.RoundRectangle2D.intersects (number 20)
FAIL: gnu.testlet.java.awt.geom.RoundRectangle2D.intersects (number 23)
FAIL: gnu.testlet.java.awt.geom.RoundRectangle2D.intersects (number 27)
FAIL: gnu.testlet.java.awt.geom.RoundRectangle2D.intersects (number 30)
FAIL: gnu.testlet.java.awt.geom.RoundRectangle2D.intersects (number 34)
FAIL: gnu.testlet.java.awt.geom.RoundRectangle2D.intersects (number 38)
FAIL: gnu.testlet.java.awt.geom.RoundRectangle2D.intersects (number 39)
FAIL: gnu.testlet.java.awt.geom.RoundRectangle2D.intersects (number 40)
- Believed to be known Classpath bugs.

FAIL: gnu.testlet.java.awt.image.PixelGrabber.SimpleGrabber abnormal 
termination 139 CRASH or TIMEOUT
- Classpath bug - GTK peers crash.

FAIL: gnu.testlet.BinaryCompatibility.BinaryCompatibilityTest (number 1)
- Ignore this for now. Testuite weirdness.

signature.asc
Description: This is a digitally signed message part