Re: [Bug-gnubg] Gnubg's Cache and Plies > 3 - problem?

[Michael Petch]

On 01/09/09 12:29 PM, "Jonathan Kinsey" <address@hidden> wrote:

> I've checked this in.


Post mortem: There is a significant improvement, and this change is a step in the right direction! However, there is still some work/investigation to do.

My GnuBG uses an evaluation setting of “Supremo for Checker” and “World Class for Checker” with all the default options for that configuration. When I do 4 ply analysis from the GUI I up the plies from 2 to 4 for  both cube and checkers. I mention this in the event that people wish to reproduce this. 

With that being said I generally use the command line version of Gnubg on Linux (with –t option) and run test scripts. I’m using Linux on an Intel Dual QuadCore (Debian Lenny Stable). For these tests I used full –O3 optimizations and enabled SSE2 and enabled threads. Code was a CVS checkout after Jon committed the changes.

Previously we would get output as described here when a large cache was used:

http://www.bgonline.org/forums/webbbs_config.pl?noframes;read=47575
http://www.bgonline.org/forums/webbbs_config.pl?noframes;read=47533

The data we get now is below. Clearly there is a big improvement when cache=4194304 (Whether pruned or not) over the results at the link above.  The values seem as if they aren’t just regurgitated 0ply masquerading as 4ply (At least not in the obvious scenarios). Although the results look good, thing get a bit uglier when you look at the cache=0 entries. Everything being equal (The results can be reproduced, the output seems deterministic) - Cached evals <> No Caching Evals.

I haven’t provided the output, but I ran 0,1,2,3 plies (Same filter and other settings). In those instances Cache Evals = No Cached evals, which leads me to believe we still have an issue with plies >3  with caching that hasn’t been discovered. I will look at the code more tonight and if I see anything I’ll let people know.  My guess is we have missed something small somewhere (I hope).

Thanks for the work to this point Jon!

----------------------

PRUNING OFF (Cache = 4194304 Entries):

Setting GNUBG id 1a4pwABsd7YAAA:EYERADAAAAAA
(gnubg) hint
    1. Cubeful 4-ply    10/6 4/1                     Eq.:  +0.550861
       0.806520 0.004686 0.000000 - 0.193480 0.001081 0.000000
        4-ply cubeful
    2. Cubeful 4-ply    10/6 5/2                     Eq.:  +0.548238 ( -0.002623)
       0.805572 0.003914 0.000000 - 0.194428 0.000714 0.000000
        4-ply cubeful
    3. Cubeful 4-ply    10/3                         Eq.:  +0.528942 ( -0.021919)
       0.797292 0.004050 0.000000 - 0.202708 0.000773 0.000000
        4-ply cubeful
    4. Cubeful 4-ply    6/2 5/2                      Eq.:  +0.383369 ( -0.167492)
       0.732130 0.015411 0.000000 - 0.267870 0.005099 0.000127
        4-ply cubeful
    5. Cubeful 4-ply    10/6 9/6                     Eq.:  +0.375597 ( -0.175265)
       0.728159 0.015202 0.000000 - 0.271841 0.003498 0.000000
        4-ply cubeful
    6. Cubeful 4-ply    9/6 9/5                      Eq.:  +0.349527 ( -0.201335)
       0.715965 0.020125 0.000000 - 0.284035 0.005783 0.000174
        4-ply cubeful
    7. Cubeful 2-ply    6/3 5/1                      Eq.:  +0.511787 ( -0.039074)
       0.788510 0.010323 0.000217 - 0.211490 0.004915 0.000156
        2-ply cubeful
    8. Cubeful 2-ply    10/6 8/5                     Eq.:  +0.510642 ( -0.040219)
       0.788452 0.009162 0.000403 - 0.211548 0.002479 0.000056
        2-ply cubeful
    9. Cubeful 2-ply    9/2                          Eq.:  +0.509073 ( -0.041788)
       0.786207 0.015394 0.000601 - 0.213793 0.008581 0.000233
        2-ply cubeful
   10. Cubeful 2-ply    8/5 8/4                      Eq.:  +0.499145 ( -0.051716)
       0.782590 0.010395 0.000255 - 0.217410 0.003147 0.000071
        2-ply cubeful


PRUNING ON (Cache = 4194304 Entries):

Setting GNUBG id 1a4pwABsd7YAAA:EYERADAAAAAA
(gnubg) hint
    1. Cubeful 4-ply    10/6 5/2                     Eq.:  +0.558395
       0.809966 0.001843 0.000000 - 0.190034 0.000240 0.000001
        4-ply cubeful prune
    2. Cubeful 4-ply    10/3                         Eq.:  +0.555309 ( -0.003086)
       0.808654 0.001924 0.000000 - 0.191346 0.000273 0.000001
        4-ply cubeful prune
    3. Cubeful 4-ply    10/6 4/1                     Eq.:  +0.551376 ( -0.007019)
       0.806997 0.001966 0.000003 - 0.193003 0.000421 0.000008
        4-ply cubeful prune
    4. Cubeful 4-ply    9/6 9/5                      Eq.:  +0.540817 ( -0.017578)
       0.800311 0.009391 0.000385 - 0.199689 0.002403 0.000074
        4-ply cubeful prune
    5. Cubeful 4-ply    10/6 9/6                     Eq.:  +0.535377 ( -0.023018)
       0.798171 0.009679 0.000819 - 0.201829 0.003600 0.000133
        4-ply cubeful prune
    6. Cubeful 4-ply    10/6 8/5                     Eq.:  +0.518103 ( -0.040292)
       0.791480 0.008408 0.000439 - 0.208520 0.002432 0.000063
        4-ply cubeful prune
    7. Cubeful 2-ply    6/2 5/2                      Eq.:  +0.515210 ( -0.043185)
       0.788854 0.012530 0.000272 - 0.211146 0.003212 0.000065
        2-ply cubeful prune [world class]
    8. Cubeful 2-ply    6/3 5/1                      Eq.:  +0.510872 ( -0.047523)
       0.788168 0.010213 0.000217 - 0.211832 0.004918 0.000158
        2-ply cubeful prune [world class]
    9. Cubeful 2-ply    9/2                          Eq.:  +0.509888 ( -0.048507)
       0.786479 0.015650 0.000602 - 0.213521 0.008656 0.000237
        2-ply cubeful prune [world class]
   10. Cubeful 2-ply    8/5 8/4                      Eq.:  +0.499926 ( -0.058469)
       0.782833 0.010552 0.000255 - 0.217167 0.003093 0.000068
        2-ply cubeful prune [world class]


PRUNING OFF (No Cache):

Setting GNUBG id 1a4pwABsd7YAAA:EYERADAAAAAA
(gnubg) hint
    1. Cubeful 4-ply    10/6 5/2                     Eq.:  +0.559584
       0.810446 0.001882 0.000000 - 0.189554 0.000220 0.000000
        4-ply cubeful
    2. Cubeful 4-ply    10/3                         Eq.:  +0.557987 ( -0.001597)
       0.809740 0.002051 0.000000 - 0.190260 0.000256 0.000001
        4-ply cubeful
    3. Cubeful 4-ply    10/6 4/1                     Eq.:  +0.551984 ( -0.007600)
       0.807208 0.002109 0.000004 - 0.192792 0.000449 0.000010
        4-ply cubeful
    4. Cubeful 4-ply    9/6 9/5                      Eq.:  +0.539309 ( -0.020275)
       0.799705 0.009315 0.000382 - 0.200295 0.002489 0.000076
        4-ply cubeful
    5. Cubeful 4-ply    10/6 9/6                     Eq.:  +0.538872 ( -0.020712)
       0.800018 0.008501 0.000663 - 0.199982 0.002921 0.000096
        4-ply cubeful
    6. Cubeful 4-ply    6/2 5/2                      Eq.:  +0.515758 ( -0.043826)
       0.788591 0.012823 0.000473 - 0.211409 0.002882 0.000067
        4-ply cubeful
    7. Cubeful 2-ply    6/3 5/1                      Eq.:  +0.511787 ( -0.047797)
       0.788510 0.010323 0.000217 - 0.211490 0.004915 0.000156
        2-ply cubeful
    8. Cubeful 2-ply    10/6 8/5                     Eq.:  +0.510642 ( -0.048942)
       0.788452 0.009162 0.000403 - 0.211548 0.002479 0.000056
        2-ply cubeful
    9. Cubeful 2-ply    9/2                          Eq.:  +0.509073 ( -0.050511)
       0.786207 0.015394 0.000601 - 0.213793 0.008581 0.000233
        2-ply cubeful
   10. Cubeful 2-ply    8/5 8/4                      Eq.:  +0.499145 ( -0.060439)
       0.782590 0.010395 0.000255 - 0.217410 0.003147 0.000071
        2-ply cubeful

PRUNING ON (No Cache):

    1. Cubeful 4-ply    10/6 5/2                     Eq.:  +0.558395
       0.809966 0.001843 0.000000 - 0.190034 0.000240 0.000001
        4-ply cubeful prune
    2. Cubeful 4-ply    10/3                         Eq.:  +0.555309 ( -0.003086)
       0.808654 0.001924 0.000000 - 0.191346 0.000273 0.000001
        4-ply cubeful prune
    3. Cubeful 4-ply    10/6 4/1                     Eq.:  +0.551376 ( -0.007019)
       0.806997 0.001966 0.000003 - 0.193003 0.000421 0.000008
        4-ply cubeful prune
    4. Cubeful 4-ply    9/6 9/5                      Eq.:  +0.540817 ( -0.017578)
       0.800311 0.009391 0.000385 - 0.199689 0.002403 0.000074
        4-ply cubeful prune
    5. Cubeful 4-ply    10/6 9/6                     Eq.:  +0.535377 ( -0.023018)
       0.798171 0.009679 0.000819 - 0.201829 0.003600 0.000133
        4-ply cubeful prune
    6. Cubeful 4-ply    10/6 8/5                     Eq.:  +0.518103 ( -0.040292)
       0.791480 0.008408 0.000439 - 0.208520 0.002432 0.000063
        4-ply cubeful prune
    7. Cubeful 2-ply    6/2 5/2                      Eq.:  +0.515210 ( -0.043185)
       0.788854 0.012530 0.000272 - 0.211146 0.003212 0.000065
        2-ply cubeful prune [world class]
    8. Cubeful 2-ply    6/3 5/1                      Eq.:  +0.510872 ( -0.047523)
       0.788168 0.010213 0.000217 - 0.211832 0.004918 0.000158
        2-ply cubeful prune [world class]
    9. Cubeful 2-ply    9/2                          Eq.:  +0.509888 ( -0.048507)
       0.786479 0.015650 0.000602 - 0.213521 0.008656 0.000237
        2-ply cubeful prune [world class]
   10. Cubeful 2-ply    8/5 8/4                      Eq.:  +0.499926 ( -0.058469)
       0.782833 0.010552 0.000255 - 0.217167 0.003093 0.000068
        2-ply cubeful prune [world class]