The FFO endgame test suite is a common benchmark for endgame searching. Computer completely solves each testcase, and find the best move. This benchmark evaluates the exact time for searching and the speed (NPS: Nodes Per Second).
I used Core i9-11900K for testing.
No. | Depth | Best Move | Score | Time (sec) | Nodes | NPS |
---|---|---|---|---|---|---|
#40 | 20@100% | a2 | +38 | 0.079 | 20675942 | 261720784 |
#41 | 22@100% | h4 | +0 | 0.156 | 28392068 | 182000435 |
#42 | 22@100% | g2 | +6 | 0.208 | 49139741 | 236248754 |
#43 | 23@100% | g3 | -12 | 0.401 | 86360041 | 215361698 |
#44 | 23@100% | b8 | -14 | 0.176 | 28565965 | 162306619 |
#45 | 24@100% | b2 | +6 | 1.352 | 476921635 | 352752688 |
#46 | 24@100% | b3 | -8 | 0.383 | 83495062 | 218002772 |
#47 | 25@100% | g2 | +4 | 0.162 | 22332907 | 137857450 |
#48 | 25@100% | f6 | +28 | 0.853 | 150805811 | 176794620 |
#49 | 26@100% | e1 | +16 | 1.266 | 314363012 | 248312015 |
#50 | 26@100% | d8 | +10 | 5.923 | 1485495809 | 250801250 |
#51 | 27@100% | e2 | +6 | 2.485 | 697258715 | 280587008 |
#52 | 27@100% | a3 | +0 | 2.061 | 505277066 | 245161118 |
#53 | 28@100% | d8 | -2 | 10.488 | 3319261482 | 316481834 |
#54 | 28@100% | c7 | -2 | 15.945 | 4960272938 | 311086418 |
#55 | 29@100% | g6 | +0 | 42.92 | 11362599782 | 264739044 |
#56 | 29@100% | h5 | +2 | 5.791 | 960708045 | 165896744 |
#57 | 30@100% | a6 | -10 | 11.061 | 2827877585 | 255662018 |
#58 | 30@100% | g1 | +4 | 6.609 | 1364499647 | 206460833 |
#59 | 34@100% | e8 | +64 | 0.221 | 3362984 | 15217122 |
All | - | - | - | 108.54 | 28747666237 | 264857806 |
Edax 4.4 is one of the best Othello AI in the world.
If I set the game from the very beginning, same line appears a lot. To avoid this, I set the game from many different near-draw lines.
No opening books used.
If Egaroucid Win Ratio is over 0.5, then Egaroucid wins more than Edax do.
I used XOT for its testcases.
Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
---|---|---|---|---|
1 | 615 | 23 | 362 | 0.63 |
5 | 566 | 48 | 386 | 0.59 |
10 | 589 | 115 | 296 | 0.67 |
15 | 114 | 31 | 55 | 0.67 |
Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
---|---|---|---|---|
1 | 619 | 26 | 355 | 0.64 |
5 | 535 | 44 | 421 | 0.56 |
10 | 451 | 119 | 430 | 0.51 |
15 | 108 | 36 | 56 | 0.66 |