The FFO endgame test suite is a common benchmark for endgame searching. Computer completely solves each testcase, and find the best move. This benchmark evaluates the exact time for searching and the speed (NPS: Nodes Per Second).
I used Core i9-11900K for testing.
| No. | Depth | Best Move | Score | Time (sec) | Nodes | NPS |
|---|---|---|---|---|---|---|
| #40 | 20@100% | a2 | +38 | 0.079 | 20675942 | 261720784 |
| #41 | 22@100% | h4 | +0 | 0.156 | 28392068 | 182000435 |
| #42 | 22@100% | g2 | +6 | 0.208 | 49139741 | 236248754 |
| #43 | 23@100% | g3 | -12 | 0.401 | 86360041 | 215361698 |
| #44 | 23@100% | b8 | -14 | 0.176 | 28565965 | 162306619 |
| #45 | 24@100% | b2 | +6 | 1.352 | 476921635 | 352752688 |
| #46 | 24@100% | b3 | -8 | 0.383 | 83495062 | 218002772 |
| #47 | 25@100% | g2 | +4 | 0.162 | 22332907 | 137857450 |
| #48 | 25@100% | f6 | +28 | 0.853 | 150805811 | 176794620 |
| #49 | 26@100% | e1 | +16 | 1.266 | 314363012 | 248312015 |
| #50 | 26@100% | d8 | +10 | 5.923 | 1485495809 | 250801250 |
| #51 | 27@100% | e2 | +6 | 2.485 | 697258715 | 280587008 |
| #52 | 27@100% | a3 | +0 | 2.061 | 505277066 | 245161118 |
| #53 | 28@100% | d8 | -2 | 10.488 | 3319261482 | 316481834 |
| #54 | 28@100% | c7 | -2 | 15.945 | 4960272938 | 311086418 |
| #55 | 29@100% | g6 | +0 | 42.92 | 11362599782 | 264739044 |
| #56 | 29@100% | h5 | +2 | 5.791 | 960708045 | 165896744 |
| #57 | 30@100% | a6 | -10 | 11.061 | 2827877585 | 255662018 |
| #58 | 30@100% | g1 | +4 | 6.609 | 1364499647 | 206460833 |
| #59 | 34@100% | e8 | +64 | 0.221 | 3362984 | 15217122 |
| All | - | - | - | 108.54 | 28747666237 | 264857806 |
Edax 4.4 is one of the best Othello AI in the world.
If I set the game from the very beginning, same line appears a lot. To avoid this, I set the game from many different near-draw lines.
I used XOT for its testcases.
No opening books used.
If Egaroucid Win Ratio is over 0.5, then Egaroucid wins more than Edax do. "Black" and "White" means Egaroucid played black/white. In all conditions, Egaroucid is stronger than Edax.
| Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
|---|---|---|---|---|
| 1 | 1234(Black: 615 White: 619) | 49(Black: 23 White: 26) | 717(Black: 362 White: 355) | 0.632 |
| 5 | 1101(Black: 566 White: 535) | 92(Black: 48 White: 44) | 807(Black: 386 White: 421) | 0.577 |
| 10 | 1040(Black: 589 White: 451) | 234(Black: 115 White: 119) | 726(Black: 296 White: 430) | 0.589 |
| 15 | 222(Black: 114 White: 108) | 67(Black: 31 White: 36) | 111(Black: 55 White: 56) | 0.667 |