The FFO endgame test suite is a common benchmark for endgame searching. Computer completely solves each testcase, and find the best move. This benchmark evaluates the exact time for searching and the speed (NPS: Nodes Per Second).
I used Core i9-11900K for testing.
| No. | Depth | Best Move | Score | Time (sec) | Nodes | NPS |
|---|---|---|---|---|---|---|
| #40 | 20 | a2 | 38 | 0.146 | 18499320 | 126707671 |
| #41 | 22 | h4 | 0 | 0.256 | 26526311 | 103618402 |
| #42 | 22 | g2 | 6 | 0.35 | 40548462 | 115852748 |
| #43 | 23 | c7 | -12 | 0.574 | 82911207 | 144444611 |
| #44 | 23 | d2 | -14 | 0.301 | 15270420 | 50732292 |
| #45 | 24 | b2 | 6 | 2.533 | 498339937 | 196739019 |
| #46 | 24 | b3 | -8 | 0.837 | 76840991 | 91805246 |
| #47 | 25 | g2 | 4 | 0.435 | 37334630 | 85826735 |
| #48 | 25 | f6 | 28 | 1.838 | 204129724 | 111060785 |
| #49 | 26 | e1 | 16 | 2.496 | 256316623 | 102690954 |
| #50 | 26 | d8 | 10 | 7.966 | 1179213508 | 148030819 |
| #51 | 27 | a3 | 6 | 2.557 | 249226421 | 97468291 |
| #52 | 27 | a3 | 0 | 5.363 | 560569333 | 104525327 |
| #53 | 28 | d8 | -2 | 30.118 | 4883501669 | 162145616 |
| #54 | 28 | c7 | -2 | 28.803 | 6314578504 | 219233361 |
| #55 | 29 | g6 | 0 | 138.86 | 23384774474 | 168405404 |
| #56 | 29 | h5 | 2 | 11.095 | 1140351709 | 102780685 |
| #57 | 30 | a6 | -10 | 13.494 | 1668140404 | 123620898 |
| #58 | 30 | g1 | 4 | 15.759 | 1921933011 | 121957802 |
| #59 | 34 | g8 | 64 | 0.023 | 28904 | 1256695 |
| All | - | - | - | 263.804 | 42559035562 | 161328242 |
Edax 4.4 is one of the best Othello AI in the world.
If I set the game from the very beginning, same line appears a lot. To avoid this, I set the game from many different near-draw lines.
No opening books used.
If Egaroucid Win Ratio is over 0.5, then Egaroucid wins more than Edax do.
I used XOT for its testcases.
| Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
|---|---|---|---|---|
| 1 | 497 | 24 | 479 | 0.51 |
| 5 | 573 | 52 | 375 | 0.6 |
| 10 | 536 | 131 | 333 | 0.62 |
| Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
|---|---|---|---|---|
| 1 | 532 | 22 | 446 | 0.54 |
| 5 | 535 | 54 | 411 | 0.57 |
| 10 | 468 | 109 | 423 | 0.53 |