The FFO endgame test suite is a common benchmark for endgame searching. Computer completely solves each testcase, and find the best move. This benchmark evaluates the exact time for searching and the speed (NPS: Nodes Per Second).
I used Core i9-11900K for testing.
| No. | Depth | Best Move | Score | Time (sec) | Nodes | NPS |
|---|---|---|---|---|---|---|
| #40 | 20 | a2 | 38 | 0.208 | 30240013 | 145384677 |
| #41 | 22 | h4 | 0 | 0.282 | 30934637 | 109697294 |
| #42 | 22 | g2 | 6 | 0.323 | 38954689 | 120602752 |
| #43 | 23 | c7 | -12 | 0.764 | 113328845 | 148336184 |
| #44 | 23 | d2 | -14 | 0.4 | 24596008 | 61490020 |
| #45 | 24 | b2 | 6 | 2.957 | 597485227 | 202057905 |
| #46 | 24 | b3 | -8 | 0.975 | 101741641 | 104350401 |
| #47 | 25 | g2 | 4 | 0.568 | 55996875 | 98586047 |
| #48 | 25 | f6 | 28 | 3.955 | 605660062 | 153137815 |
| #49 | 26 | e1 | 16 | 4.756 | 798738457 | 167943325 |
| #50 | 26 | d8 | 10 | 13.33 | 2343428530 | 175801090 |
| #51 | 27 | e2 | 6 | 5.417 | 532335784 | 98271328 |
| #52 | 27 | a3 | 0 | 4.371 | 490500268 | 112216945 |
| #53 | 28 | d8 | -2 | 45.686 | 4995871831 | 109352358 |
| #54 | 28 | c7 | -2 | 57.814 | 8094332723 | 140006446 |
| #55 | 29 | g6 | 0 | 153.868 | 19667033928 | 127817570 |
| #56 | 29 | h5 | 2 | 17.839 | 1737263912 | 97385722 |
| #57 | 30 | a6 | -10 | 40.738 | 5202620937 | 127709287 |
| #58 | 30 | g1 | 4 | 20.25 | 2560167511 | 126428025 |
| #59 | 34 | g8 | 64 | 0.026 | 2056 | 79076 |
| All | - | - | - | 374.527 | 48021233934 | 128218350 |
Edax 4.4 is one of the best Othello AI in the world.
If I set the game from the very beginning, same line appears a lot. To avoid this, I set the game from many different near-draw lines.
No opening books used.
If Egaroucid Win Ratio is over 0.5, then Egaroucid wins more than Edax do.
I used XOT for its testcases.
| Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
|---|---|---|---|---|
| 1 | 489 | 24 | 487 | 0.5 |
| 5 | 582 | 59 | 359 | 0.62 |
| 10 | 585 | 119 | 296 | 0.66 |
| 11 | 552 | 132 | 316 | 0.64 |
| Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
|---|---|---|---|---|
| 1 | 534 | 27 | 439 | 0.55 |
| 5 | 549 | 44 | 407 | 0.57 |
| 10 | 443 | 124 | 433 | 0.51 |
| 11 | 501 | 115 | 384 | 0.57 |