The FFO endgame test suite is a common benchmark for endgame searching. Computer completely solves each testcase, and find the best move. This benchmark evaluates the exact time for searching and the speed (NPS: Nodes Per Second).
I used Core i9-11900K for testing.
| No. | Depth | Best Move | Score | Time (sec) | Nodes | NPS |
|---|---|---|---|---|---|---|
| #40 | 20 | a2 | 38 | 0.187 | 32617519 | 174425235 |
| #41 | 22 | h4 | 0 | 0.242 | 26560625 | 109754648 |
| #42 | 22 | g2 | 6 | 0.36 | 51191219 | 142197830 |
| #43 | 23 | c7 | -12 | 0.929 | 168771687 | 181670276 |
| #44 | 23 | d2 | -14 | 0.626 | 43705622 | 69817287 |
| #45 | 24 | b2 | 6 | 4.256 | 973544606 | 228746382 |
| #46 | 24 | b3 | -8 | 2.315 | 169047118 | 73022513 |
| #47 | 25 | g2 | 4 | 0.816 | 115350803 | 141361278 |
| #48 | 25 | f6 | 28 | 4.137 | 822747204 | 198875321 |
| #49 | 26 | e1 | 16 | 6.387 | 1021389690 | 159916970 |
| #50 | 26 | d8 | 10 | 15.945 | 3470416861 | 217649223 |
| #51 | 27 | a3 | 6 | 19.308 | 2093326335 | 108417564 |
| #52 | 27 | a3 | 0 | 7.95 | 666596389 | 83848602 |
| #53 | 28 | d8 | -2 | 67.989 | 12227417145 | 179844050 |
| #54 | 28 | c7 | -2 | 71.954 | 13290990536 | 184715103 |
| #55 | 29 | b7 | 0 | 276.5 | 41506305139 | 150113219 |
| #56 | 29 | h5 | 2 | 28.172 | 3409497345 | 121024327 |
| #57 | 30 | a6 | -10 | 88.863 | 13317806725 | 149868974 |
| #58 | 30 | g1 | 4 | 31.941 | 4861384409 | 152198879 |
| #59 | 34 | g8 | 64 | 1.624 | 2975 | 1831 |
| All | - | - | - | 630.501 | 98268669952 | 155858072 |
Edax 4.4 is one of the best Othello AI in the world.
If I set the game from the very beginning, same line appears a lot. To avoid this, I set the game from many different near-draw lines.
No opening books used.
If Egaroucid Win Ratio is over 0.5, then Egaroucid wins more than Edax do.
I used XOT for its testcases.
| Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
|---|---|---|---|---|
| 1 | 61 | 2 | 67 | 0.48 |
| 5 | 68 | 6 | 56 | 0.55 |
| 11 | 69 | 18 | 43 | 0.62 |
| Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
|---|---|---|---|---|
| 1 | 76 | 3 | 51 | 0.6 |
| 5 | 67 | 11 | 52 | 0.56 |
| 11 | 61 | 15 | 54 | 0.53 |