The FFO endgame test suite is a common benchmark for endgame searching. Computer completely solves each testcase, and find the best move. This benchmark evaluates the exact time for searching and the speed (NPS: Nodes Per Second).
I used Core i9-11900K for testing.
No. | Depth | Best Move | Score | Time (sec) | Nodes | NPS |
---|---|---|---|---|---|---|
#40 | 20@100% | a2 | +38 | 0.13 | 34046159 | 261893530 |
#41 | 22@100% | h4 | +0 | 0.233 | 38361379 | 164641111 |
#42 | 22@100% | g2 | +6 | 0.324 | 69392367 | 214173972 |
#43 | 23@100% | c7 | -12 | 0.284 | 57083578 | 200998514 |
#44 | 23@100% | b8 | -14 | 0.198 | 21367458 | 107916454 |
#45 | 24@100% | b2 | +6 | 1.813 | 612227091 | 337687308 |
#46 | 24@100% | b3 | -8 | 0.516 | 104353321 | 202235118 |
#47 | 25@100% | g2 | +4 | 0.247 | 30154429 | 122082708 |
#48 | 25@100% | f6 | +28 | 0.896 | 178317496 | 199015062 |
#49 | 26@100% | e1 | +16 | 1.693 | 461193080 | 272411742 |
#50 | 26@100% | d8 | +10 | 6.572 | 2078435981 | 316256235 |
#51 | 27@100% | e2 | +6 | 1.819 | 402752110 | 221414024 |
#52 | 27@100% | a3 | +0 | 2.105 | 460196375 | 218620605 |
#53 | 28@100% | d8 | -2 | 16.745 | 5428631290 | 324194164 |
#54 | 28@100% | c7 | -2 | 20.264 | 6858449925 | 338454891 |
#55 | 29@100% | g6 | +0 | 56.476 | 14231640162 | 251994478 |
#56 | 29@100% | h5 | +2 | 7.647 | 1421292685 | 185862780 |
#57 | 30@100% | a6 | -10 | 14.908 | 4174615559 | 280025191 |
#58 | 30@100% | g1 | +4 | 8.619 | 1762391815 | 204477528 |
#59 | 34@100% | e8 | +64 | 0.129 | 627770 | 4866434 |
All | - | - | - | 141.618 | 38425530030 | 271332246 |
Edax 4.4 is one of the best Othello AI in the world.
If I set the game from the very beginning, same line appears a lot. To avoid this, I set the game from many different near-draw lines.
No opening books used.
If Egaroucid Win Ratio is over 0.5, then Egaroucid wins more than Edax do.
I used XOT for its testcases.
Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
---|---|---|---|---|
1 | 643 | 21 | 336 | 0.66 |
5 | 609 | 51 | 340 | 0.64 |
10 | 587 | 112 | 301 | 0.66 |
15 | 63 | 11 | 26 | 0.71 |
Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
---|---|---|---|---|
1 | 638 | 19 | 343 | 0.65 |
5 | 580 | 44 | 376 | 0.61 |
10 | 458 | 135 | 407 | 0.53 |
15 | 44 | 24 | 32 | 0.58 |