The FFO endgame test suite is a common benchmark for endgame searching. Computer completely solves each testcase, and find the best move. This benchmark evaluates the exact time for searching and the speed (NPS: Nodes Per Second).
I used Core i9-11900K for testing.
| No. | Depth | Best Move | Score | Time (sec) | Nodes | NPS |
|---|---|---|---|---|---|---|
| #40 | 20@100% | a2 | +38 | 0.13 | 34046159 | 261893530 |
| #41 | 22@100% | h4 | +0 | 0.233 | 38361379 | 164641111 |
| #42 | 22@100% | g2 | +6 | 0.324 | 69392367 | 214173972 |
| #43 | 23@100% | c7 | -12 | 0.284 | 57083578 | 200998514 |
| #44 | 23@100% | b8 | -14 | 0.198 | 21367458 | 107916454 |
| #45 | 24@100% | b2 | +6 | 1.813 | 612227091 | 337687308 |
| #46 | 24@100% | b3 | -8 | 0.516 | 104353321 | 202235118 |
| #47 | 25@100% | g2 | +4 | 0.247 | 30154429 | 122082708 |
| #48 | 25@100% | f6 | +28 | 0.896 | 178317496 | 199015062 |
| #49 | 26@100% | e1 | +16 | 1.693 | 461193080 | 272411742 |
| #50 | 26@100% | d8 | +10 | 6.572 | 2078435981 | 316256235 |
| #51 | 27@100% | e2 | +6 | 1.819 | 402752110 | 221414024 |
| #52 | 27@100% | a3 | +0 | 2.105 | 460196375 | 218620605 |
| #53 | 28@100% | d8 | -2 | 16.745 | 5428631290 | 324194164 |
| #54 | 28@100% | c7 | -2 | 20.264 | 6858449925 | 338454891 |
| #55 | 29@100% | g6 | +0 | 56.476 | 14231640162 | 251994478 |
| #56 | 29@100% | h5 | +2 | 7.647 | 1421292685 | 185862780 |
| #57 | 30@100% | a6 | -10 | 14.908 | 4174615559 | 280025191 |
| #58 | 30@100% | g1 | +4 | 8.619 | 1762391815 | 204477528 |
| #59 | 34@100% | e8 | +64 | 0.129 | 627770 | 4866434 |
| All | - | - | - | 141.618 | 38425530030 | 271332246 |
Edax 4.4 is one of the best Othello AI in the world.
If I set the game from the very beginning, same line appears a lot. To avoid this, I set the game from many different near-draw lines.
I used XOT for its testcases.
No opening books used.
If Egaroucid Win Ratio is over 0.5, then Egaroucid wins more than Edax do. "Black" and "White" means Egaroucid played black/white. In all conditions, Egaroucid is stronger than Edax.
| Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
|---|---|---|---|---|
| 1 | 1281(Black: 643 White: 638) | 40(Black: 21 White: 19) | 679(Black: 336 White: 343) | 0.654 |
| 5 | 1189(Black: 609 White: 580) | 95(Black: 51 White: 44) | 716(Black: 340 White: 376) | 0.624 |
| 10 | 1045(Black: 587 White: 458) | 247(Black: 112 White: 135) | 708(Black: 301 White: 407) | 0.596 |
| 15 | 107(Black: 63 White: 44) | 35(Black: 11 White: 24) | 58(Black: 26 White: 32) | 0.648 |