The FFO endgame test suite is a common benchmark for endgame searching. Computer completely solves each testcase, and find the best move. This benchmark evaluates the exact time for searching and the speed (NPS: Nodes Per Second).
I used Core i9-11900K for testing.
| No. | Depth | Best Move | Score | Time (sec) | Nodes | NPS |
|---|---|---|---|---|---|---|
| #40 | 20 | a2 | 38 | 0.135 | 27871488 | 217746000 |
| #41 | 22 | h4 | 0 | 0.199 | 28862801 | 151114141 |
| #42 | 22 | g2 | 6 | 0.213 | 48660062 | 237366156 |
| #43 | 23 | c7 | -12 | 0.776 | 166809244 | 216917092 |
| #44 | 23 | d2 | -14 | 0.323 | 42549145 | 134649193 |
| #45 | 24 | b2 | 6 | 3.241 | 912441891 | 282840015 |
| #46 | 24 | b3 | -8 | 1.089 | 227129647 | 211677210 |
| #47 | 25 | g2 | 4 | 0.852 | 151105116 | 180531799 |
| #48 | 25 | f6 | 28 | 3.025 | 724631805 | 240661509 |
| #49 | 26 | e1 | 16 | 4.537 | 1079040603 | 239043110 |
| #50 | 26 | d8 | 10 | 13.943 | 3688114040 | 264912659 |
| #51 | 27 | a3 | 6 | 14.732 | 2782257813 | 189153430 |
| #52 | 27 | a3 | 0 | 3.785 | 604311247 | 160635631 |
| #53 | 28 | d8 | -2 | 69.739 | 11344109584 | 163022872 |
| #54 | 28 | c7 | -2 | 63.972 | 12621020703 | 197592458 |
| #55 | 29 | b7 | 0 | 458.573 | 78910958123 | 172128553 |
| #56 | 29 | h5 | 2 | 25.576 | 3533955047 | 138445312 |
| #57 | 30 | a6 | -10 | 59.654 | 9948249883 | 166956162 |
| #58 | 30 | g1 | 4 | 23.824 | 3949220953 | 166066227 |
| #59 | 34 | g8 | 64 | 0.043 | 7096 | 645090 |
| All | - | - | - | 748.231 | 130791306291 | 174800705 |
Edax 4.4 is one of the best Othello AI in the world.
If I set the game from the very beginning, same line appears a lot. To avoid this, I set the game from many different near-draw lines.
No opening books used.
If Egaroucid Win Ratio is over 0.5, then Egaroucid wins more than Edax do.
| Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
|---|---|---|---|---|
| 1 | 148 | 7 | 145 | 0.51 |
| 5 | 107 | 8 | 85 | 0.56 |
| 15 | 50 | 11 | 39 | 0.56 |
| Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
|---|---|---|---|---|
| 1 | 181 | 10 | 109 | 0.62 |
| 5 | 114 | 12 | 74 | 0.61 |
| 15 | 52 | 9 | 39 | 0.57 |