The FFO endgame test suite is a common benchmark for endgame searching. Computer completely solves each testcase, and find the best move. This benchmark evaluates the exact time for searching and the speed (NPS: Nodes Per Second). In this section, you can see the result of FFO#40-59.
AVX512 edition do not works with Core i9-13900K, so there are only SIMD, Generic, and x86 editions.
Egaroucid's result are:
| CPU | Edition | Time (sec) | Nodes | NPS | File |
|---|---|---|---|---|---|
| Core i9-13900K | x64_SIMD | 22.892 | 19272934563 | 841906978 | 000_ffo40_59_Core_i9-13900K_x64_SIMD.txt |
| Core i9-13900K | x64_Generic | 39.477 | 21898593531 | 554717773 | 001_ffo40_59_Core_i9-13900K_x64_Generic.txt |
| Core i9-13900K | x86_Generic | 92.359 | 19548877069 | 211661852 | 002_ffo40_59_Core_i9-13900K_x86_Generic.txt |
As a comparison, I also show Edax 4.5.2's result:
| CPU | Edition | Time (sec) | Nodes | NPS | File |
|---|---|---|---|---|---|
| Core i9-13900K | x64_modern | 23.328 | 27849601649 | 1193827231 | 010_ffo40_59_Core_i9-13900K_edax_x64_modern.txt |
| Core i9-13900K | x64 | 27.767 | 27892181236 | 1004508274 | 011_ffo40_59_Core_i9-13900K_edax_x64.txt |
| Core i9-13900K | x86 | 42.098 | 27862333601 | 661844591 | 012_ffo40_59_Core_i9-13900K_edax_x86.txt |
With Core i9-11900K, you can run AVX512 edition.
Egaroucid's result are:
| CPU | Edition | Time (sec) | Nodes | NPS | File |
|---|---|---|---|---|---|
| Core i9-11900K | x64_AVX512 | 47.282 | 17422173608 | 368473702 | 100_ffo40_59_Core_i9-11900K_x64_AVX512.txt |
| Core i9-11900K | x64_SIMD | 48.25 | 17524528057 | 363202654 | 101_ffo40_59_Core_i9-11900K_x64_SIMD.txt |
| Core i9-11900K | x64_Generic | 92.032 | 18384451854 | 199761516 | 102_ffo40_59_Core_i9-11900K_x64_Generic.txt |
| Core i9-11900K | x86_Generic | 252.075 | 18597008331 | 73775695 | 103_ffo40_59_Core_i9-11900K_x86_Generic.txt |
Edax 4.5.2's result are:
| CPU | Edition | Time (sec) | Nodes | NPS | File |
|---|---|---|---|---|---|
| Core i9-11900K | x64_avx512 | 43.19 | 26820387942 | 620986060 | 110_ffo40_59_Core_i9-11900K_edax_x64_avx512.txt |
| Core i9-11900K | x64_modern | 44.11 | 26929672444 | 610511731 | 111_ffo40_59_Core_i9-11900K_edax_x64_modern.txt |
| Core i9-11900K | x64 | 56.327 | 26971739786 | 478842115 | 112_ffo40_59_Core_i9-11900K_edax_x64.txt |
| Core i9-11900K | x86 | 89.701 | 26583076444 | 296352063 | 113_ffo40_59_Core_i9-11900K_edax_x86.txt |
Edax 4.4 is one of the best Othello AI in the world.
If I set the game from the very beginning, same line appears a lot. To avoid this, I set the game from many different near-draw lines.
I used XOT for its testcases.
No opening books used.
If Egaroucid Win Ratio is over 0.5, then Egaroucid wins more than Edax do. "Black" and "White" means Egaroucid played black/white. In all conditions, Egaroucid is stronger than Edax.
| Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
|---|---|---|---|---|
| 1 | 1232(Black: 597 White: 635) | 58(Black: 33 White: 25) | 710(Black: 370 White: 340) | 0.63 |
| 5 | 1313(Black: 673 White: 640) | 109(Black: 52 White: 57) | 578(Black: 275 White: 303) | 0.684 |
| 10 | 1013(Black: 568 White: 445) | 222(Black: 113 White: 109) | 765(Black: 319 White: 446) | 0.562 |
| 15 | 228(Black: 125 White: 103) | 103(Black: 52 White: 51) | 169(Black: 73 White: 96) | 0.559 |
| 21 | 78(Black: 47 White: 31) | 54(Black: 25 White: 29) | 68(Black: 28 White: 40) | 0.525 |