The FFO endgame test suite is a common benchmark for endgame searching. Computer completely solves each testcase, and find the best move. This benchmark evaluates the exact time for searching and the speed (NPS: Nodes Per Second). In this section, you can see the result of FFO#40-59.
AVX512 edition do not works with Core i9-13900K, so there are only SIMD, Generic, and x86 editions.
Egaroucid's result are:
| CPU | Edition | Time (sec) | Nodes | NPS | File |
|---|---|---|---|---|---|
| Core i9-13900K | x64_SIMD | 23.965 | 19280200483 | 804514937 | 000_ffo40_59_Core_i9-13900K_x64_SIMD.txt |
| Core i9-13900K | x64_Generic | 35.053 | 18750846644 | 534928441 | 001_ffo40_59_Core_i9-13900K_x64_Generic.txt |
| Core i9-13900K | x86_Generic | 88.496 | 19057983884 | 215354184 | 002_ffo40_59_Core_i9-13900K_x86_Generic.txt |
As a comparison, I also show Edax 4.5.2's result:
| CPU | Edition | Time (sec) | Nodes | NPS | File |
|---|---|---|---|---|---|
| Core i9-13900K | x64_modern | 24.908 | 27698822259 | 1112045217 | 010_ffo40_59_Core_i9-13900K_edax_x64_modern.txt |
| Core i9-13900K | x64 | 29.469 | 27561483343 | 935270397 | 011_ffo40_59_Core_i9-13900K_edax_x64.txt |
| Core i9-13900K | x86 | 45.156 | 28511338646 | 631396462 | 012_ffo40_59_Core_i9-13900K_edax_x86.txt |
With Core i9-11900K, you can run AVX512 edition.
Egaroucid's result are:
| CPU | Edition | Time (sec) | Nodes | NPS | File |
|---|---|---|---|---|---|
| Core i9-11900K | x64_AVX512 | 44.232 | 17098579900 | 386565832 | 100_ffo40_59_Core_i9-11900K_x64_AVX512.txt |
| Core i9-11900K | x64_SIMD | 48.614 | 18373521423 | 377947122 | 101_ffo40_59_Core_i9-11900K_x64_SIMD.txt |
| Core i9-11900K | x64_Generic | 85.018 | 17451101371 | 205263607 | 102_ffo40_59_Core_i9-11900K_x64_Generic.txt |
| Core i9-11900K | x86_Generic | 238.965 | 18184845840 | 76098365 | 103_ffo40_59_Core_i9-11900K_x86_Generic.txt |
Edax 4.5.2's result are:
| CPU | Edition | Time (sec) | Nodes | NPS | File |
|---|---|---|---|---|---|
| Core i9-11900K | x64_avx512 | 46.642 | 27072480526 | 580431382 | 110_ffo40_59_Core_i9-11900K_edax_x64_avx512.txt |
| Core i9-11900K | x64_modern | 46.561 | 27575952822 | 592254308 | 111_ffo40_59_Core_i9-11900K_edax_x64_modern.txt |
| Core i9-11900K | x64 | 56.86 | 26635810350 | 468445486 | 112_ffo40_59_Core_i9-11900K_edax_x64.txt |
| Core i9-11900K | x86 | 91.764 | 26989485812 | 294118454 | 113_ffo40_59_Core_i9-11900K_edax_x86.txt |
Edax 4.4 is one of the best Othello AI in the world.
If I set the game from the very beginning, same line appears a lot. To avoid this, I set the game from many different near-draw lines.
I used XOT for its testcases.
No opening books used.
If Egaroucid Win Ratio is over 0.5, then Egaroucid wins more than Edax do. "Black" and "White" means Egaroucid played black/white. In all conditions, Egaroucid is stronger than Edax.
| Level | Egaroucid win | Draw | Edax Win | Egaroucid Win Ratio |
|---|---|---|---|---|
| 1 | 1273(Black: 629 White: 644) | 47(Black: 29 White: 18) | 680(Black: 342 White: 338) | 0.648 |
| 5 | 1335(Black: 672 White: 663) | 100(Black: 55 White: 45) | 565(Black: 273 White: 292) | 0.693 |
| 10 | 1064(Black: 610 White: 454) | 226(Black: 108 White: 118) | 710(Black: 282 White: 428) | 0.589 |
| 15 | 245(Black: 130 White: 115) | 104(Black: 50 White: 54) | 151(Black: 70 White: 81) | 0.594 |
| 21 | 84(Black: 59 White: 25) | 43(Black: 15 White: 28) | 73(Black: 26 White: 47) | 0.527 |