日本語

Egaroucid 7.7.0 Benchmarks

The FFO endgame test suite

The FFO endgame test suite is a common benchmark for endgame searching. Computer completely solves each testcase, and find the best move. This benchmark evaluates the exact time for searching and the speed (NPS: Nodes Per Second). In this section, you can see the result of FFO#40-59.

Core i9-13900K

AVX512 edition do not works with Core i9-13900K, so there are only SIMD, Generic, and x86 editions.

Egaroucid's result are here. As a comparison, I also show Edax 4.5.5's result. Although Edax 4.6 is the latest, but on my environment, I found that 4.5.5 is faster than 4.6.

AIEditionTime (sec)NodesNPSFile
EgaroucidSIMD20.74614789131082712866628000_ffo40_59_Core_i9-13900K_SIMD.txt
EgaroucidGeneric31.90615735727776493190239001_ffo40_59_Core_i9-13900K_Generic.txt
Edaxv322.798277030824241215154067010_ffo40_59_Core_i9-13900K_edax_x64_v3.txt
Edax-27.468279058048301015938723011_ffo40_59_Core_i9-13900K_edax_x64.txt

Core i9-11900K

With Core i9-11900K, you can run AVX512 edition.

Egaroucid's result and Edax 4.5.5's result are:

AIEditionTime (sec)NodesNPSFile
EgaroucidAVX51237.61514224643683378164128100_ffo40_59_Core_i9-11900K_AVX512.txt
EgaroucidSIMD39.35614201687484360851902101_ffo40_59_Core_i9-11900K_SIMD.txt
EgaroucidGeneric70.86814512377695204780404102_ffo40_59_Core_i9-11900K_Generic.txt
Edaxv435.40626154694442738707972110_ffo40_59_Core_i9-11900K_edax_x64_v4.txt
Edaxv338.34425950762077676788078111_ffo40_59_Core_i9-11900K_edax_x64_v3.txt
Edax-48.31425908072899536243592112_ffo40_59_Core_i9-11900K_edax_x64.txt

Play against Edax 4.6

Edax 4.6 is one of the best open-source Othello AI in the world.

If I set the game from the very beginning, same line appears a lot. To avoid this, I set the game from many different near-draw lines.

If Egaroucid Win Ratio is over 0.5, then Egaroucid wins more than Edax do. In all conditions, Egaroucid is stronger than Edax.

The average number of discs earned indicates how many more discs Egaroucid was able to acquire than Edax on average. The higher this value, the bigger the victory over Edax.

I used XOT for its testcases. No opening books used.

LevelAvg. Discs EarnedWinning RateEgaroucid WinDrawEdax Win
1+10.920.72672012268
5+8.980.79478421195
10+2.160.67163769294
15+0.890.6161383280
21+0.240.565462133