日本語

Egaroucid 6.3.0 Benchmarks

The FFO endgame test suite

The FFO endgame test suite is a common benchmark for endgame searching. Computer completely solves each testcase, and find the best move. This benchmark evaluates the exact time for searching and the speed (NPS: Nodes Per Second).

I used Core i9-11900K for testing.

Egaroucid for Console 6.3.0 Windows x64 SIMD

In this testcase, Egaroucid is faster than Edax 4.4

Core i9 13900K @ 32 threads

No.DepthBest MoveScoreTime (sec)NodesNPS
#4020a2+380.03515604674445847828
#4122h4+00.07221714114301584916
#4222g2+60.12555433043443464344
#4323g3-120.289692254448461270
#4423b8-140.08824244680275507727
#4524b2+60.534388512222727550977
#4624b3-80.18480077492435203760
#4725g2+40.09418628708198177744
#4825f6+280.513182960049356647269
#4926e1+160.463215949781466414213
#5026d8+102.4791217607890491168975
#5127e2+61.159631334502544723470
#5227a3+01.07487586489455688307
#5328d8-24.9973151318045630641994
#5428c7-27.0164395595386626510174
#5529g6+018.84910046955374533023257
#5629h5+22.567810031220315555597
#5730a6-103.6251674272788461868355
#5830g1+43.3581332068570396685101
#5934e8+640.507798705215753554
All---47.93524847574333518359744

Core i9 11900K @ 19 threads

No.DepthBest MoveScoreTime (sec)NodesNPS
#4020a2+380.04415494702352152318
#4122h4+00.07321124820289381095
#4222g2+60.14649745915340725445
#4323g3-120.29587066413295140383
#4423b8-140.10123486569232540287
#4524b2+60.922392855585426090656
#4624b3-80.24581888822334240089
#4725g2+40.09718401427189705432
#4825f6+280.689159793545231920965
#4926e1+160.624181557049290956809
#5026d8+104.2041189348649282908812
#5127e2+61.467483533396329606950
#5227a3+01.348407229019302098678
#5328d8-27.1362544121571356519278
#5428c7-211.8494096311418345709462
#5529g6+031.5359377874772297379888
#5629h5+24.024779372741193681098
#5730a6-106.2321625097679260766636
#5830g1+45.2621234742124234652627
#5934e8+640.323677918520988188
All---76.61622775825401297272442

Egaroucid for Console 6.3.0 Windows x64 Generic

Without speedup by SIMD

Core i9 13900K @ 32 threads

No.DepthBest MoveScoreTime (sec)NodesNPS
#4020a2+380.05215106413290507942
#4122h4+00.08124801349306189493
#4222g2+60.1550172927334486180
#4323g3-120.25582187995322305862
#4423b8-140.10722195794207437327
#4524b2+60.815380144157466434548
#4624b3-80.24185114614353172672
#4725g2+40.09919198079193919989
#4825f6+280.469114869257244923788
#4926e1+160.713281038454394163329
#5026d8+103.4541216391164352168837
#5127e2+61.435545231458379952235
#5227a3+01.472537958037365460622
#5328d8-27.143299644180462135039
#5428c7-210.7694876521617452829567
#5529g6+027.89710569469395378874767
#5629h5+23.069719993903234602118
#5730a6-105.7012212611193388109312
#5830g1+44.4131364387596309174619
#5934e8+640.5860231117204622
All---68.83226425639893383915038

Play against Edax 4.4

Edax 4.4 is one of the best Othello AI in the world.

If I set the game from the very beginning, same line appears a lot. To avoid this, I set the game from many different near-draw lines.

I used XOT for its testcases.

No opening books used.

If Egaroucid Win Ratio is over 0.5, then Egaroucid wins more than Edax do. "Black" and "White" means Egaroucid played black/white. In all conditions, Egaroucid is stronger than Edax.

LevelEgaroucid winDrawEdax WinEgaroucid Win Ratio
11227(Black: 591 White: 636)46(Black: 20 White: 26)727(Black: 389 White: 338)0.628
51154(Black: 593 White: 561)87(Black: 45 White: 42)759(Black: 362 White: 397)0.603
101050(Black: 599 White: 451)237(Black: 107 White: 130)713(Black: 294 White: 419)0.596
15302(Black: 162 White: 140)114(Black: 51 White: 63)184(Black: 87 White: 97)0.621