Last Update: 10.05.2022
Dear Chess Friends,
As usual I'm pleased to announced that,Here is another new:exciting competition...!
As participants, I've picked mainly the Top enginesWhich performed not so bad in the recent OTS v5
Well, where this time,All engines are tested with 86 unique but hard positions!It's based on unsolved positions in 2 seconds/moveBut note that all of them are solved in 40 sec/moveThese testings done via 1 core by the Top engines
Btw, it looks like the number of the positions not so BIG ...But note that all these 86 positions are derived from overThan 1000 pos and just only 86 are left as unsolved in 2sIt seems BestOfBest suite is not so easy for sure e.g as You may see, many managed to solve minus plus 10% ...
As source regarding the current used test suite:86 positions, based mainly on Hard-Talkchess,ACT3, Arasan,TTT2, OTS, ERET, Der-Brillante...And it includes tactical, opening, mate etc. puzzles
And I have good news, My used test suite (86 pos) is released BestOfBest
The Leader Crystal - Congrats to Stockfish developers!
Engine PointsCrystal 251221 NN : 25Blue Marlin 14.4 NN : 22SF Polyglot 15 NN : 22CorChess 3 230422 NN : 20Stockfish 15 NN : 19Honey 14.1.01 NN Tact 8 : 19Raubfisch X48d2 NN : 19BrainLearn 17 NN : 19lc0 v0.82.2 611245 NN : 18Deep Blue 180422 : 18SugaR AI ICCF 2.50 NN : 17Houdini 6.03 Tact 128 : 16SF PB 190422 NN : 15Raubfisch X39e3b NMH OFF : 13Honey 14.1.01 NN : 11ShashChess 21.1 NN : 10Fat Titz 2 130122 NN : 9ProteusSF JBE 007 NN : 9KomodoDragon 3 NN : 8Kayra 1.0 NN : 8Kovisto 8.6 NN : 8Redfish 240122 NN : 7Berserk 8.5.1 NN : 7Cfish 130821 NN : 7Fat Fritz 2 NN : 7EMAN 7.93 NN : 6Bluefish 090321 NN : 6RubiChess 230222 NN : 6Komodo 13.3 : 5Fisherov v0.98c NN : 4SlowChess 2.83 NN : 4Stockfish 11 : 4Wasp 5.50 NN : 2Seer 2.5.0 NN : 1
Here are some more results and let's see the influences...I've picked 4 Top engines (2 as NNUE, 2 as NON-NNUE):As NNUE engines: Crystal 251221, Blue Marlin 14.4NON: Houdini 6.03 Tact 128, Raubfisch X39e3b NMH OFFAnd you can appreciate, like any testings as you wish...)
1 core, 30 seconds, 512 MB hash, Total = 76 pointsCrystal=25, Blue Marlin=22, Houdini=16, Raubfish=13
1 Core, 30 seconds, 128 MB hash, Total = 80 pointsCrystal=27, Blue Marlin=22, Houdini=14, Raubfish=17
Note: 128 MB performed slightly better than 512 MB...------------------------------------------------------------------------
4 Cores, 10 seconds, 1024 MB hash, Total = 69 pointsCrystal=28, Blue Marlin=20, Houdini=10, Raubfish=11
4 Cores, 10 seconds, 128 MB hash, Total = 64 pointsCrystal=24, Blue Marlin=20, Houdini=11, Raubfish=9
Note: 1024 MB performed slightly better than 128 MB...------------------------------------------------------------------------
3 Cores, 8 seconds, 128 MB hash, Total = 50 pointsCrystal=22, Blue Marlin=12, Houdini= 7, Raubfish=9
3 Cores, 8 seconds, 512 MB hash, Total = 48 pointsCrystal=17, Blue Marlin= 14, Houdini= 7, Raubfish=10
Note: 128 MB performed slightly better than 512 MB...------------------------------------------------------------------------
6 Cores, 8 seconds, 1024 MB hash, Total = 80 pointsCrystal=31, Blue Marlin=21, Houdini=12, Raubfish=16
6 Cores, 8 seconds, 2048 MB hash, Total = 71 pointsCrystal=27, Blue Marlin=18, Houdini=10, Raubfish=16
6 Cores, 8 seconds, 512 MB hash, Total = 63 pointsCrystal=21, Blue Marlin=19, Houdini=10, Raubfish=13
Note:1024 MB performed better than 512 MB /2048 MBBtw, 6 core + 8 sec points are close to 1 core +30 sec
Plus as additional testings, I've realized to be analyzed:Crystal 6 core, 16 sec/move,1024 MB hash: 36 pointsCrystal 6 core, 30 sec/move,1024 MB hash: 37 pointsBlue Marlin 6 core, 30 sec,1024 MB hash: 32 points----------------------------------------------------------------------
Here are the overall 8 sec results of Crystal testings:Crystal 1 core, 8 sec/move, 64 MB hash: 11 pointsCrystal 1 core, 8 sec/move, 128 MB hash: 13 pointsCrystal 1 core, 8 sec/move, 256 MB hash: 10 pointsCrystal 1 core, 8 sec/move, 512 MB hash: 11 pointsCrystal 1 core, 8 sec/move, 1024 MB hash: 14 pointsCrystal 1 core, 8 sec/move, 2048 MB hash: 12 pointsCrystal 2 core, 8 sec/move, 128 MB hash: 22 pointsCrystal 3 core, 8 sec/move, 128 MB hash: 22 pointsCrystal 4 core, 8 sec/move, 128 MB hash: 24 pointsCrystal 4 core, 8 sec/move, 1024 MB hash: 29 pointsCrystal 4 core, 8 sec/move, 4096 MB hash: 28 pointsCrystal 6 core, 8 sec/move, 1024 MB hash: 31 pointsCrystal 6 core, 8 sec/move, 6144 MB hash: 26 points
Note:The biggest influence is between 1 core Vs 2 core---------------------------------------------------------------------------
More Details:• All engines are analyzed with BesOfBest suite (86 positions)• The current results can be counted as overall performance Anyhow, my used suite is based mainly on tactical positions E.g some engines are better solvers in openings/tactics etc.• As you may see too, giving more time and cores is better...! E.g Crystal, Blue Marlin etc.are best under these conditions Btw, no BIG surprise here...plus Blue Marlin is best: Results However some NNUE engines do not gain/perform so well Even old-dated Houdini, Raubfish are still better than many...• Sometimes giving big or small hash sizes don't mean better It all depends on our used conditions, e.g to be sure about Which conditions are best: simply run your own testings...!
OTS v5 2021 OTS v4 OTS v3 AES PTS ETS OTS 30s STS TTS