Questions and comments related to CCRL testing study
Ray
Posts: 22613 Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ
Post
by Ray » Thu Oct 28, 2010 6:34 pm
I have played against 6 opponents so far, 600 games. At this point, Tornado 4.1 is approx +80 ELO stronger than the last version I tested, 3.42. Of course I am not even half way through yet, the results could change up or down. To date only weaker opponents have been played, because I was not expecting this sort of increase. Over the next few days, the full range of opponents will be played, within +/- 300 ELO
Code: Select all
Shredder GUI, ChessGUI by Matthias Gemuh, Ponder off, 5-men EGTB, 128MB hash, random openings with switched sides
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
CCRL 404FRC main list:
Tornado 4.1 64-bit is #15 with rating of 2652 ELO points (+25 -24),
based on 600 games: 295 wins, 180 losses and 125 draws
Score: 59.6%, Average opponent: −70.0, Draws: 20.8%
Pairwise results:
Opponent ELO Score LOS Perf
- Hermann 2.5 64-bit 2617 51.5-48.5 (+42-39=19) 99.4 -25
- Jonny 2.83 2616 57.0-43.0 (+49-35=16) 99.5 +15
- Hamsters 0.7.1 2615 53.0-47.0 (+40-34=26) 99.7 -15
- Ufim 8.02 2590 63.5-36.5 (+54-27=19) 100.0 +39
- DanaSah 4.20 2550 65.0-35.0 (+55-25=20) 100.0 +9
- LittleThought 1.052 64-bit 2504 67.5-32.5 (+55-20=25) 100.0 -23
Ray
Posts: 22613 Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ
Post
by Ray » Sun Oct 31, 2010 6:06 pm
After 1,400 games the improvement over 3.42 is about +90 ELO. Website update with the final batch if games in the next 2 or 3 days
Code: Select all
Tornado 4.1 64-bit in CCRL 404FRC, 2010-10-31
Shredder GUI, ChessGUI by Matthias Gemuh, Ponder off, 5-men EGTB, 128MB hash, random openings with switched sides
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
CCRL 404FRC main list:
Tornado 4.1 64-bit is #15 with rating of 2658 ELO points (+16 -16),
based on 1400 games: 553 wins, 568 losses and 279 draws
Score: 49.5%, Average opponent: +5.0, Draws: 19.9%
Pairwise results:
Opponent ELO Score LOS Perf
- Loop for Chess960 2856 21.5-78.5 (+13-70=17) 0.0 -28
- Bright 0.4a 2820 28.5-71.5 (+17-60=23) 0.0 +2
- Spike 1.2 Turin 2811 25.5-74.5 (+15-64=21) 0.0 -31
- Daydreamer 1.75 64-bit 2704 41.5-58.5 (+31-48=21) 0.0 -16
- Movei 00.8.438 2667 50.5-49.5 (+42-41=17) 16.9 +13
- Frenzee Feb08 64-bit 2665 50.5-49.5 (+45-44=11) 25.8 +11
- Pharaon 3.5.1 2642 56.5-43.5 (+43-30=27) 95.9 +30
- Amyan 1.72 2625 60.5-39.5 (+52-31=17) 99.9 +46
- Hermann 2.5 64-bit 2617 51.5-48.5 (+42-39=19) 100.0 -31
- Jonny 2.83 2616 57.0-43.0 (+49-35=16) 100.0 +9
- Hamsters 0.7.1 2615 53.0-47.0 (+40-34=26) 100.0 -21
- Ufim 8.02 2590 63.5-36.5 (+54-27=19) 100.0 +33
- DanaSah 4.20 2550 65.0-35.0 (+55-25=20) 100.0 +4
- LittleThought 1.052 64-bit 2504 67.5-32.5 (+55-20=25) 100.0 -28