Windows Desktop Browser Compatibility Comparison - ECMA JavaScript Tests

This page documents a comparison of desktop browser performance in how each of them fares against the suite of JavaScript tests compiled by ECMA. The goal in this comparison is primarily to assess JavaScript compatibility of desktop browsers, and not their execution speed.

The results are given below for the browsers I tend to use. All the tests were run on an ACER Aspire 4730Z, Pentium Dual-core CPU T4200 @ 2.00 GHz with 3GB RAM and Windows Vista Home Premium Service Pack 2, 32-bit:


ECMA Test Suite Version Google Chrome Mozilla Firefox Microsoft IE Opera Apple Safari
Latest Public Version as of October 12, 2011 11016, ES5, 
  25 September 2011  
14.0.835.202 7.0.1 9.0.8112.16421 (9.0.3 update) 11.51 (1087) 5.1.1 (7534.51.22)
Tested Version on October 1, 2011 11016, ES5,
25 September 2011
14.0.835.187 7.0.1 9.0.8112.16421 (9.0.2 update) 11.51 (1078) 5.1 (7534.50)
Time to run (min.)
12 15 20 19 Crashes after 1,4921
Passed tests
10,591 10,829 10,694 7,266 1,481
Failed tests
425 187 322 3,750 9,535
Did not load
0 0 0 0 9,524
Tested version on September 1, 2011 10927, 0.7.5.3,
18 July 2011
13.0.782.218 6.0.1 9.0.8112.16421 11.50 (1074) 5.1 (7534.50)
Time to run (min.)
21 13 20 46 Crashes after 1,7781
Passed tests
10,446 10,718 10,634 6,995 1,773
Failed tests
481 209 300 3,873 9,154
Did not load
1 0 0 66 9,149
Tested Version on August 7, 2011 10927, 0.7.5.3,
18 July 2011
13.0.782.107 5.0.1 9.0.8112.16421 11.50 (1074) 5.1 (7534.50)
Time to run (min.)
24 13 18 18 Crashes after 1,7781
Passed tests
10,4462 10,627 10,629 7,064 1,773
Failed tests
481 255 298 3,863 9,154
Did not load
1 0 0 66 9,149
Tested version on July 1, 2011 10934, 0.7.5.1,
30 June 2011
12.0.742.112 5.0 9.0.8112.16421 11.50 (1074) 5.0.5 (7533.21.1)
Time to run (min.)
55 42 20 46 Crashes after ~300
Passed tests
10,427 10,662 10,634 6,995 ~2,500
Failed tests
507 262 300 3,939 ~8434
Did not load
0 0 0 66 ~8,414

1WebKit2WebProcess.exe stops working after being responsible for nearly 90% of the more than 70% of consumption of my PC's memory; I suspect there is a memory leak in this program. 
2Failed tests include those that did not load.
Comments