Friday, November 11, 2011

The winners are: Opera, IE, Firefox, Chrome, Safari; in that order.

This is a response to a contentious blog entry I wrote two days ago.

In under 36 hours, a lot has changed:
  • has updated their tests
  • Opera 12 Alpha is out.
  • Firefox 10 Alpha is out.
Also, many said I didn't give Opera a fair shake. So now the beta and alpha builds have been included.

Here's the updated (2011-11-11) results. Each browser's data is compressed with bzip2.
BrowserFailsThe photoThe dataRelease Status
Opera 11.60 beta 11471ScreenshotXML ResultsBeta
IE 10 10.0.8102.06ScreenshotXML ResultsAlpha
Opera 12.00 alpha 111611ScreenshotXML ResultsAlpha
Firefox 10.0a2 2011-11-11160ScreenshotXML ResultsAlpha
Firefox 9.0164ScreenshotXML ResultsBeta
Firefox 8.0164ScreenshotXML ResultsRelease
IE 9 9.0.8112.16421322ScreenshotXML ResultsRelease
Chrome 17 17.0.932.0 dev-m415ScreenshotXML ResultsAlpha
Chrome 16 16.0.912.36 beta-m415ScreenshotXML ResultsBeta
Chrome 15 15.0.874.120 m416ScreenshotXML ResultsRelease
Safari 5.1.1 6534.51.22772ScreenshotXML ResultsRelease
Opera 11.52 11003751ScreenshotXML ResultsRelease
IE 8 8.0.6001.18702N/A[1]ScreenshotN/ARelease
1The test fails to run in IE8, much like the last time. But after the error is hit, the status bar quickly goes back to saying "done". The developers tools, however, shows the error in the same place.

Well, Opera wins. and the old becomes new again. IE10 still takes the number 2 slot with everything else staying nearly the same.

Tests were done on Windows 8, XP, and Vista; to try to main consistency. If you want to contact the author, reply here below. The author is Chris McKenzie; a programmer dedicated to truth, no matter how crazy it gets. Check out his projects on github.


  1. I don't know what to say about this test. I have my doubts.

    We know that Microsoft is very close to ECMA, they approved the OOXML standard (which was very low quality) and make a fast track to approve it ISO. ECMA was the standard body used by Microsoft to do that, and the way the pull out the standard didn't help for their reputation.

    On the other hand the test script is created by the ECMA TC39 team. Who is an active member of that team?
    - David Fugarte (MS Employee) (

    I do not trust ECMA being serious enough about standards. After the OOXML fiasco I just think of ECMA as an standard body were you can give a pile of cash to approve anything.

    There might be good standards promoted by ECMA out there, but I don't trust ECMA anymore.

  2. @Quien? Well ok. But if it was run by a mozilla developer and firefox did well, would you have the same suspicion?

    I think there's too much conspiratorial skepticism with Microsoft. Sure, they have a history of really underhanded tricks; but those were in the 1990s; at what point can they get past those?

    And besides, most of the really dirty tricks are done by marketing, and they are the same tricks that any for-profit-software (Sun, SGI, IBM, Oracl) use; basically "we are more cost effective than free somehow, and read this".

    I don' think this is the case though. I found this test on my own, just by poking around wikipedia and then I went to the site. The buzz and press of this test was created basically, entirely by me; and if Microsoft wants to send me a check for it, I'd probably cash it; but it hasn't happened.

    I think this is a relatively benign and agnostic thing in the world of seedy testing; which is indeed frought with corruption. If you look at the previous post I went into some details about trying to verify the veracity of it; I really can't paint Microsoft into a corner any more so then Google or Mozilla on this one.

    Although if you'd like to start an initiative to get a more "honest" test, then please, I'll hop on board; I'm all for transparency.

  3. This comment has been removed by a blog administrator.

  4. This comment has been removed by a blog administrator.

  5. those last two comments were SEO spam btw ... just for the record. Useful discussion is great. But saying "Great post (client website link)" is not.