Android G1 and Palm Pre versus iPhone and BlackBerry Benchmarks

In my last post, I shared benchmark data for the web browser on the iPhone versus BlackBerry. My theory is that web browser performance is critically important for smartphone user experience. Furthermore, the BlackBerry seems to be embarrassingly inferior to the iPhone in this respect. This begs the question, how do other phones stack up.

All PhonesThanks to two friends, I have SunSpider JavaScript benchmark results for the G1 and for the Palm Pre. Based on the graphs here, it’s clear that the G1 and the Pre are both considerably better than the BlackBerry Bold. Specifically, the G1 is 9.6 times faster than the Bold, and the Pre is 15 times faster.

All but BlackBerryOn the other hand, the G1 and the Pre both compare unfavorably to the iPhone 3GS. The G1 is 6 times slower, as can be seen from the graph that excludes the BlackBerry. The Pre is 3.7 times slower. Neither the Pre nor the G1 achieve the performance of the first-gen iPhone.

Knowing the Android/G1 performance also helps to answer if this is a Java versus Objective C issue. Both the BlackBerry and Android are Java-based phone systems. Java puts a bigger burden on the virtual machine implementor to be responsible for performance, and has a reputation for overall worse performance than more native languages like Objective C. The G1 demonstrates that RIM could be doing a lot better with the BlackBerry.

it is also worth noting that the SunSpider benchmark was developed by the WebKit development team, and WebKit is the basis for the iPhone browser. It is unsurprising that the iPhone does well on this benchmark, it is likely used as part of the development process. However, it is still the best general JavaScript benchmark available.

The main conclusion to be drawn here is that if you want a web browser in your pocket, the BlackBerry is right out. When it comes to deciding between iPhone, Android, and Pre, it is likely that things other than JavaScript performance will drive your decision.

5 Comments »

 
  1. Kevin Riggle says:

    The G1’s browser is based on WebKit as well (see eg. this article, so it’s not just possible benchmark bias at work here.

    I wonder how long before the V8 JavaScript VM gets ported to Android.

  2. tibbetts says:

    I’m told the Palm Pre browser is also WebKit: http://opensource.palm.com/packages.html

    That makes BlackBerry the only non-WebKit phone under test. And makes the wide difference in performance between the WebKit phones all the more surprising.

  3. Hayden Schultz says:

    The Pre’s browser is also based on WebKit.

  4. Hayden Schultz says:

    Web page rendering speed is what users experience. That’s probably more important. Don’t know how the iphone stacks up against the G1, but it’s apparently about 11% faster than the pre. That’s nice, but not a big deal (at least to me).

    http://www.appleinsider.com/articles/09/06/19/iphone_3g_s_faster_than_palm_pre_500k_sales_conservative.html

  5. Kevin Riggle says:

    Hayden: I don’t know about you, but I use enough JavaScript-heavy sites that JS performance makes a big difference in how I perceive snappiness. I’ve actually just switched to the Google Chrome Linux beta on my EeePC largely because it handles JS significantly faster. (4.3x faster, when I ran the SpiderMonkey benchmark out of curiosity. Dunno how it compares on page-rendering speed.)