App Store Data for December 2009

Ok, so it has been a while since I’ve posted an update of the App Store data. Since it’s been so long, I’m including a special bonus. But first, a couple of notes:

1. It looks to me like the XML feed that I scrape to gather this data limits the results to 6000 applications per category. I’m not sure that they’re ordered by popularity, though that certainly would make sense. This same limit is in the iTunes UI that uses the feed, so popularity is sensible.
2. I haven’t look closely at the data, nor tried to to put together any trends. You’re on your own!
3. I added a few additional columns to the data that I scrape:
   1. ApplicationUrl
   2. IconUrl
   3. Rating
   4. RatingContent

And as the special super cool bonus, I’ve posted not only data for North America, but data for 61 additional markets.

As always, I’m happy to share the data, but would love to learn from people- please share what you learn with this!

Download US only data (6MB)

Download 62 markets (198MB)

Comments

[Matthew]

Charles,

Thank you for always sharing your data through your blog.

Looking at the US data, I noticed there are about 30,000 duplicated App IDs. However, these duplicated IDs have different values for some of the other fields. Do you have any insight why this would occur?

I appreciate any help you can provide.

[Jon]

The international data file refuses to download for me...Using Chrome 3.0 for Windows, it stops around the 160 MB mark. Using Safari 4.0.4 in OS X 10.6.2, it just keeps on going. I stopped it at 220 out of 198 MBs (which doesn't make sense for me either). The file was still a .download file, and when I renamed it to a ZIP, it could not be unarchived.

Could you maybe post this link somewhere else, like MediaFire?