iTunes: Just how random is random?

Think that song has appeared in your playlists just a few too many times? David Braue puts the randomness of Apple's song shuffling to the test -- and finds some surprising results.

Think that song has appeared in your playlists just a few too many times? David Braue puts the randomness of Apple's song shuffling to the test -- and finds some surprising results.

Quick -- think of a number between one and 20. Now think of another one, and another, and another.

Starting to repeat yourself? No surprise: in practice, many series of random numbers are far less random than you would think.

Computers have the same problem. Although all systems are able to pick random numbers, the method they use is often tied to specific other numbers -- for example, the time -- that means you could get a very similar series of 'random' numbers in different situations.

This tendency manifests itself in many ways. For anyone who uses their iPod heavily, you've probably noticed that your supposedly random 'shuffling' iPod seems to be particularly fond of the Bee Gees, Melissa Etheridge or Pavarotti. Look at a random playlist that iTunes generates for you, and you're likely to notice several songs from one or two artists, while other artists go completely unrepresented.

This phenomenon has been observed widely across the world, with many conspiracy theorists suggesting there was more method than madness to Apple's randomisation routines.

Just what are they implying? Consider, for a minute, that you're a music industry marketer. There could be little more tempting than direct access to the ears -- and, indirectly, the wallets -- of tens of millions of iPod users around the world.

Through payment of a fee, the theory goes, a record label could increase the rotation frequency of their own music by tweaking Apple's randomisation formula. Popular songs and artists from their catalogue would pop up on playlists time and again, potentially explaining why your 50-strong playlist includes half a dozen Jackson 5 tracks but no Jackson Browne.

Less insidiously, iTunes could be tracking the songs you like the most -- it already does this -- then rotating them more often into its playlists.

Concerns over the randomness of Apple's randomness have even reached the ears of Steve Jobs, who has emphatically denied that the iPod's shuffle feature -- and the design of the iPod Shuffle itself -- is anything more than random. Just tell that to the hundreds of forum participants posters who have posted their complaints about the devices' playlist approach.

After an afternoon spent listening to far too much Bon Jovi, we decided to put iTunes to the test.

Building the perfect library
To evaluate iTunes' randomness, we borrowed a Mac Mini from Apple, with its fresh install of Mac OS X ensuring that we were working with an empty iTunes library and an otherwise completely clean slate.

We purchased AU$170 worth of Apple iTunes Music Store prepaid cards, then proceeded to go on a carefully planned shopping spree. As it was necessary to have multiple songs from one artist to observe any untoward clustering, we purchased five songs from each of four artists, with four artists chosen arbitrarily from the online artist lists of each of the major music labels (EMI, Sony, Universal and Warner Music).

This gave us a total of 80 songs. To see whether popular songs were being rotated more frequently, we also purchased 20 more songs from Billboard's current (as of late February) Top 50 chart, which represented a variety of labels. All told, we purchased and downloaded 100 iTunes songs from the iTunes Music Store (download the spreadsheet for the full song list here).

We then used the Smart Playlist feature to force iTunes to make random playlists 25 and 40 songs long, respectively. Ten playlists of each length were created, providing a total of 20 playlists and 650 possible song positions. Each song list was exported to a text file for analysis using Microsoft Excel.

If Apple and the labels were including any information to change songs' priority, it would arguably be stored in the downloaded AAC files. To test this, we also added another 100 MP3 files, previously ripped from a variety of CDs, that definitely contained no extra coding information whatsoever. These artists included Def Leppard, Bon Jovi, Erasure, Maroon 5, Bob Seger and even John Denver & The Muppets for variety.

With 200 songs in the iTunes Library, we then repeated the random playlist test, creating an additional ten playlists with each of 25 and 40 songs.

Featured Video