What held up, what didn’t, and what we left open
What held up, what didn’t, and what we left open
We tested with real users twice: first on the original design to find where people got stuck, then on our final design to see if the fixes worked.
Round one: 6 people, original design
What people ran into What we changed
5 of 6 couldn’t confirm which playlist was playing Designed a tag on Now Playing that names the playlist
2 of 6 tripped on the word “Library” Renamed it My Music
1 of 6 couldn’t tell playlists from albums or audiobooks Added a small icon to each card
“If I really want to know the playlist, obviously you have to click a lot… so then that’s probably not so safe.”
Round two: 79 people, final design
starting a playlist: very easy
getting to a playlist: very easy
getting to Now Playing: very easy
raised Now Playing unprompted
Held up
Starting a playlist: 77 of 79 called it very easy, and every single person said the labels matched
Getting to a playlist: 71% called it very easy, and 91% said the labels matched
Still weak
Getting to Now Playing drew the most “difficult” ratings: 10 people, against 2 and 0 for the other tasks
Only 75% said its label matched what they expected
Why Now Playing kept slipping
Our final design had a bar at the bottom showing the current song, but only on the home and My Music screens, and it read “Resume Playing,” which sounds paused. Inside a playlist, where the task started, the bar disappeared. The only way to Now Playing from there was a small icon in the corner, or pressing Play.
Inside a playlist · no bar
Same prototype, two screens. The bar people were looking for wasn’t on the one where the task began.
“I expected there to be a bar on the screen where I can see the music that’s currently playing.”
Our walkthrough had actually flagged this a month earlier. Our early sketch already added a clearer Now Playing icon and label, but the walkthrough couldn’t score it because Now Playing wasn’t one of the five steps we walked. It took real people to show us how much it mattered.
What we’d do differently
Measure what people do, not just how it felt: round two collected ratings, and the tool marked Task 3 done as soon as someone pressed Play. Next time we’d record whether each task was actually completed and how many taps it took.
Check the task wording against the screen: Task 3 said “You’re viewing a playlist. Go to the Now Playing screen,” but nothing was playing yet. A quick pilot would have caught that.
Close the loop on what we fixed: we never retested finding Apple’s curated playlists, the task that failed hardest, and we never tested the playlist tag we designed after round one.
Test it in a car: every session ran on a laptop or phone. How long someone looks away from the road is the thing that matters most here, and we couldn’t measure it sitting at a desk.