User-testing the iPlayer
- 4 May 07, 08:16 PM
Recently, I met with Mark Howell from the User Experience Design team to discuss how user-testing fits into the development of the 大象传媒 iPlayer.
User-testing is a fascinating part in the development life cycle. Rather than just guessing how someone might use the iPlayer, user-testing involves studying how it actually is used, identifying what works well and what doesn 't.
The first stage in the process is to meet with the people involved in creating the iPlayer, like the copywriters and the designers, in order to identify areas to explore. From that, a number of scenarios are drawn up to test questions that arise from the consultation.
It might be, for instance, that the team is unsure if 'Gardner's World' is most sensibly listed as a factual or educational programme. This can be tested with a task that asks users to find the programme. This is the kind of issue where user testing comes into its own. Grey areas where both options might seem equally sensible can be resolved by seeing how users actually go about finding the programme.
Testing has been carried out with small groups of between eight to ten people. Groups are usually representative of both genders and all ages. The one thing they have in common is that they can be described as 'novice' users. It is important to the 大象传媒 that the iPlayer is as simple as possible to use, regardless of how technically literate someone is. So what better way to put that to the test than with novice users?
There is more to user-testing than just asking, "Does this look OK to you?" Users are given the tasks to complete and as they do so, they are asked to 'think out loud' and talk through what they are doing and explain their reasoning as they go.
The responses are then assessed and grouped into any themes running through a majority of user experiences. This information is then taken to the stakeholders for discussion. It may be that solutions are identified straight away, or that more research needed. User-testing is very much an iterative process, and the 大象传媒 have carried out several rounds already.
User-testing has had a significant impact on the iPlayer. Originally, the starting page was to be called "Highlights". But users found this too confusing, and disorientated them when navigating. Consequently, the starting page will be known as the home page. Sometimes, it is just better to meet users expectations, rather than do something too clever.
Some specific testing is also planned for other user groups as well, including children and those with accessibility issues. What all of this means is that whilst other media players may be effectively doing their testing in a live environment at your inconvenience, when the iPlayer formally launches, then it should work well for all from day one.
The 大象传媒 is not responsible for the content of external internet sites
颁辞尘尘别苍迟蝉听听 Post your comment
Just signed up to further user test the iplayer and came across your blog. You make some interesting points about user testing that I'd like to incorporate in an assignment for my students - ok to quote you?
Complain about this post
Hi Barbara
I don't think there is a problem with quoting me in the assignment for your students. I wonder if you could email me via the link above? I'd like to talk to you about user testing.
Complain about this post
I've just discovered that the 大象传媒's commercial tie-in with a predatory convicted US monopolist (yes, Microsoft) means that I will never be able to access the 大象传媒 content published for download using iPlayer - you guessed it, only Microsoft users will be able to do so!
OK, Beeb, how much of a refund of my huge TV licence fee can I expect?
Complain about this post
How about designing and testing a user experience that isn't limited to a single operating system?
Complain about this post
Very good - glad to hear some of you are having fun with the iPlayer.
Now - how about those of us who have been looking for the damn thing for months and have yet to find anywhere we can download a copy to test at all? I mean, if the 大象传媒 really wants this thing testing, you would have thought there would be a bloody link to it somewhere!
It doesn't even turn up if you search the 大象传媒 for it.
Complain about this post
What a serious disappointment!
You download a mass of software which seems to trample all over your system The main suspect is Kservice.exe - a nasty little P2P program, frequently recognised as malware.
I spent what seemed like hours downloading programs which were all actually very disappointing to watch. The relatively small, relatively low resolution PC monitor does not make telly watching a particularly enjoyable experience. Certainly unsuitable for "family viewing".
Even more annoying was the P2P 'business'. After getting bored waiting for the download to complete, I often left the computer downloading overnight to discover that the thing had been busy wasting even more of my bandwidth uploading the same programs to someone else. Sorry but I hate giving my valuable bandwith away to someone I don't know.
I UNinstalled the iPlayer this evening and felt more satisfied than I have been for a couple of weeks.
Unless there are big changes, I doubt I will install the 'alpha' software when it comes.
Complain about this post
1. Installed
2. Watched how it works
3. Uninstalled
I won't be using the iPlayer while the nasty Kontiki kservice remains on my system. _I_ decide when/what I upload/download from/to my computer, not the iPlayer. The 大象传媒 should not be at liberty to loan out my bandwith to anyone else. I'm still also at a loss as to why the ridiculous DRM system is in use. I can record 大象传媒 to DVD and keep it forever and watch as many times as I like.
Complain about this post