Highlights of Week 06/2010
Maestros, at this point a quick note that I will be back writing my own content shortly (have quiet some stuff in my queue). So long, the highlights of week 6/2010:
- Paper iPad - you don't have the money for a real iPad? Make one out of paper
- Using a Pre-Launch Checklist for your Website (by Ben Gremillion) - building a website is fun and believe me, it's funnier to follow a protocol. This one is a great start.
- Leadership Lessons from Dancing Guy (by Derek Sivers) - Value your first follower, embrace him/her as equal, the rest will follow...
- If 1 of 5 users has a problem in a usability test will it impact 1% or 20% of all users? (by Jeff Sauro) - take observed usability issues serious, there are more than likely critical issues.
- Google Maps Get Labs With 9 Cool New Features (by Stan Schroeder) - nothing fancy when you work in a mapping company like ESRI, but probably a heck-full of work for google.
User-Centered Design (UCD) Methods: Comparison and Overview
This is the first in a series of blogs describing User-centered Design Methods. My goal is to summarize my experience, insights and findings across multiple literature and compile them into easy and quick to digest pieces for you to consume. I want to encourage you to comment your own experiences and give me feedback on why your company applies certain methods differently or not at all or something else altogether.
I personally don't like the term Usability too much, it's an empty buzz word. It means SOMETHING to everybody but isn't scientific enough to be taken serious. It's often interpreted wrongly and purely misunderstood by most. It's kinda like Psychology, we know it is important to understand fundamental human behavior, their problems and remedies, but I wouldn't pay a dime to go to a Psychologist. But who knows, just as Psychology got its scientific relevance and acknowledgment - partly maybe through the 'invention' of the IQ - hopefully Usability rises up to similar levels (Jeff Sauro offers interesting metrics via SUM (Single Usability Metric).
That's why I like the term User-centered Design. It works wonders with Project Managers and the-like, probably because Design is such an important term in their daily work. And when asked about Usability testing I can conveniently point out that this is only one tool of many in my UCD toolbox. But the really important sales trick is to know which UCD method is best used at what time in the project management cycle.
The following chart compares the most common user-centered design methods, outlines their cost and shows when to use them:
Overview of user-centered design methods
| Method | Cost | Output | Sample Size | When to Use |
|---|---|---|---|---|
| Competitive Studies | Medium | Stat. & Non-Stat. | 5 | Requirements |
| Focus Groups | High | Non-Statistical | 6-9 | Requirements |
| Field Studies | High | Non-Statistical | 2-3 | Requirements |
| Heuristic Evaluation | Low | Statistical | 2-3 | Design |
| Paper Prototyping | Medium | Stat. & Non-Stat. | 5 | Design |
| Card Sorting | High | Statistical | 15-20 | Design |
| Participatory Design | Low | Non-Statistical | n/a | Design |
| User Testing | Medium | Stat. & Non-Stat. | 5 | Design & Evaluation |
| Surveys | Low | Statistical | 20+ | Requirements & Evaluation |
| Interviews | High | Non-Statistical | 3-5 | Requirements & Evaluation |
| Server Traffic Log Analysis | Low | Statistical | n/a | Evaluation |
| Search Log Analysis | Low | Statistical | n/a | Evaluation |
Not long ago, after having completed a full project management cycle (requirements, design, implementation and evaluation) the PM proudly announced to perform a Focus Group with his stakeholders. Showing the ready application, he thought, would surely impress them and lead to valuable feedback for the next milestone. This impulse isn't uncommon but has to be fought before it becomes reality. Does he really want to produce MORE and EXPENSIVE requirements? Because that's the output of Focus Groups. Wouldn't he be better off running 2 iterations of User Testing to reveal usability issues or a Survey to receive input from outside the development environment?
Recommendations
- Requirements:
- Competitive Studies
- Interviews
- Field Studies
- Design:
- Heuristic Evaluation
- Paper Prototyping
- User Testing
- Evaluation:
- Surveys
- Server Traffic Log Analysis
- Search Log Analysis
- User Testing
- The Usability effort is NOT proportional to the size of the project. Bigger projects spend less percentage on UCD with same effort. Regardless, as a rule of thumb assign 10% of the projects budget for UCD.
- Faster iterations of prototype design require less testers
References
- Fidgeon, T.; User-centered design (UCD) - 6 methods; Nov. 2005; http://www.webcredible.co.uk/user-friendly-resources/web-usability/user-centered-design.shtml
- IBM; User-Centered Design Principles; https://www-01.ibm.com/software/ucd/
- Nielsen, J.; Field Studies Done Right: Fast and Observational; 01/20/2002; http://www.useit.com/alertbox/20020120.html
- Nielsen, J.; How Big is the Difference Between Websites; 01/19/2004; http://www.useit.com/alertbox/20040119.html
- Usability in Practice: Three-Day Intensive Camp; Nielsen, J. et. al.; April 2006; Proceeding, Usability Week 2006


Highlights of Week 02/2010
Posted by Michael Gaigg