Measuring UX
Pick one behavioural measure per goal, pair it with a quality measure, and decide the threshold before you look.
Definition
Measuring experience means choosing indicators that move when the experience changes, and interpreting them without pretending correlation is proof. The common failure is measuring what is easy to collect rather than what would change a decision.
Mixed evidence. Real research exists, but findings conflict, effect sizes are small, or the jump from the lab to interface design is contested.
On this page
Measures and what they actually tell you
| Measure | Tells you | Misleads when |
|---|---|---|
| Task success rate | Whether people can complete the task at all | The task was defined generously, or helped along by a moderator. |
| Time on task | Efficiency for known tasks | Longer is better, as in reading or browsing. |
| Error rate | Where the interface misleads | Errors are recovered so smoothly nobody notices them. |
| SUS or UMUX-Lite | A comparable satisfaction score with published benchmarks | Sample is small, or the questionnaire is run immediately after help. |
| Adoption and retention | Whether the change stuck | A launch spike is read as sustained behaviour. |
| Support contact rate | Where the product fails to explain itself | Support channels changed at the same time. |
Setting up a measure you can trust
- 1
Start from the decision
What would you do differently at a good result and at a bad one? If the answer is the same, do not collect it.
- 2
Pair behaviour with quality
Completion without satisfaction hides a grim experience people endured. Satisfaction without completion hides a pleasant failure.
- 3
Set the threshold in advance
Decide what counts as success before the data arrives, because afterwards every number can be argued into a win.
- 4
Take a baseline
Measure before shipping. A post-launch number with nothing to compare it to settles no argument.
- 5
Watch the counterweight
Every metric can be moved by damaging something else. Name the measure that would catch that and watch it too.
In practice
A metric moved by damage
Session length rose after a navigation change, which was reported as engagement. Task completion had fallen: people were taking longer because they could not find things. The counterweight measure caught it, the headline measure did not.
Sources
Where a source establishes something narrower than the popular reading of it, the note says so.
Measuring the User Experience
Tullis and Albert, 2013
Standard reference for task-based measures and their interpretation.
SUS: A quick and dirty usability scale
J. Brooke, 1996
Origin of the most widely benchmarked satisfaction questionnaire.
Continue from here
Each link says what the connection is, so you can tell a principle from an alternative from a thing people mix this up with.
Principles behind this
The reasoning this solution is an application of.
- Confirmation BiasCognitive bias
- Survivorship BiasCognitive bias
- Product ThinkingMental model
Related concept
Connected closely enough to change how you apply this.
- A/B TestingResearch method
- Funnel AnalysisResearch method
- Product AnalyticsResearch method
- Usability TestingResearch method
- Problem FramingWorkflow