Product Analytics
Measuring what people do at scale, which tells you where problems are and never why they exist.
Definition
Product analytics records user actions as events and aggregates them. It is comprehensive about behaviour within the product and silent about intention, context and everything that happens outside it.
Craft convention. True because the industry converged on it. Breaking it costs familiarity, not correctness.
What analytics can and cannot answer
- Can: how many, how often, in what order, where people stop.
- Can: whether a change moved a number.
- Cannot: why people stopped.
- Cannot: what people wanted and did not find.
- Cannot: who never arrived at all.
Practical rules
- Design the event taxonomy before instrumenting. Renaming events after the fact loses history.
- Segment before concluding. An aggregate median usually hides two distinct populations.
- Watch for survivorship bias: everyone in your data is someone who got that far.
- Pair every surprising number with qualitative work before acting on it.
- Respect consent and data minimisation obligations. Collect what you will use.
Continue from here
Each link says what the connection is, so you can tell a principle from an alternative from a thing people mix this up with.
Applies when you are designing
Principles behind this
The reasoning this solution is an application of.
- Availability HeuristicCognitive bias
- Survivorship BiasCognitive bias
- Help and DocumentationHeuristic
- Pareto PrinciplePrinciple
Often used with
These usually appear in the same screen or the same decision.
Short definition
The one-paragraph version, for when that is all you need.
- ActivationTerm
- BenchmarkTerm
- CohortTerm
- North Star MetricTerm
- Quantitative ResearchTerm
- RetentionTerm
- TriangulationTerm
- Vanity MetricTerm
Related concept
Connected closely enough to change how you apply this.
- A/B TestingResearch method
- Funnel AnalysisResearch method
- SurveysResearch method
- User InterviewsResearch method
- Measuring UXWorkflow
- Prioritising Design WorkWorkflow