Research Synthesis
Turning raw observations into findings, which is where most of the value and most of the bias enters.
Definition
Synthesis codes raw research data, groups it into themes, and derives findings that can inform decisions. It is the step where quality is won or lost, and the step most often skipped under time pressure.
Established research. Originates in published research and has been replicated. The effect is real. Its size in your product still needs measuring.
On this plate
Reach for this when
- After any qualitative research.
- Combining findings from several methods.
- Several people took notes and the team is about to argue from memory.
Common mistakes
- Writing findings from memory.
- Themes stated as topics rather than findings.
- No frequency information.
- Disconfirming evidence omitted.
- Synthesising alone, then presenting conclusions the rest of the team never saw the data for.
A workable process
- 1
Capture observations atomically
One observation per note, in the participant's words, with a session identifier.
- 2
Code inductively first
Let categories emerge from the data before applying your existing framework.
- 3
Group into themes
Cluster related codes. Name each theme as a statement, not a topic.
- 4
Count
State how many participants exhibited each theme. 'Three of eight' is meaningfully different from 'users said'.
- 5
Separate observation from interpretation
Keep what happened distinct from what you think it means, so others can disagree with the second without discarding the first.
- 6
Include disconfirming evidence
Report what contradicted the theme. Its absence is a signal that the analysis was not neutral.
Keeping the chain back to the data
Do
- Tag every observation with the session it came from, so a finding can be traced.
- Write findings as claims that could be wrong, not as themes that cannot.
- Count how many participants support each claim, and say so in the report.
- Keep the contradicting observations visible instead of smoothing them out.
Do not
- Start from the categories you expected to find.
- Let the most articulate participant become the finding.
- Report a quote without saying how common the view was.
- Present a recommendation without the observation that produced it.
Three levels, kept apart
Most disputed research reports have collapsed these into each other. Keeping them separate is what makes a finding arguable rather than personal.
| Level | Example | Who can challenge it |
|---|---|---|
| Observation | Four of eight participants opened a spreadsheet during the task | Only the recording |
| Finding | The product does not support comparing options side by side | Anyone, with other observations |
| Recommendation | Add a comparison view to the results page | Anyone, on cost, priority or a different solution |
In practice
- i.
Two people, one loud
WeightingA single articulate participant can produce more quotable material than the other seven combined. Counting participants per claim is the cheapest available defence against a report that is really one person's opinion.
Commonly confused with
Close neighbours that get substituted for each other. The difference is stated first, then the condition that picks one over the other.
Affinity Mapping
Research methodBottom-up clustering of individual observations, with the groups named last.
Key difference
Synthesis is the whole step from raw data to findings a team can act on. Affinity mapping is one technique inside it. Clustering notes on a wall is not synthesis until the themes are interrogated and turned into findings.
Use Research Synthesis when
- The question is how to get from sessions to conclusions.
- Rigour, traceability and bias are the concern.
- The output has to survive being challenged.
Use Affinity Mapping when
- You have a pile of observations and no structure yet.
- The session is collaborative and needs a concrete activity.
- Naming last is the point, so expectations do not drive the sorting.
Local chart
RES·014 · Region IV · Grid H2
This entry and the entries it is stated to connect with. Each line is labelled with what the connection means.
Continue from here
Each link says what the connection is, so you can tell a principle from an alternative from a thing people mix this up with.
Principles behind this
The reasoning this solution is an application of.
- Availability HeuristicBIAS·011 · Cognitive bias
- Confirmation BiasBIAS·009 · Cognitive bias
Often used with
These usually appear in the same screen or the same decision.
- Journey MapTPL·004 · Template
- PersonaTPL·003 · Template
- Research PlanTPL·001 · Template
- CondensTOOL·015 · Tool
- DovetailTOOL·014 · Tool
- FigJamTOOL·006 · Tool
- MiroTOOL·007 · Tool
- MuralTOOL·008 · Tool
- NotionTOOL·044 · Tool
Short definition
The one-paragraph version, for when that is all you need.
- PersonaTERM·116 · Term
- TriangulationTERM·023 · Term
Related concept
Connected closely enough to change how you apply this.
- Research Notes to InsightsAI·003 · AI workflow
- Contextual InquiryRES·012 · Research method
- Diary StudiesRES·013 · Research method
- Jobs to Be DoneRES·018 · Research method
- SurveysRES·004 · Research method
- Usability TestingRES·001 · Research method
- User InterviewsRES·003 · Research method
- Problem FramingFLOW·007 · Workflow