A/B Test
Showing two versions to different people and comparing the results.
Definition
A controlled experiment comparing variants by randomly assigning users and measuring a predefined metric.
Craft convention. True because the industry converged on it. Breaking it costs familiarity, not correctness.
On this plate
In plain language
Showing two versions to different people and comparing the results.
Example
Testing two checkout layouts with the sample size and stopping rule fixed in advance.
Local chart
TERM·100 · Region X · Grid D5
This entry and the entries it is stated to connect with. Each line is labelled with what the connection means.
Continue from here
Each link says what the connection is, so you can tell a principle from an alternative from a thing people mix this up with.
Deeper reading
The full entry behind this definition.
- Confirmation BiasBIAS·009 · Cognitive bias
- A/B TestingRES·009 · Research method
Related concept
Connected closely enough to change how you apply this.
- Statistical SignificanceTERM·025 · Term
Nearby in the Atlas
Adjacent territory, found through shared tags rather than a stated link.