Visitors and conversions for a control plus any number of variants → conversion rates, uplift, and whether each difference is statistically significant.
Variants
The first row is your control (baseline) — every other variant is compared against it. Add as many as you're testing.
Confidence level
| Variant | Conv. rate | Uplift | Z-score | P-value | Result |
|---|
About this calculator
This uses a two-proportion z-test, the standard method for comparing conversion rates between two groups. Each variant is tested individually against the control: pooling the two groups' conversions to estimate a shared standard error, then measuring how many standard errors apart the two observed rates are (the z-score).
The p-value is the probability of seeing a difference this large (or larger) if there were actually no real difference between that variant and the control. If the p-value is below your chosen significance threshold (5% at 95% confidence, 1% at 99%, and so on), the result is considered statistically significant.
Testing several variants against the same control at once increases the chance that at least one shows up "significant" purely by chance — known as the multiple comparisons problem. Treat borderline results across many variants with extra caution, or raise your confidence level accordingly.
A significant result doesn't guarantee the uplift is real forever — it means the difference is unlikely to be due to random chance alone, given the sample sizes you tested. Small sample sizes need much larger differences to reach significance than large ones do.