DigiJaws

AI Search Visibility & Agent Readiness

Free A/B Test Significance Calculator

← All free tools
FREE TOOL · EXPERIMENTATION

A/B Test Significance Calculator

Drop in two variants and instantly know whether your winner is statistically real — or just random noise you would be unwise to ship.

Variant A CVR
Variant B CVR
Relative Lift
Confidence
Enter your numbers to see significance.

Confidence below 95% means the result could be random chance — do not ship it yet. This uses a two-tailed two-proportion z-test, the same standard real testing tools use.

Frequently asked questions
What is statistical significance in A/B testing?
It is the confidence that a difference between two variants is real and not random chance. 95% confidence is the standard threshold for calling a winner.
How large should an A/B test sample be?
Large enough to reach 95% confidence. Small samples produce noisy results that look like wins but disappear at scale.
What does relative lift mean?
Relative lift is the percentage improvement of variant B over variant A. A jump from 5% to 6% conversion is a 20% relative lift.
Run tests that actually compound.

DigiJaws runs disciplined experimentation programs that turn small wins into a permanent conversion advantage.

Deploy CRO →
Keep going · related free tools
See your site’s full SEO score — free.Instant audit, 10 checks, no signup to see it.
Run free audit →
Free tools →My toolkit →Locations →Comparisons →
Verified Agent-Ready by DigiJaws
Start free with all 34 tools — no credit card, cancel anytimeStart Free