Noctral

ASO and experiments

A/B test sample size calculator

Plan a per-variant sample to compare two conversion rates with equal allocation, a two-sided test, and a normal approximation.

Build your scenario

Runs in your browser. No signup.

Starting values are editable examples.

Sample per variant
8,158
Total sample (two variants)
16,316
Minimum detectable conversion
6%

Estimate without continuity correction. Requires independent observations, two variants, and equal allocation; not for sequential tests or multiple comparisons.

How it works

p1 = baseline; p2 = p1 × (1 + MDE). n = ceiling([zα√(2p̄(1−p̄)) + zβ√(p1(1−p1)+p2(1−p2))]² ÷ (p2−p1)²).

Worked example

A 5% baseline, 20% relative MDE, 95% confidence and 80% power plan about 8.2k observations per variant.

Assumptions and limits

Estimate without continuity correction. Requires independent observations, two variants, and equal allocation; not for sequential tests or multiple comparisons.

Method reference: NIST: difference of proportions

Frequently asked questions

How do I use the a/b test sample size calculator?

Plan a per-variant sample to compare two conversion rates with equal allocation, a two-sided test, and a normal approximation.

Does a 20% MDE mean 20 percentage points?

No. With a 5% baseline, 20% relative lift means reaching 6%, a difference of 1 percentage point.

Do I need an account and are my inputs uploaded?

No account is required. Calculations run in your browser. Entered numbers and text are not included in tool analytics events; only the tool ID, language, and action are recorded.

Want to go past the numbers and see the real market?

Noctral shows estimated MRR, live ads, creators, and competitors so you can validate opportunities with real signals instead of projections.

See Noctral data

Noctral Pro

Stop picking app ideas in the dark.

Use estimated revenue, downloads, rankings, and competitor signals to decide what to build or improve in your current app.

Start now