Netflix Style Pricing Pages

Netflix A/B tested at least three pricing plan layouts between 2019 and 2026. Now, in 2026, a third version is live. Run the experiment and see whether Netflix really picked the winning treatment.

MDE range 1-3%
Lessons 8
Taught
by
Ishan
Goel
Jakub
Linowski
Your existing pricing page

Choose your plan

Downgrade or upgrade at any time.

Monthly price
$9.99
$13.99
$16.99
HD available
Ultra HD available
Screens you can watch at the same time
1
2
4
Watch on your laptop, TV, phone and tablet
Unlimited movies and TV shows
Cancel anytime
HD and Ultra HD availability subject to your Internet service and device capabilities. Not all content available in HD or Ultra HD.

Choose your plan

Downgrade or upgrade at any time.

Choose your plan

Downgrade or upgrade at any time.

Monthly price $16.99
Resolution Ultra HD
Screens 4
Laptop, TV, phone & tablet Yes
Unlimited movies & TV shows Yes
Cancel anytime Yes
Ads No ads

Simulated Test Run

Variant Visitors Purchases Purchase rate True effect Measured effect p-value

Experiment Design

Choose the structure of your experiment.

Prior Evidence Checks

To increase your odds of success, maximize impact and decrease sample size.

Should a default plan be pre-selected?

Recommended: Highest Plan Selected, worth +10.2% in Test 525. The winning variant defaulted to the most expensive option, and the lift came from anchoring rather than from the discount itself - so keep the price visible while the plan is pre-selected.

How many plans should be offered?

Recommended: More plans, worth +9.3% in Test 319. Cutting the lineup down to fewer plans lost ground here. A fuller range likely gives visitors a better fit and a stronger price anchor, so keep the extra tier rather than trimming it away.

Targeting / Triggering

Refine where and when the test fires, beyond the page types chosen above in order to increase power (and shorten the testing duration).

Metrics & Ship Requirements

Mark each metric as Primary, Secondary, or Guardrail, then set the requirement it must meet to ship.

Metric Primary Secondary Guardrail Superiority Non-Inferiority Binary Continuous
%
%
%
%
%
%
%
%
%
%

Power, Sample & Duration

The effect you want to detect and how long you'll run to reach the power for it.

%
%
%
%
Total Sample — visitors across all variants
Duration —weeks  

Meta-Analysis

Combine your experiment with that of others to reach a decision faster or increase power.

Start Rules

When can the experiment start?

Stop Criteria

When to end the experiment. Pick both for a hybrid.

Stop at

Segments

Which subgroups should we track and break the results down by, to see if the effect differs across them?

Segment Exclude Measure

Iteration Rules

What next experiments to run once the results come in.

Outcome → Re-run with: Higher intensity Higher power Elsewhere Something different Invert Move on
IF Stat sig primary A clear, significant win.
IF Stat sig primary Flat secondary A win on primary, no effect on secondary.
IF Flat primary Stat sig secondary No effect on primary, a win on secondary.
IF Flat primary Flat secondary No significant effect on either.
IF Stat sig neg primary A clear, significant loss.

Now Run This Experiment