Which Of These Sticky UI Variables Would You Test?

Amazon, Booking, Airbnb, and Walmart all use sticky UI patterns like these in production.

MDE range 1-3%
72% positive · 29 tests
Taught
by
Jakub
Linowski
Product
Your existing product page
Product
Amazon product page sticky CTA example
Product (Top)
Booking sticky bar at top of page
Product (Bottom)
Booking sticky bar at bottom of page
Product
Airbnb product page sticky CTA
Product (After Date Selection)
Airbnb sticky CTA after date selection
Product
Walmart product page sticky CTA example

Experiment Design

Choose the structure of your experiment.

Variants in this experiment

Targeting / Triggering

Refine where and when the test fires, beyond the page types chosen above in order to increase power (and shorten the testing duration).

Metrics & Ship Requirements

Mark each metric as Primary, Secondary, or Guardrail, then set the requirement it must meet to ship.

Metric Primary Secondary Guardrail Superiority Non-Inferiority Binary Continuous
%
%
%
%
%
%
%
%
%
%
%
%
%

Power, Sample & Duration

The effect you want to detect and how long you'll run to reach the power for it.

%
%
%
%
Total Sample — visitors across all variants
Duration —weeks  

Start Rules

When can the experiment start?

Stop Criteria

When to end the experiment. Pick both for a hybrid.

Stop at

Segments

Which subgroups should we track and break the results down by, to see if the effect differs across them?

Segment Exclude Measure
Long: Benefits most from a persistent sticky CTA
Many (5+): More choices may increase value of a sticky anchor

Iteration Rules

What next experiments to run once the results come in.

Outcome → Re-run with: Higher intensity Higher power Elsewhere Something different Invert Move on
IF Stat sig primary A clear, significant win.
IF Stat sig primary Flat secondary A win on primary, no effect on secondary.
IF Flat primary Stat sig secondary No effect on primary, a win on secondary.
IF Flat primary Flat secondary No significant effect on either.
IF Stat sig neg primary A clear, significant loss.

Export to Experimentation Tools

Pick a destination — copy a plain-text spec, or a JSON config for your platform.


        
        
    

Now Run This Experiment