Site-wide shipping info banner: +3.3% conversion, not significant
Test run byClean CommitCRO agency
Commentary byLiftArchiveOur analysis, not theirsA site-wide shipping info banner that opened a details panel lifted conversion rate 3.3%, but the result was not statistically significant, so we count it as inconclusive.
Clean Commit ran this test for an anonymized Shopify store and published it in its A/B test library.
Mobile improved, while desktop revenue per visitor fell sharply.
- Conversion rate: +3.3%, with a 75.8% probability that the variant was better. Not significant.
- Add-to-cart rate: +5.0%, and orders rose 2.1%.
- Mobile: conversion rate +5.5%.
- Desktop: revenue per visitor fell 16.4%, so overall revenue per visitor barely moved (+0.9%). Average order value fell 2.5%.
The change
The variant adds a site-wide banner that opens a shipping and returns panel.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Control
The site had no shipping info banner.
Variant
A banner at the top of every page on mobile and desktop opened a panel when clicked. The panel showed the free shipping offer, shipping times, the returns policy and customer service contacts.
Why it likely came out this way
Our reading of the result, not the practitioner's claim.
- Mobile shoppers have less room to hunt for policies, so a one-tap panel may have helped them most.
- On desktop, the panel may have added friction or pulled attention from browsing.
- Highlighting free shipping can lead shoppers to spend just enough to qualify, which fits the lower order value.
Caveats: 68,939 visitors, duration not shared, and the result did not reach significance. Desktop and mobile moved in different directions.
Who ran it
Clean Commit ran this test for a Shopify store (anonymized) and published the results (Clean Commit A/B test library). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on Clean Commit →
How to run this test on your store
- Hypothesis
- If we add a site-wide banner that opens shipping and returns details, then more shoppers will buy because key questions are answered in one tap.
- Primary metric
- Conversion rate
- Guardrails
- Desktop revenue per visitor
- Average order value
- Add-to-cart rate
- Who should test it
- Mobile-heavy stores whose shipping and return terms are a selling point. Consider showing it on mobile only if desktop revenue drops as it did here.
Questions
Should a shipping banner show on mobile and desktop?
Test them separately if you can. Here mobile conversion rose 5.5% while desktop revenue per visitor fell 16.4%.
What should a shipping info panel include?
This one covered the free shipping offer, delivery times, returns and support contacts.
Keep it to the questions shoppers actually ask.
Similar tests
@oliverkenyon@oliverkenyon@oliverkenyon
@DaveDiederen@DaveDiederen@DaveDiederen