Shipping info banner with drawer: +4.7% conversion, not significant
Test run byClean CommitCRO agency
Commentary byLiftArchiveOur analysis, not theirsA shipping info banner at the top of every page, opening a drawer of shipping and returns details, lifted conversion rate 4.7%, but the result was not statistically significant.
Clean Commit ran this test for an anonymized Shopify store and published it in its A/B test library.
We count it as inconclusive, with a strong positive lean on desktop.
- Conversion rate: +4.7%, with a 90.2% probability that the variant was better. Not significant.
- Revenue per visitor: +2.9%, and orders rose 2.2%.
- Desktop: conversion rate +9.1% and revenue per visitor +10.5%.
- Average order value: -0.5%, so any gain came from more orders, not bigger ones.
The change
The variant adds a top banner that opens a shipping and returns drawer.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Control
The site had no shipping info banner.
Variant
A banner at the top of the page on desktop and mobile opened a drawer when clicked. The drawer covered free shipping, shipping times, the returns policy and customer service contacts.
Why it likely came out this way
Our reading of the result, not the practitioner's claim.
- Shipping costs and return rules are common reasons to hesitate, and the banner answered them without leaving the page.
- Putting the details in a drawer kept the banner short while still offering depth to shoppers who wanted it.
- Desktop users may have had more room to notice and open the banner.
Caveats: 135,421 visitors over 41 days, and the result did not reach significance. The same store ran similar banner tests with weaker results.
Who ran it
Clean Commit ran this test for a Shopify store (anonymized) and published the results (Clean Commit A/B test library). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on Clean Commit →
How to run this test on your store
- Hypothesis
- If we add a site-wide banner that opens shipping and returns details, then more shoppers will buy because their delivery and return worries are answered early.
- Primary metric
- Conversion rate
- Guardrails
- Revenue per visitor
- Average order value
- Banner click rate
- Who should test it
- Stores with generous shipping or return terms that shoppers may not know about. If your terms are average or strict, highlighting them may not help.
Questions
Does showing shipping information increase conversions?
It can. Here conversion rose 4.7%, but not significantly, so treat it as a lead to test rather than a sure win.
Should shipping details go in a banner or a drawer?
This test used both: a short banner that opens a drawer.
That keeps the page clean while giving full details on demand.
Similar tests
@oliverkenyon@oliverkenyon@oliverkenyon
@DaveDiederen@DaveDiederen@DaveDiederen