Removing mobile discount banner and pop-up: +20.1% add-to-cart
Test run byClean CommitCRO agency
Commentary byLiftArchiveOur analysis, not theirsRemoving the discount banner and discount pop-up on mobile lifted add-to-cart rate 20.1% and click-through rate 12.1%.
Clean Commit ran this test for an anonymized Shopify store and published it in its A/B test library.
The sample was small, only 1,647 mobile visitors, and no order data was shared.
- Add-to-cart rate: +20.1%, the headline number, but on a small sample.
- Click-through rate: +12.1%, the metric the test was set up for, with a 93.8% probability of beating the original.
- Bounce rate: -4.9%, so fewer shoppers left after one page.
- Orders and revenue: not shared, so the effect on sales is unknown.
The change
The variant removes the mobile discount banner and discount pop-up.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Control
The mobile site showed a discount banner and a discount pop-up to shoppers.
Variant
Both the discount banner and the discount pop-up were removed on mobile. The product grid, filters and navigation stayed the same.
Why it likely won
Our reading of the result, not the practitioner's claim.
- On a small screen, a banner and a pop-up take space and attention away from products.
- Closing a pop-up is an extra step that can push some mobile shoppers to leave.
- Two elements were removed together, so it's not clear whether the banner or the pop-up mattered more.
Caveats: Very small sample: 1,647 mobile visitors over 13 days, with no order or revenue data. The banner and pop-up were removed together, so the result can't be split between them.
Who ran it
Clean Commit ran this test for a Shopify store (anonymized) and published the results (Clean Commit A/B test library). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on Clean Commit →
How to run this test on your store
- Hypothesis
- If we remove the discount banner and pop-up on mobile, then more shoppers will click through and add to cart because the screen is less cluttered.
- Primary metric
- Mobile conversion rate
- Guardrails
- Email or SMS sign-ups
- Revenue per visitor
- Discount code usage
- Who should test it
- Stores with heavy mobile traffic and several discount prompts on screen. If your pop-up is a major source of email sign-ups, measure the list growth you lose, not just add-to-carts.
Questions
Do discount pop-ups hurt mobile conversion?
They can. In this test, removing a discount pop-up and banner together lifted add-to-cart 20.1% on mobile, though the sample was small.
Should I remove my discount banner on mobile?
Test it first. You may gain engagement but lose sign-ups or discount-driven orders, so track both.
Is 1,647 visitors enough for an A/B test?
Usually not for firm conclusions. Treat a result this size as a signal and retest with more traffic and order data.
Similar tests
@oliverkenyon@oliverkenyon@oliverkenyon
OptiMonk
@DaveDiederen@DaveDiederen