Redesigned mobile mini-cart button: +4.7% conversion, not significant
Test run byClean CommitCRO agency
Commentary byLiftArchiveOur analysis, not theirsRedesigning the main button in the mobile mini-cart lifted conversion rate 4.7%, but with only 1,215 visitors the result is not statistically significant.
Clean Commit ran this test for an anonymized Shopify store and published it in its A/B test library.
The agency calls it a positive signal; we count it as inconclusive.
- Conversion rate: +4.7%, with a 76.9% probability of beating the original. Inconclusive: not statistically significant.
- Orders: +5.9%.
- Revenue per visitor: +4.6%.
- Average order value: -0.1%, essentially flat, so any gain came from more orders rather than bigger ones.
The change
Only the main button in the mobile mini-cart changes.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Control
The mobile mini-cart showed the store's original main call-to-action button.
Variant
The main button in the mobile mini-cart got a new design. The test ran on mobile visitors only.
Why it likely came out this way
Our reading of the result, not the practitioner's claim.
- A clearer, more prominent button may make the next step to checkout easier to spot on a small screen.
- The mini-cart is a short step from purchase, so a small button change can only move things so much.
- With 1,215 visitors, a lift of this size is well within what chance alone can produce.
Caveats: Very small sample: 1,215 mobile visitors, with a 76.9% probability to win. The result is directional only, and the source does not describe the exact design change.
Who ran it
Clean Commit ran this test for a Shopify store (anonymized) and published the results (Clean Commit A/B test library). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on Clean Commit →
How to run this test on your store
- Hypothesis
- If we make the main mini-cart button on mobile clearer and more prominent, then more shoppers will go on to buy because the path to checkout is easier to see.
- Primary metric
- Mobile conversion rate
- Guardrails
- Average order value
- Cart abandonment rate
- Who should test it
- Stores that use a slide-out mini-cart on mobile and see many shoppers open it without checking out. You need far more than 1,215 visitors to confirm a lift of about 5%, so plan for a longer run.
Questions
Does the checkout button design in a cart drawer matter?
It can, but this test was too small to say.
Conversion rose 4.7% with only a 76.9% chance that the change was better.
How many visitors do I need to test a button change?
Usually tens of thousands for a lift of a few percent.
A test with about 1,200 visitors can only catch very large effects.
Should I test mini-cart changes on mobile only?
Mobile is where the mini-cart is often the main route to checkout, so it is a sensible place to start. Run desktop separately if the design differs.
Similar tests
@oliverkenyon@oliverkenyon@oliverkenyon
ConvertiblesConvertibles