Mini cart v2 with bolder checkout button: +46.6% RPV, unproven
Test run byClean CommitCRO agency
Commentary byLiftArchiveOur analysis, not theirsA second mini cart redesign with a more prominent checkout button lifted revenue per visitor by 46.6% and conversion rate by 26.7%, but we treat it as inconclusive.
Clean Commit ran this test for an anonymized Shopify store and published it in its A/B test library.
Mobile conversion rose while desktop conversion fell 20.9%, and several changes shipped together, so no single change gets the credit.
- Revenue per visitor: +46.6%, the target metric, with a 98.8% probability of beating the control. The agency still called it a signal, not proof.
- Conversion rate: +26.7%, but significance could not be computed. Inconclusive.
- Mobile conversion rate: +45.5%.
- Desktop conversion rate: -20.9%, a negative result that pulls against the headline.
- Orders +21.0%, average order value +16.9%, add-to-cart rate +11.3%.
The change
Bolder checkout, add-on promo back, chat button and overlapping bar gone.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Control
The store's first mini cart redesign, which had dropped an add-on promo widget and had a sticky bar that could cover the checkout button.
Variant
A restyled, more prominent checkout button, no chat button, the add-on promo widget restored, and the scroll overlap fixed.
Why it likely came out this way
Our reading of the result, not the practitioner's claim.
- Bringing back the add-on promo likely helped order value, since shoppers had used it before.
- Fixing the sticky bar overlap removed a problem that blocked checkout on mobile, which may explain the mobile-heavy gain.
- The new layout may not suit larger screens, which could explain the desktop drop.
Caveats: Bundled test: four changes shipped at once, including a bug fix. Sample size and duration were not shared, and mobile and desktop moved in opposite directions.
Who ran it
Clean Commit ran this test for a Shopify store (anonymized) and published the results (Clean Commit A/B test library). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on Clean Commit →
How to run this test on your store
- Hypothesis
- If we make the mini cart checkout button more prominent, remove distractions and keep the add-on promo, then revenue per visitor will rise because shoppers reach checkout with fuller carts.
- Primary metric
- Revenue per visitor
- Guardrails
- Desktop conversion rate
- Average order value
- Who should test it
- Stores where most traffic opens a slide-out mini cart on mobile. Check for layout bugs first, since a fix alone may drive the gain. Test desktop and mobile layouts separately.
Questions
Should I remove the chat button from my mini cart?
It was one of several changes in this test, so its effect alone is unknown.
Test it separately if you want a clear answer.
Why would a mini cart change help mobile but hurt desktop?
Layouts behave differently by screen size. Here a mobile scroll overlap was fixed, which may have helped mobile, while desktop conversion fell 20.9%.
Similar tests
@oliverkenyon@oliverkenyon@oliverkenyon
ConvertiblesConvertibles