Bundle banner moved next to add to cart: -45.5% RPV, inconclusive
Test run byClean CommitCRO agency
Commentary byLiftArchiveOur analysis, not theirsMoving a 'Buy 3 sleeves' bundle banner next to the add-to-cart button came with a 45.5% drop in revenue per visitor, though clicks rose 7.0%.
Clean Commit ran this test on an anonymized Shopify store's product page and labelled it a positive signal.
Because the label and the numbers conflict and no sample or significance was shared, we treat it as inconclusive.
- Revenue per visitor: -45.5% (goal metric). A large drop, not a win.
- Conversion rate: -22.5%, add-to-cart rate: -29.8%, and average order value: -27.3%. All moved the wrong way.
- Clicks: +7.0% and click-through rate: +2.8%. More shoppers interacted with the banner.
- The agency still labelled it a positive signal, so we count it as inconclusive rather than a clear loss.
The change
The variant moves a redesigned, clickable bundle banner next to add to cart.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Control
The product page showed a 'Buy 3 sleeves' bundle promo banner in its original spot and design.
Variant
The banner moved next to the add-to-cart button, got a new design, and became clickable to open a popup. These changes were tested together.
Why it likely came out this way
Our reading of the result, not the practitioner's claim.
- A banner beside the add-to-cart button may have pulled attention away from buying the single item.
- Opening a popup adds a step, which may have stalled shoppers at the point of purchase.
- The bundle's value may not have been clear, so extra visibility did not turn into bundle sales.
Caveats: Three changes (placement, design and a popup) shipped together, so none can be credited alone. The source labels conflict with its own numbers, and sample size, duration and significance were not shared.
Who ran it
Clean Commit ran this test for a Shopify store (anonymized) and published the results (Clean Commit A/B test library). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on Clean Commit →
How to run this test on your store
- Hypothesis
- If we show the bundle offer next to the add-to-cart button, then average order value will rise because shoppers see the deal at the moment they decide.
- Primary metric
- Revenue per visitor
- Guardrails
- Add-to-cart rate
- Conversion rate
- Bundle take rate
- Who should test it
- Stores selling consumables or items people buy in multiples, like sleeves or socks. Test placement and the popup separately, and stop early if add-to-cart drops this sharply.
Questions
Should bundle offers sit next to the add-to-cart button?
Be careful. In this test the move came with large drops in add-to-cart rate and revenue per visitor, though the result was not confirmed.
Why can a more visible bundle offer reduce sales?
It can distract from the main purchase or add a decision at the last step.
If the bundle's value is not clear, shoppers may hesitate.
How should a bundle placement test be set up?
Change one thing at a time, such as position first, then design.
Track add-to-cart and revenue per visitor, not just clicks on the banner.
Similar tests
@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon