'High demand' scarcity message in cart: +2.7% CR, not significant
Test run byClean CommitCRO agency
Commentary byLiftArchiveOur analysis, not theirsA cart message saying the items were in high demand and could not be reserved lifted conversion rate 2.7% and orders 3.1%.
Clean Commit ran this 18-day test for an anonymized Shopify store and published it in its A/B test library.
We count it as inconclusive: even with 141,998 visitors, the result did not reach statistical significance.
- Conversion rate: +2.7%, with an 83.1% probability of beating the original. Not significant.
- Revenue per visitor: +2.8%, and orders +3.1%.
- Average order value: +0.1%, flat. The message changed whether people bought, not how much.
- Mobile responded more, with conversion up 3.2% against 0.9% on desktop.
The change
The variant adds a message that cart items are in high demand and not reserved.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Variant
The cart added a message saying the products were in high demand and that items in the cart could not be reserved and might sell out.
Why it likely came out this way
Our reading of the result, not the practitioner's claim.
- Telling shoppers their items are not held gives them a reason to check out now rather than later.
- The cart is late in the journey, so most visitors there already want to buy. A nudge can only move a small share.
- Many shoppers have seen this kind of message before, which may blunt its effect.
- The small lift on a very large sample suggests any real effect is modest.
Caveats: Not statistically significant after 18 days and 141,998 visitors. Results are reported by the agency that ran the test.
Who ran it
Clean Commit ran this test for a Shopify store (anonymized) and published the results (Clean Commit A/B test library). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on Clean Commit →
How to run this test on your store
- Hypothesis
- If we tell shoppers their cart items are in high demand and not reserved, then conversion will rise because they act before the items sell out.
- Primary metric
- Conversion rate
- Guardrails
- Revenue per visitor
- Cart abandonment rate
- Customer complaints
- Who should test it
- Stores with real stock limits, such as small batches or popular sizes. If stock is plentiful, the claim may be untrue and can harm trust.
Questions
Do scarcity messages in the cart work?
They can give a small push. In this test the lift was 2.7% and not significant, even with a very large sample.
Is it OK to say items are not reserved?
Only if it is true. Most carts do not hold stock, but claims of high demand should match your real inventory.
Where is a scarcity message most effective?
Here, mobile shoppers responded more than desktop shoppers.
Test on your own traffic mix before rolling it out.
Similar tests
@DaveDiederen@DaveDiederen@DaveDiederen
@kasper_dolk@kasper_dolk