Redesigned mobile 'selling fast' badge: -0.9% conversion, flat
Test run byClean CommitCRO agency
Commentary byLiftArchiveOur analysis, not theirsA redesigned mobile "selling fast" badge on five selected products changed conversion rate by -0.9%, a result too small to call either way.
Clean Commit ran this follow-up test for an anonymized Shopify store and published it in its A/B test library.
The redesign did lift mobile order value, the problem it was built to fix.
- Conversion rate: -0.9%. Inconclusive: the original had only a 66.8% probability of being better.
- Revenue per visitor: +1.8%, also within normal variation.
- Average order value: +2.7% overall and +3.8% on mobile, the metric the redesign targeted.
- Orders: -1.4%, another small, inconclusive move.
The change
The variant shows a redesigned mobile 'selling fast' badge on five products.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Control
The store without the "selling fast" badge.
Variant
A "selling fast" badge sat on the product images of five selected products, with a new mobile design. The redesign followed an earlier version that had lowered mobile order value.
Why it likely came out this way
Our reading of the result, not the practitioner's claim.
- A badge on only five products is unlikely to shift store-wide conversion much.
- The new mobile design may have removed whatever pulled shoppers toward cheaper items in the first version.
- Shoppers who have already seen urgency cues often learn to ignore them, which can blunt the effect over time.
Caveats: 95,695 visitors over 35 days, and none of the changes reached significance. Treat the order value gain as a hint, not proof.
Who ran it
Clean Commit ran this test for a Shopify store (anonymized) and published the results (Clean Commit A/B test library). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on Clean Commit →
How to run this test on your store
- Hypothesis
- If we redesign the mobile "selling fast" badge, then mobile order value will recover without hurting conversion because the badge will no longer steer shoppers toward low-value items.
- Primary metric
- Conversion rate
- Guardrails
- Mobile average order value
- Revenue per visitor
- Orders
- Who should test it
- Stores that already ran an urgency badge test and saw a device-specific problem. If the badge only covers a handful of products, expect small store-wide effects.
Questions
Is it worth re-testing a design after a mixed result?
Often, yes. This follow-up fixed mobile order value, even though conversion did not move.
How many products should get an urgency badge?
There is no set number. Badging only five products here made little store-wide difference, so measure those products as well as the whole store.
Similar tests
@oliverkenyon@oliverkenyon
@DaveDiederen
Convertibles@DaveDiederen@DaveDiederen