Homepage rebuilt around product clarity: +11.0% conversion rate
Test run byClean CommitCRO agency
Commentary byLiftArchiveOur analysis, not theirsA homepage redesigned around a shorter benefit headline, a product image and highlighted reviews showed an 11.0% rise in conversion rate.
Clean Commit ran this test for an anonymized Shopify store and published it in its A/B test library.
We count it as inconclusive: across 23,885 visitors the variant had only a 68.1% probability of beating the original, and click-through rate fell.
- Conversion rate: +11.0%, with a 68.1% probability of beating the original. Far from significant.
- Revenue per visitor: +21.4%, and average order value: +9.4%, both directional only.
- Click-through rate: -15.5%, a negative result. This was the metric the hypothesis targeted.
- Bounce rate: +6.1%, also negative, so fewer visitors moved past the homepage.
The change
A shorter hero, stronger button, highlighted reviews and compact cards, shipped together.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Control
The original homepage, with a longer hero message and animations running on the page.
Variant
A bundle of changes: a shorter benefit-led hero headline beside a product image, a higher-contrast call to action, highlighted reviews, a swipeable 'How it works' carousel, compact product cards with category buttons and animations paused.
Why it likely came out this way
Our reading of the result, not the practitioner's claim.
- A clearer product message may have helped visitors who were already close to buying.
- Compact cards and category buttons may have changed how people browsed, which could explain fewer clicks.
- With many changes shipped together and a low probability, chance may explain much of the gap.
Caveats: Several changes went live at once, so no single element gets the credit. The result was far from significance, and click-through and bounce rate both moved the wrong way.
Who ran it
Clean Commit ran this test for a Shopify store (anonymized) and published the results (Clean Commit A/B test library). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on Clean Commit →
How to run this test on your store
- Hypothesis
- If we shorten the hero to one clear benefit and show the product beside it, then click-through rate will rise because visitors understand the product faster.
- Primary metric
- Click-through rate from the homepage
- Guardrails
- Conversion rate
- Bounce rate
- Revenue per visitor
- Who should test it
- Stores where first-time visitors don't grasp what the product is from the homepage. If your product is already obvious, the gain is likely small.
Questions
Should a homepage hero headline be short?
A short, benefit-led headline is a common choice.
In this test it was part of a bundle that showed a conversion lift, but the result was not significant.
Can conversion rate rise while click-through falls?
Yes. Here conversion rate rose 11.0% while click-through fell 15.5%, which suggests a smaller group of more decided visitors went on to buy.
Similar tests
@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon
@DaveDiederen@DaveDiederen