Product page redesign with testimonials: -10.0% revenue per visitor
Test run byClean CommitCRO agency
Commentary byLiftArchiveOur analysis, not theirsA bundled product page redesign, with a simpler top section, short testimonials above the fold and a how-it-works explainer, cut revenue per visitor by 10.0% and conversion rate by 9.0%.
Clean Commit ran this test for an anonymized Shopify store and published it in its A/B test library.
Several changes shipped together, so the loss cannot be pinned on any one of them.
- Revenue per visitor: -10.0%, the main metric. The original had an 84.5% probability of performing better.
- Conversion rate: -9.0%, and orders fell 8.8%.
- Add-to-cart rate: -5.6%, and average order value fell 2.2%.
- By device: mobile drove the loss, with conversion down 11.5%. Desktop revenue per visitor rose 6.7%.
The change
The variant trims the top, adds testimonials above the fold and a how-it-works section.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Control
The original product page, with its existing top section and no testimonials or how-it-works section.
Variant
The top was simplified around the gallery, title, price, size selector and add-to-cart button, with two or three short testimonials above the fold. A visual how-it-works section was added below the main product content.
Why it likely lost
Our reading of the result, not the practitioner's claim.
- On mobile, testimonials above the fold may have pushed the price or add-to-cart button further down.
- Simplifying the top may have removed details that shoppers were using to decide.
- Desktop has room for the extra content, which could explain why it did better there.
Caveats: This was a bundled change, so no single element can be credited or blamed. An 84.5% probability is a strong signal but not full significance, and sample size and duration were not shared.
Who ran it
Clean Commit ran this test for a Shopify store (anonymized) and published the results (Clean Commit A/B test library). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on Clean Commit →
How to run this test on your store
- Hypothesis
- If we add short testimonials above the fold and a how-it-works section, then add-to-cart rate will rise because shoppers get reassurance and key facts sooner.
- Primary metric
- Revenue per visitor
- Guardrails
- Mobile conversion rate
- Add-to-cart rate
- Average order value
- Who should test it
- Stores whose product needs explaining and whose page lacks social proof near the top. Test one change at a time, and watch mobile closely if the top of the page gets longer.
Questions
Should I put testimonials above the fold on product pages?
It can help, but here it was part of a bundle that lost on mobile.
Test it alone and check that it does not push the add-to-cart button down.
Do how-it-works sections help product pages?
They can help when a product is unfamiliar.
This test cannot say whether the explainer helped or hurt, because it shipped with other changes.
Why test a redesign instead of just launching it?
Redesigns often feel like improvements but can cost sales.
Here, testing stopped a change that lowered revenue per visitor.
Similar tests
@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon