Product pages tailored to new vs returning visitors: +2.4% CR
Test run byClean CommitCRO agency
Commentary byLiftArchiveOur analysis, not theirsGiving new visitors an educational product page and returning visitors a shorter, sales-focused one lifted conversion rate 2.4% and revenue per visitor 2.1% across 37,726 visitors.
Clean Commit ran this test for an anonymized Shopify store and published it in its A/B test library.
We count it as inconclusive: the variant had only a 70.5% probability of beating the original, and add-to-cart rate fell 7.4%.
- Conversion rate: +2.4%. Not significant, with a 70.5% probability of beating the original, so treat it as a weak signal.
- Revenue per visitor: +2.1%, in line with the small conversion lift.
- Add-to-cart rate: -7.4%. Negative: more engagement did not mean more items added to cart.
- Desktop did most of the work: conversion rate +7.8% and revenue per visitor +12.5%, against +1.3% conversion on mobile.
- Click-through rate rose 17.2% and bounce rate fell 13.3%, so visitors did engage more with the tailored pages.
The change
New visitors get benefits, how-it-works and proof; returning visitors get a condensed page with a stronger CTA.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Control
Every visitor saw the same product page, whether it was their first visit or not.
Variant
New visitors saw a page built around benefits, how the product works and social proof. Returning visitors saw a condensed page with stronger calls to action and fewer distractions.
Why it likely came out this way
Our reading of the result, not the practitioner's claim.
- New visitors often need to learn what the product is before buying, so an educational page may have answered their questions.
- Returning visitors already know the product, so a shorter page may have removed friction on their way back to buy.
- Two different layouts were tested as one variant, so gains in one group may have been offset by losses in the other.
- The drop in add-to-cart next to a rise in conversion suggests the visitors who did add to cart were more likely to finish, but the sample can't confirm that.
Caveats: Not statistically significant (70.5% probability to beat the original), so we count it as inconclusive. New and returning visitors got different layouts in one variant, and duration was not shared.
Who ran it
Clean Commit ran this test for a Shopify store (anonymized) and published the results (Clean Commit A/B test library). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on Clean Commit →
How to run this test on your store
- Hypothesis
- If we show new visitors an educational product page and returning visitors a condensed one, then conversion rate will rise because each group gets the content that fits where they are in the decision.
- Primary metric
- Conversion rate, split by new and returning visitors
- Guardrails
- Add-to-cart rate
- Revenue per visitor
- Mobile conversion rate
- Who should test it
- Stores with a product that needs some explaining and a solid share of returning visitors. It probably won't move much for simple, familiar products, or for stores without the traffic to read each visitor group on its own.
Questions
Should new and returning visitors see different product pages?
It can help, but this test only showed a weak signal.
Read the result for each group on its own, since one group can cancel out the other.
What should a product page for new visitors include?
Usually the basics a first-time shopper needs: what the product does, how it works and proof that others like it. Returning visitors often need less of this.
Why did add-to-cart fall while conversion rose?
Fewer people added to cart, but more of those who did went on to buy.
With a non-significant result, that pattern may also be noise.
Similar tests
@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon