Personalized PDPs for new and returning visitors: +1.0% CR, flat
Test run byClean CommitCRO agency
Commentary byLiftArchiveOur analysis, not theirsTailoring product pages by visitor type, with an educational page for new visitors and a condensed one for returning visitors, moved conversion rate just 1.0%, and orders were flat.
Clean Commit ran this test for an anonymized Shopify store and published it in its A/B test library.
With 2,581 visitors over 33 days, the result is inconclusive.
- Conversion rate: +1.0%, and orders were flat (0.0%). No clear difference.
- Add-to-cart rate: -10.7%. Negative: the tailored pages did not create more purchase intent.
- Revenue per visitor: -5.0%. Negative, though within what a small sample can produce by chance.
- Bounce rate fell 12.2% and click-through rate rose 8.2%, but both are within normal variation for this sample.
The change
Returning visitors get a condensed, CTA-led page; new visitors get extra benefits and proof.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Control
Every visitor saw the same product page.
Variant
New visitors saw a page focused on benefits, how it works and social proof. Returning visitors saw a condensed page with stronger calls to action and fewer distractions.
Why it likely came out this way
Our reading of the result, not the practitioner's claim.
- The sample was small, so a real effect of a few percent could easily go unseen.
- Visitors engaged more with the pages but did not buy more, which suggests the layouts held attention without changing the decision.
- Two different layouts sat inside one variant, so a gain for one group may have been cancelled by a loss for the other.
Caveats: Small sample: 2,581 visitors over 33 days, which is too few to detect small effects. The variant combined two different layouts for two visitor groups.
Who ran it
Clean Commit ran this test for a Shopify store (anonymized) and published the results (Clean Commit A/B test library). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on Clean Commit →
How to run this test on your store
- Hypothesis
- If we give returning visitors a condensed, CTA-focused product page and new visitors an educational one, then conversion rate will rise because each group gets a page that matches what they already know.
- Primary metric
- Conversion rate, split by new and returning visitors
- Guardrails
- Add-to-cart rate
- Revenue per visitor
- Orders
- Who should test it
- Stores with enough returning traffic to measure that group on its own. With a few thousand visitors a month, as here, you likely won't get a clear answer; small stores are better off with bigger, simpler changes first.
Questions
How much traffic do I need to test personalized product pages?
More than a typical single-page test, because you need enough visitors in each group.
This test had 2,581 visitors over 33 days and could not detect small effects.
Do returning visitors need a different product page?
Maybe. They often already know the product, so less explaining and a clearer path to buy can make sense, but this test did not prove it.
Is lower bounce rate a good sign on its own?
Not by itself. Here bounce rate fell and click-through rose, yet orders stayed flat and add-to-cart fell.
Similar tests
@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon