Simpler custom text input on product pages: -3.1% revenue, mixed
Test run byClean CommitCRO agency
Commentary byLiftArchiveOur analysis, not theirsMaking the custom text input clearer on product pages raised conversion rate by 4.2%, but revenue per visitor, the test's main metric, fell 3.1%.
Clean Commit ran this test for an anonymized Shopify store and published it in its A/B test library.
The store sells personalized products, and the outcome is inconclusive because smaller orders offset the extra buyers.
- Revenue per visitor: -3.1%, the main metric. The original had a 61.3% probability of doing better across 6,853 visitors.
- Conversion rate: +4.2%, not significant.
- Add-to-cart rate: -6.4%, a negative result.
- Average order value: -4.9%, which cancelled the extra buyers.
- Bounce rate fell 23.1% and click-through rate rose 16.6%, but these engagement gains did not lift revenue.
The change
A confusing text field and silent disabled button become a clear prompt with inline errors.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Control
A customizer with the prompt "Type your city, state or text" and an add-to-cart button that was silently disabled when no text was entered.
Variant
A simpler, action-oriented prompt, an input that auto-focused after clicking "Add Your Text," a clear label, and an inline error when text was missing.
Why it likely came out this way
Our reading of the result, not the practitioner's claim.
- A clear error message removes a silent dead end, which may explain the extra buyers.
- An inline error may also stop shoppers who would otherwise have tried several times and added more items.
- The swings are small for this sample, so much of the movement may be noise.
Caveats: Inconclusive on the main metric across 6,853 visitors. Average order value fell 4.9%, and duration was not shared.
Who ran it
Clean Commit ran this test for a Shopify store (anonymized) and published the results (Clean Commit A/B test library). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on Clean Commit →
How to run this test on your store
- Hypothesis
- If we simplify the custom text prompt, auto-focus the field and show an inline error when text is missing, then conversion rate will rise because shoppers won't get stuck customizing.
- Primary metric
- Revenue per visitor
- Guardrails
- Add-to-cart rate
- Average order value
- Who should test it
- Stores selling personalized or engraved products with a required text field. If customization is optional or rarely used, the effect will be small.
Questions
Should a disabled add-to-cart button explain why it's disabled?
Generally yes, since a silent block can leave shoppers stuck.
In this test, adding an inline error lifted conversion 4.2%, but revenue per visitor still fell.
What should I measure when testing a product customizer?
Revenue per visitor and average order value, not just conversion.
Here conversion rose while order value fell 4.9%.
Similar tests
@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon