Visual mobile menu: +10.3% conversion, not significant
Test run byClean CommitCRO agency
Commentary byLiftArchiveOur analysis, not theirsRebuilding the mobile menu to show product collections visually lifted conversion rate 10.3% and revenue per visitor 10.7% over 26 days, but the result did not reach statistical significance.
Clean Commit ran this test for an anonymized Shopify store and published it in its A/B test library.
The agency calls it a positive signal; we count it as inconclusive.
- Conversion rate: +10.3%, with an 84.0% probability of beating the original. Inconclusive: not statistically significant.
- Revenue per visitor: +10.7%.
- Orders: +25.5%.
- Add-to-cart rate: +4.1%, and bounce rate fell 5.4%, so shoppers went deeper into the store.
The change
The variant swaps the text menu for visual collection tiles.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Control
A text-based mobile menu listing the store's categories.
Variant
A rebuilt mobile menu that shows product collections visually, so shoppers can spot the right one faster.
Why it likely came out this way
Our reading of the result, not the practitioner's claim.
- Pictures of collections are quicker to scan on a phone than a list of category names.
- Seeing products in the menu may prompt browsing that a text list would not.
- Every metric moved the same way, which makes the signal more believable, but the evidence still falls short of proof.
Caveats: The test ran 26 days and reached an 84.0% probability to win, below the usual significance bar. Visitor numbers were not shared.
Who ran it
Clean Commit ran this test for a Shopify store (anonymized) and published the results (Clean Commit A/B test library). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on Clean Commit →
How to run this test on your store
- Hypothesis
- If we show collections as images in the mobile menu, then more mobile shoppers will buy because they find the right category faster.
- Primary metric
- Mobile conversion rate
- Guardrails
- Menu load time
- Revenue per visitor
- Bounce rate
- Who should test it
- Stores with several distinct, visual collections, such as apparel, home goods or beauty. Stores with one or two products, or categories that look alike, will get less from images in the menu.
Questions
Do image-based mobile menus convert better?
This test leaned that way, with conversion up 10.3%, but it was not statistically significant.
Treat it as a strong idea to test, not a proven win.
Will images slow down my mobile menu?
They can. Use small, compressed images and watch load time as a guardrail during the test.
Which stores benefit most from a visual menu?
Stores whose collections look different from each other, so a picture tells the shopper something a label can't.
Similar tests
@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon