Comparison Chart A/B Tests: What 4 Measured Results Show

All 4 measured comparison chart tests in this archive won, and the most useful pattern is that both isolated tests added a chart to the product page, one comparing value and one comparing key attributes.

Four results is a small base, so treat this as a strong lead rather than a rule.

Dave Diederen's value comparison chart gained +9.4% conversion rate and +7.68% revenue per visitor (+$57.4K/month).

Oliver Kenyon's comparison table of key attributes reported +$32,884/month.

Below are the four results, what the ideas suggest testing next, and how to run your own test. The grid lists every result and idea.

measured results
0–0won vs lost or flat
ideas to test

What counts as a comparison chart

This collection covers 'us vs them' charts, value comparisons against alternatives, attribute tables on product pages, retail-price comparison popups, and comparison sections inside long-form landing pages.

The win/loss record

4 measured results, 4 wins, no losses. Only two of them test a comparison chart on its own; the other two changed other things at the same time.

The evidence is thin, and no failed comparison chart test has been shared yet.

Where comparison charts were tested

  • Product page: 2 tests
  • Collection page: 1 test (with a product page popup)
  • Landing page: 1 test

Biggest wins and their numbers

Isolated product page tests

Dave's chart framed the product's value against alternatives.

Oliver's table compared attributes. Both work as a quick answer to "why this one?" near the buying decision.

Tests where the chart was one part

Kasper Dolk's test of swipeable collection images plus a retail-price comparison popup on the product page reported two separate lifts: +€96,350 revenue for the swipeable images (10,796 visitors, 97% confidence) and +€30,554 for the price comparison popup (6,302 visitors, 94% confidence).

Kasper's long-form landing page flow ended with a comparison section and reported +259.7% revenue (2.5x).

The whole page changed, so the comparison's share is unknown.

Tests that lost or were flat

None have been recorded. That is more likely a sign of a small sample, and of practitioners sharing wins, than proof that comparison charts never hurt.

What the ideas suggest testing

Most of the untested ideas in this collection come from Kasper Dolk and Dave Diederen. They point to a few directions:

  • Pick the right rival. Compare against the customer's real alternative, your top 2-3 alternatives for solution-aware visitors, or named competitors.
  • Move the chart. Add it as an image in the product page media slider, on the homepage, or as a model comparison table on the collection page.
  • Make the claims concrete. Use numbered, percentage-backed claims, or a cost card that sets an itemized alternative against your price.
  • Make the contrast visible. Green for you, red for others, with a direct headline.

Design patterns that won

  • Place the chart on the product page, close to the buying decision.
  • Compare value or key attributes, not every spec.
  • Keep it short enough to scan on mobile.

How to add a comparison chart on Shopify

Many themes include a comparison table or multi-column section that can be added to the product template.

An alternative is a single image in the product gallery, which is quick to test.

Keep claims about competitors accurate and easy to check.

How to test it on your store

Hypothesis: a value comparison chart against the customer's main alternative, placed below the buy box, will raise revenue per visitor.

Use RPV and conversion rate as metrics. Because the evidence base is four tests, your own result counts for more than the averages here.

Size the test with the sample size calculator.

Questions

Do comparison charts increase conversions?

All 4 measured tests here won, but the evidence is thin.

Dave Diederen's value comparison chart gained +9.4% conversion rate and +7.68% revenue per visitor, and Oliver Kenyon's attribute table reported +$32,884/month.

Where should a comparison chart go?

Both isolated wins put the chart on the product page.

Kasper Dolk also tested a retail-price comparison popup on the product page, which reported +€30,554 revenue at 94% confidence.

Who should I compare my product against?

No test here compares rival choices directly. The ideas in this collection suggest the customer's real alternative, your top 2-3 alternatives, or named competitors as the next things to test.