Checkout A/B Tests: What Won, What Lost and What to Test Next

Of the 21 measured checkout tests here, 20 won and 1 lost. The most useful pattern: adding proof and reassurance inside checkout (reviews, trust USPs, guarantee and delivery lines) won every time it was tested.

Dave Diederen's customer reviews on the checkout page lifted conversion rate by 17.96% and revenue per visitor by 23.13%. Dave Diederen also saw 3 trust USPs in the banner and below the main CTA lift checkout conversion rate by 20%.

Countdown timers are the one element with conflicting results. They won several times, lost once, and in one test removing the timer was the winning change.

20measured results
19–1won vs lost or flat
19ideas to test
$139,029biggest est. monthly gain
A
→
B
+3.16% revenue per visitor
Added a countdown timer to checkout
CheckoutCountdown timers@DaveDiederen
A
→
B
+4.83% revenue per visitor
Added a checkout countdown timer (order reserved) for US brands
CheckoutCountdown timers@DaveDiederen
A
→
B
+5.56% revenue per visitor
Tested flat $2, $5 and $7 shipping fees against free shipping
CheckoutShipping & delivery messaging@DaveDiederen
A
→
B
+$55,000/month
Added an image in checkout showing social proof, return policy and financing
CheckoutSocial proof, authority & press@CROguy_
A
→
B
+10.07% revenue per visitor
Added 3 USPs (guarantee, orders shipped, delivery speed) below the Pay Now button on checkout
CheckoutMoney-back guarantee & returns@DaveDiederen
A
→
B
+1.89% revenue per visitor
Tweaked shipping rates (volume-grab vs margin-grab)
CheckoutShipping & delivery messaging@DaveDiederen
A
→
B
+7.81% revenue per visitor
Showed card and other payment method icons under the express checkout buttons
CheckoutPayment icons, express checkout & BNPL@DaveDiederen
A
→
B
+23.13% revenue per visitor
Showed customer reviews on the checkout page
CheckoutReviews & star ratings@DaveDiederen
A
→
B
+1.57% revenue per visitor
Raised the shipping price (tested $6.95 and $7.95 against control)
CheckoutShipping & delivery messaging@DaveDiederen
A
→
B
+6.59% revenue per visitor
Added urgency messaging to checkout (instead of a full checkout redesign)
CheckoutSales, urgency & limited-time offers@DaveDiederen
A
→
B
CVR moved from below 1% to above 1%
Enabled Shop Pay (buy now, pay later)
CheckoutPayment icons, express checkout & BNPL@DaveDiederen
A
→
B
checkout conversion 69% to 76%
Added a customer trust count and 3 USPs with icons to the checkout
CheckoutSocial proof, authority & press@peterac_
A
→
B
Conversion rate 3.8% (+24%) month to date vs previous period
Checkout blocks with store USPs, reviews and a checkout upsell
CheckoutReviews & star ratings@kasper_dolk
A
→
B
+20% checkout conversion rate
Added 3 trust USPs to the checkout banner and below the main CTA
CheckoutUSP bars & benefit icons@DaveDiederen
A
→
B
Take rate 15-20%
Add a custom AOV order bump
CheckoutUpsells & cross-sells@kasper_dolk
A
→
B
Increase in AOV and take rate for all clients
Checkbox upsell in a custom checkout
CheckoutUpsells & cross-sells@kasper_dolk
A
→
B
Revenue per visitor +26.18%
Remove the countdown timer from checkout
CheckoutCountdown timers@kasper_dolk
A
→
B
+$33,435
Add trust and urgency elements to the Plus checkout
CheckoutReviews & star ratings@kasper_dolk
A
→
B
50% of orders took the upsell
Add a checkbox upsell in the Shopify Plus checkout
CheckoutUpsells & cross-sells@kasper_dolk
A
→
B
-7.1% revenue per visitor
Added a countdown timer to checkout
CheckoutCountdown timers@DaveDiederen
A
→
B
Idea, no result yet
Turn on Shopify checkout tipping
CheckoutCheckout steps, fields & flow@CROguy_
A
→
B
Idea, no result yet
Rename shipping options to delivery times
CheckoutShipping & delivery messaging@CROguy_
A
→
B
Idea, no result yet
Remove unneeded checkout fields
CheckoutCheckout steps, fields & flow@CROguy_
A
→
B
Idea, no result yet
Money-back guarantee block under the checkout total
CheckoutMoney-back guarantee & returns@kasper_dolk
A
→
B
Idea, no result yet
Cut checkout from 5 steps to 3
CheckoutCheckout steps, fields & flow@joshtCRO
A
→
B
Idea, no result yet
Test a higher shipping price
CheckoutShipping & delivery messaging@DaveDiederen
A
→
B
Idea, no result yet
Checkout: featured reviews, guarantees, call/email option, benefits again
CheckoutReviews & star ratings@kasper_dolk
A
→
B
Idea, no result yet
Highlight savings during checkout
CheckoutPricing, discounts & savings display@kasper_dolk
A
→
B
Idea, no result yet
Cut clicks from cart to purchase, added express checkout and removed unneeded form fields
CheckoutPayment icons, express checkout & BNPL@joshtCRO
A
→
B
Idea, no result yet
Gamify AOV in checkout with a progress block and frequently-bought-together upsells
CheckoutUpsells & cross-sells@kasper_dolk
A
→
B
Idea, no result yet
Add urgency, USPs, reviews and FAQs to the checkout page
CheckoutReviews & star ratings@DaveDiederen
A
→
B
Idea, no result yet
Add 2-4 objection-specific reviews to checkout
CheckoutReviews & star ratings@DaveDiederen
A
→
B
Idea, no result yet
Add a 10-minute countdown timer on the checkout page
CheckoutCountdown timers@DaveDiederen
A
→
B
Idea, no result yet
Add a 'total savings' block in checkout
CheckoutCountdown timers@kasper_dolk
A
→
B
Idea, no result yet
Checkout: rewrote headlines, removed a step and tested 'Fast, Free Shipping in 2 Days' vs 'Free Shipping Over $50'
CheckoutShipping & delivery messaging@joshtCRO
A
→
B
Idea, no result yet
Sticky 'Pay now' button with the order total pinned to the bottom of checkout
CheckoutSticky add-to-cart bars@kasper_dolk
A
→
B
Idea, no result yet
Gamify the free-shipping threshold in checkout with extra quantities
CheckoutShipping & delivery messaging@kasper_dolk
A
→
B
Idea, no result yet
Replace a plain Stripe checkout with a custom native checkout
CheckoutCountdown timers@kasper_dolk
A
→
B
Idea, no result yet
Remove extra calls to action from the checkout flow
CheckoutMoney-back guarantee & returns@DaveDiederen

What a checkout has to do

By checkout, the shopper has decided. The page has to keep them from changing their mind while they type card details. That means confirming they can trust the store, showing what happens next, and not adding new reasons to stop. It is also the last chance to raise order value with a simple add-on.

Most-tested checkout elements

Trust USPs and reviews

This is the most consistent group. Besides the two tests above, Dave Diederen's 3 USPs below the Pay Now button lifted conversion rate by 9.90%. Peter Christensen's customer trust count and 3 USP icons moved checkout conversion from 69% to 76% (still running at the time). Milos added an image with social proof, return policy and financing for +$55,000/month.

A→
B
+$55,000/month
Added an image in checkout showing social proof, return policy and financing
CheckoutSocial proof, authority & press@CROguy_
A→
B
+10.07% revenue per visitor
Added 3 USPs (guarantee, orders shipped, delivery speed) below the Pay Now button on checkout
CheckoutMoney-back guarantee & returns@DaveDiederen
A→
B
+23.13% revenue per visitor
Showed customer reviews on the checkout page
CheckoutReviews & star ratings@DaveDiederen
A→
B
checkout conversion 69% to 76%
Added a customer trust count and 3 USPs with icons to the checkout
CheckoutSocial proof, authority & press@peterac_
A→
B
+20% checkout conversion rate
Added 3 trust USPs to the checkout banner and below the main CTA
CheckoutUSP bars & benefit icons@DaveDiederen

Want results like this on your store?

Dave Diederen at Syntra Labs. Dave builds and tests Shopify stores at Syntra Labs, and shares most results in public.

Book a CRO call with Dave → See all their tests

Countdown timers

Dave Diederen's checkout countdown timer won across 4 separate tests, with +3.16% revenue per visitor in the main result. An 'order reserved' timer for US brands lifted conversion rate by 9.50%. But another timer test lost 7.1% revenue per visitor, and Kasper Dolk saw removing a checkout timer lift conversion rate by 25.61%.

The takeaway: a timer can help or hurt depending on the store, so treat it as a test, not a fix.

Shipping fees

Charging for shipping did not hurt in these tests. Dave Diederen's flat $2, $5 and $7 fees against free shipping found the $5 fee added +$59,894/month and +2.37% conversion rate. Raising the shipping price left conversion rate unchanged and added +2.21% profit per visitor.

Payment options

Dave Diederen showed card and other payment icons under the express buttons for +7.81% revenue per visitor, and enabling Shop Pay buy now, pay later moved conversion rate from below 1% to above 1%.

Upsells and order bumps

Kasper Dolk reports a checkbox upsell in the Shopify Plus checkout taken on 50% of orders for fashion clients, and a custom order bump with a 15-20% take rate. These are reported take rates rather than controlled conversion comparisons.

Biggest measured wins

  • Removing a checkout timer (Kasper Dolk): +25.61% conversion rate, est. +€150k/month.
  • Reviews on checkout (Dave Diederen): +23.13% revenue per visitor.
  • USP, review and upsell blocks (Kasper Dolk): conversion rate 3.8% (+24%) month to date vs the previous period. This is a before/after comparison, not a split test.

Tests that lost (and why)

The one loss is Dave Diederen's checkout countdown timer: -5.4% conversion rate, -7.1% revenue per visitor. Paired with Kasper Dolk's removal win, it suggests timers can read as pressure rather than help for some audiences.

One more loss sits inside a win. In Dave Diederen's urgency messaging test (+6.59% revenue per visitor), a full checkout redesign lost 1.18% conversion rate. Small additions beat a rebuild.

Ideas not yet tested

Milos suggests renaming shipping options to delivery times and removing unneeded fields. Dave Diederen suggests 2-4 objection-specific reviews, which builds on the strongest result here. Josh Thompson suggests cutting checkout from 5 steps to 3.

Checkout checklist built from the results

  • Show a few customer reviews inside checkout.
  • Put 3 trust USPs (guarantee, shipping, delivery speed) near the pay button.
  • Show card and payment icons under express checkout buttons.
  • Test a small shipping fee before assuming free shipping is required.
  • Test a countdown timer both ways: adding and removing.
  • Prefer small additions over a full checkout redesign.

Tools to run these tests

Some of these tests ran on the Shopify Plus checkout. See the Shopify A/B testing apps, the post-purchase upsell apps and the checkout checklist.

Questions

What is the best checkout A/B test to run?

Adding reviews or trust USPs to checkout. Dave Diederen's checkout reviews lifted conversion rate by 17.96%, and 3 trust USPs below the main CTA lifted checkout conversion by 20%.

Do countdown timers work in checkout?

Sometimes. Dave Diederen's timer won across 4 tests, but another timer test lost 7.1% revenue per visitor, and Kasper Dolk saw a 25.61% conversion lift from removing one.

Does charging for shipping hurt checkout conversion?

Not in these tests. Dave Diederen found a flat $5 fee beat free shipping by +$59,894/month, and raising the shipping price left conversion rate unchanged.