Popup & Email Capture A/B Tests: What 4 Results Show

Of 4 measured popup tests in this archive, 3 won and 1 lost, and the loss is the most useful result: removing an email popup cut revenue per visitor by 20.51%. Popups that did one helpful job, such as setting the right currency, won.

Dave Diederen removed the email popup on a client store and saw -12.18% conversion rate and -20.51% revenue per visitor. Dave reports it lost again on a second store. A geo-detection popup for international visitors won +12.32% conversion rate.

Four results is a small base, so treat these as strong leads rather than rules. The 13 ideas in the grid below suggest what to test next.

5measured results
4–1won vs lost or flat
13ideas to test
$41,521biggest est. monthly gain
A
→
B
+$36,721/month
Removing an email popup from a top product page for a solar lighting brand
Product pagePopups & email capture@oliverkenyon
A
→
B
+13.01% revenue per visitor
Added a geo-detection popup asking international visitors to confirm country and switch currency
Site-widePayment icons, express checkout & BNPL@DaveDiederen
A
→
B
+7.80% revenue per visitor
Tested two different upsell products in the same PDP add-to-cart popup
Product pageUpsells & cross-sells@DaveDiederen
A
→
B
Swipeable Collection Images: +€96,350 revenue lift, 10,796 visitors, 97% confidence
Swipeable images on collection cards; retail-price comparison popup on PDP
Collection pageComparison charts & tables@kasper_dolk
A
→
B
-20.51% revenue per visitor
Removed the email popup
Site-widePopups & email capture@DaveDiederen
A
→
B
Idea, no result yet
Add a promo card in the 4th slot of the collection grid
Collection pageProduct cards & quick add@DaveDiederen
A
→
B
Idea, no result yet
Add a spin-to-win pop-up that requires email to stop the wheel
Site-widePricing, discounts & savings display@DaveDiederen
A
→
B
Idea, no result yet
Ask shoppers what they want in the pop-up before the email field
Site-widePopups & email capture@DaveDiederen
A
→
B
Idea, no result yet
Upsells with benefits and an info popup instead of a PDP redirect
Site-wideUpsells & cross-sells@kasper_dolk
A
→
B
Idea, no result yet
Turn dead clicks into info: popup on 'Free Shipping' text
Site-wideMoney-back guarantee & returns@kasper_dolk
A
→
B
Idea, no result yet
Added a non-sticky benefits banner across all pages on desktop
Site-wideUSP bars & benefit icons@peterac_
A
→
B
Idea, no result yet
Model switcher in the product hero with 'Most Popular' on the pricier model
Product pageUSP bars & benefit icons@kasper_dolk
A
→
B
Idea, no result yet
Turn the cart drawer into a full-screen popup
CartPopups & email capture@DaveDiederen
A
→
B
Idea, no result yet
Cart popup within thumb reach with green messaging, savings and shipping
CartShipping & delivery messaging@kasper_dolk
A
→
B
Idea, no result yet
Add a 'find your fit' popup (enter brand + model)
OtherVariant, size & option selectors@kasper_dolk
A
→
B
Idea, no result yet
Cart with social proof, subscribe toggle, free shipping and guarantee
CartSocial proof, authority & press@kasper_dolk
A
→
B
Idea, no result yet
Cart popup: 'Great choice!', savings, item count, shipping price, payment icons
CartShipping & delivery messaging@kasper_dolk
A
→
B
Idea, no result yet
Post-ATC upsell popup: 'Great choice!', complete the set, savings shown
CartUpsells & cross-sells@kasper_dolk

What counts as a popup

This collection covers email capture popups, add-to-cart upsell popups, country and currency popups, and small info popups opened from a product page. Ideas also include cart popups that replace a side cart. The evidence on spin-to-win and exit-intent popups is ideas only; no measured result in this archive covers them.

The win/loss record

4 results: 3 won, 1 lost. All 4 kept or added a popup; the only loss came from taking one away. Dave Diederen ran 3 of the 4 and Kasper Dolk ran 1.

Where popups were tested

  • Site-wide: 2
  • Product page: 1
  • Collection page and product page together: 1

The loss: removing the email popup

Dave's removal test dropped conversion rate 12.18%, revenue per visitor 20.51%, profit per visitor 19.99% and AOV 9.49%. Dave's explanation is that store owners find popups annoying but shoppers act on the offer. Dave advises fixing a weak popup (offer, timing, easy close on mobile) rather than deleting it, and describes one that fires after 8-10 seconds with 10% off as the kind that works.

Want results like this on your store?

Dave Diederen at Syntra Labs. Dave builds and tests Shopify stores at Syntra Labs, and shares most results in public.

Book a CRO call with Dave → See all their tests

Biggest wins and their numbers

A→
B
+13.01% revenue per visitor
Added a geo-detection popup asking international visitors to confirm country and switch currency
Site-widePayment icons, express checkout & BNPL@DaveDiederen
A→
B
+7.80% revenue per visitor
Tested two different upsell products in the same PDP add-to-cart popup
Product pageUpsells & cross-sells@DaveDiederen
A→
B
Swipeable Collection Images: +€96,350 revenue lift, 10,796 visitors, 97% confidence
Swipeable images on collection cards; retail-price comparison popup on PDP
Collection pageComparison charts & tables@kasper_dolk
A→
B
-20.51% revenue per visitor
Removed the email popup
Site-widePopups & email capture@DaveDiederen

Design patterns that worked

  • Keep the email popup, but test its offer and timing.
  • Ask one question or show one thing per popup.
  • For upsells, pick a product that is an obvious next step for the hero product.
  • Use popups to answer questions shoppers already have, such as price in their currency.

Ideas worth testing next

Dave Diederen suggests a popup that asks what the shopper is looking for before the email field, so follow-up emails can be tailored, and a spin-to-win wheel that keeps spinning until an email is entered. Kasper Dolk suggests turning dead clicks into info popups: if heatmaps show people clicking "Free Shipping" text, make it open shipping and returns details. Kasper also suggests a "find your fit" popup for stores with many compatible options.

Several ideas cover cart popups: placing them within thumb reach on mobile, opening with "Great choice!", and repeating savings, item count and shipping price. Dave suggests testing a full-screen cart popup in place of a side drawer.

How to add or change popups on Shopify

Email popups usually come from your email platform or a popup app; see the Shopify popup apps comparison. Add-to-cart upsell popups usually come from an upsell app. Geo and currency prompts depend on Shopify Markets and your theme.

How to test it on your store

Hypothesis: a better offer or later trigger on the email popup will raise revenue per visitor. If you plan to remove it, test the removal first instead of assuming. Measure revenue per visitor, not signups, and size the test with the sample size calculator.

Questions

Do email popups hurt conversion rate?

Not in the evidence here. Dave Diederen removed an email popup and conversion rate fell 12.18% and revenue per visitor fell 20.51%, and Dave reports the removal lost on a second store too.

What popups won in A/B tests?

A geo-detection popup asking international visitors to confirm country and currency won +12.32% conversion rate, and an add-to-cart upsell popup with a better product won +7.80% revenue per visitor. Both tests are Dave Diederen's.

Do spin-to-win popups work?

There is no measured result for spin-to-win in this archive. Dave Diederen lists a spin-to-win popup that keeps spinning until an email is entered as an idea worth testing.