Site-wide A/B Tests: 23 Results + 61 Ideas

Of the 23 measured site-wide tests here, 21 won and 2 lost, and the most repeated winner is an announcement bar that does something: a clear offer, a link and often a timer. Dave Diederen's Shop Now CTA in the announcement bar reported +14.46% conversion rate and +15.44% revenue per visitor.

The two losses are worth reading first. Removing an email popup and adding a countdown timer for a European market both cost revenue, the timer by -35.61% revenue per visitor.

Site-wide tests change the header, theme, fonts, shipping rules or popups on every page at once. That makes them high-leverage and also easy to misread, so the analysis below separates what repeated from what worked once.

33measured results
31–2won vs lost or flat
61ideas to test
$471,162biggest est. monthly gain
A
→
B
+$471,162/month
Ongoing CRO program on navigation, bundles and product pages for a knife brand
Site-wideAnnouncement bars@oliverkenyon
A
→
B
+$356,617/month
Site-wide CRO program on product listings, cart and reviews for a cooling bedding brand
Site-wideUpsells & cross-sells@oliverkenyon
A
→
B
+$337,203/month
Mega menu, collection filters and tiered cart rewards for a tattoo-inspired apparel brand
Site-wideNavigation & mega menus@oliverkenyon
A
→
B
+$286,348/month
Quick add-to-cart, PDP content and checkout badges for an energy drink brand
Site-wideProduct cards & quick add@oliverkenyon
A
→
B
+$135,482/month projected
Mega menu, homepage hero, USP bar and tiered rewards for a hair color conditioner brand
Site-wideNavigation & mega menus@oliverkenyon
A
→
B
+$1.2M annual revenue
Live chat removal, messaging, UX and new landing pages tested for an insole brand
Site-wideLive chat & contact options@oliverkenyon
A
→
B
+$77,703/month
Mobile, cart USP and homepage banner changes for a pet nutrition brand
Site-wideUSP bars & benefit icons@oliverkenyon
A
→
B
+$74,000/month
Made the announcement bar clickable, linking to high-ticket bundles
Site-wideBundles & quantity breaks@oliverkenyon
A
→
B
+$57,000 per month
Added clickable sale announcement bar linking to the clearance page
Site-wideSales, urgency & limited-time offers@oliverkenyon
A
→
B
$42,840/month
Rewrote trust policy messaging and added persistent mobile trust bar
Site-wideTrust badges & security seals@oliverkenyon
A
→
B
~$28,000/month lost revenue recovered
Removed a live chat feature that was costing revenue
Site-wideLive chat & contact options@oliverkenyon
A
→
B
+30% add-to-cart rate
Sequential tests on collection grid, pricing, PDPs and cart drawer for a fan brand
Site-wideProduct cards & quick add@oliverkenyon
A
→
B
+£281,417 annual revenue
Full theme test of homepage, collections, menu and subscriptions for a skincare brand
Site-wideLayout, fonts & visual design@oliverkenyon
A
→
B
+43.81% revenue per visitor
Tested shipping price levels; a $9.49 shipping fee beat the control
Site-wideShipping & delivery messaging@DaveDiederen
A
→
B
+5.92% revenue per visitor
Added an announcement bar
Site-wideAnnouncement bars@DaveDiederen
A
→
B
+9.17% revenue per visitor
Removed the free-shipping threshold and charged shipping on every order
Site-wideShipping & delivery messaging@DaveDiederen
A
→
B
+7.90% revenue per visitor
Removed the free shipping threshold and charged a flat shipping fee on every order
Site-wideShipping & delivery messaging@DaveDiederen
A
→
B
+15.44% revenue per visitor
Added a 'Shop Now' CTA to the announcement bar and linked it to the offer
Site-wideAdd-to-cart & CTA buttons@DaveDiederen
A
→
B
+6.47% revenue per visitor
Updated images across the store to show people matching the older target audience's age
Site-wideProduct images & gallery@DaveDiederen
A
→
B
+13.01% revenue per visitor
Added a geo-detection popup asking international visitors to confirm country and switch currency
Site-widePayment icons, express checkout & BNPL@DaveDiederen
A
→
B
+2.82% revenue per visitor
Announcement bar: countdown timer vs free-gift threshold callout (hid the free-gift callout)
Site-wideFree shipping thresholds & shipping price@DaveDiederen
A
→
B
+2.31% revenue per visitor
Hid the scrolling marquee bar
Site-wideUSP bars & benefit icons@DaveDiederen
A
→
B
+4.32% revenue per visitor
Made the announcement bar clickable with a link and added a countdown timer for the sale
Site-wideCountdown timers@DaveDiederen
A
→
B
+6.91% revenue per visitor
Made fonts 5% bigger
Site-wideLayout, fonts & visual design@DaveDiederen
A
→
B
+2.83% revenue per visitor
Added a scrolling strip of customer review snippets directly below the navbar
Site-wideReviews & star ratings@DaveDiederen
A
→
B
+3.82% revenue per visitor
Increased font size (+2px and +4px variants) for an older audience
Site-wideVariant, size & option selectors@DaveDiederen
A
→
B
Wins every time across multiple stores
Changed 'Free Shipping' to 'Free Shipping to [country]' in the shipping bar using geo-detection
Site-wideShipping & delivery messaging@DaveDiederen
A
→
B
+$170K+ additional revenue
Upgraded the announcement bar with a clear offer, countdown timer and link to a collection/product
Site-wideCountdown timers@DaveDiederen
A
→
B
+10.42% conversion rate
Changed the "Free Shipping" badge to the country-specific "Free Shipping To DE"
Site-wideShipping & delivery messaging@DaveDiederen
A
→
B
+55% conversions
Added a trust bar below the navigation (local shipping, patented since 2014, 34,000+ customers)
Site-wideSocial proof, authority & press@Rubendgrf
A
→
B
Revenue per visitor +41.85% (£1.08 to £1.54)
New theme with a BOGO offer vs old theme
Site-wideBundles & quantity breaks@kasper_dolk
A
→
B
-35.61% revenue per visitor
Added a countdown timer for a non-US (European) market
Site-wideCountdown timers@DaveDiederen
A
→
B
-20.51% revenue per visitor
Removed the email popup
Site-widePopups & email capture@DaveDiederen
A
→
B
Idea, no result yet
Add a countdown timer and a working link to the announcement bar
Site-wideCountdown timers@DaveDiederen
A
→
B
Idea, no result yet
Add a spin-to-win pop-up that requires email to stop the wheel
Site-widePricing, discounts & savings display@DaveDiederen
A
→
B
Idea, no result yet
Replace apps with custom code and compress assets for page speed
Site-wideProduct images & gallery@DaveDiederen
A
→
B
Idea, no result yet
Ask shoppers what they want in the pop-up before the email field
Site-widePopups & email capture@DaveDiederen
A
→
B
Idea, no result yet
Use bold, high-contrast CTA buttons and test colors
Site-wideAdd-to-cart & CTA buttons@DaveDiederen
A
→
B
Idea, no result yet
Add a scrolling USP ticker
Site-wideUSP bars & benefit icons@DaveDiederen
A
→
B
Idea, no result yet
Tested a shipping threshold, the product page CTA and best-seller pricing
Site-wideShipping & delivery messaging@joshtCRO
A
→
B
Idea, no result yet
Tested a limited-time shipping offer, landing page headline copy and a bundle offer
Site-wideShipping & delivery messaging@joshtCRO
A
→
B
Idea, no result yet
Added 'New' badges on bestsellers and pre-selected bundles
Site-wideBundles & quantity breaks@joshtCRO
A
→
B
Idea, no result yet
Switched from a third-party theme to a native theme and matched landing pages to top ads
Site-wideAd-to-page message match@joshtCRO
A
→
B
Idea, no result yet
Steer attention with size contrast, faces and directional cues
Site-wideProduct images & gallery@kasper_dolk
A
→
B
Idea, no result yet
Lazy-load GIFs behind compressed first-frame placeholders
Site-wideThemes, page builders & page speed@DaveDiederen
A
→
B
Idea, no result yet
Hide the scrolling marquee text bar
Site-wideUSP bars & benefit icons@DaveDiederen
A
→
B
Idea, no result yet
Show holiday shipping cutoff dates with a countdown
Site-wideMoney-back guarantee & returns@DaveDiederen
A
→
B
Idea, no result yet
Make elements clickable where recordings show dead clicks
Site-wideReviews & star ratings@DaveDiederen
A
→
B
Idea, no result yet
Simplified navigation, optimized the landing page order form, pre-selected a 2-bestseller bundle and set free shipping over $75
Site-wideShipping & delivery messaging@joshtCRO
A
→
B
Idea, no result yet
Free shipping over $80 vs flat $4.95 shipping
Site-wideShipping & delivery messaging@joshtCRO
A
→
B
Idea, no result yet
Replaced a third-party Shopify theme with a custom-built store experience
Site-wideThemes, page builders & page speed@joshtCRO
A
→
B
Idea, no result yet
Product page lifestyle photos, video and FAQ, single-page checkout and pre-selected bundles
Site-wideUGC & product video@joshtCRO
A
→
B
Idea, no result yet
Static, clickable announcement bar with 'Up to X% off + Free Shipping' and a countdown
Site-wideShipping & delivery messaging@DaveDiederen
A
→
B
Idea, no result yet
Add star ratings and guarantees near CTAs to lift clicks
Site-wideReviews & star ratings@kasper_dolk
A
→
B
Idea, no result yet
Show payment methods on PDP, side cart footer and site footer
Site-widePayment icons, express checkout & BNPL@kasper_dolk
A
→
B
Idea, no result yet
Upsells with benefits and an info popup instead of a PDP redirect
Site-wideUpsells & cross-sells@kasper_dolk
A
→
B
Idea, no result yet
Add a 'Back to shop' button on legal pages
Site-wideEmpty-cart states@kasper_dolk
A
→
B
Idea, no result yet
Swapped vague branding for clear messaging, added a live stock counter and focused above the fold on one benefit
Site-wideLow-stock & scarcity messaging@joshtCRO
A
→
B
Idea, no result yet
Switched from a third-party Shopify theme to a custom setup
Site-wideThemes, page builders & page speed@joshtCRO
A
→
B
Idea, no result yet
Rebuilt product pages, added free shipping over $75, pre-selected a 3-pack bundle and simplified the header nav
Site-wideShipping & delivery messaging@joshtCRO
A
→
B
Idea, no result yet
Raised the free shipping threshold from $75 to $100
Site-wideShipping & delivery messaging@joshtCRO
A
→
B
Idea, no result yet
Restructured the mobile menu, put bestsellers first on collection pages and pre-selected bundles in the order form
Site-wideBundles & quantity breaks@joshtCRO
A
→
B
Idea, no result yet
Use custom graphics to visualise sales copy
Site-wideHeadlines, product titles & copy@kasper_dolk
A
→
B
Idea, no result yet
Put a free-shipping progress bar in the top announcement bar
Site-wideShipping & delivery messaging@kasper_dolk
A
→
B
Idea, no result yet
Make the announcement bar clickable and link it to the best-selling PDP
Site-wideAnnouncement bars@DaveDiederen
A
→
B
Idea, no result yet
Make the second BOGO item easy to add
Site-wideBundles & quantity breaks@kasper_dolk
A
→
B
Idea, no result yet
Check color contrast so clickable elements are obvious
Site-wideLayout, fonts & visual design@kasper_dolk
A
→
B
Idea, no result yet
Show a loading state on ATC/checkout buttons
Site-wideHeadlines, product titles & copy@kasper_dolk
A
→
B
Idea, no result yet
Extend the guarantee from 14/30 to 90 days
Site-wideMoney-back guarantee & returns@kasper_dolk
A
→
B
Idea, no result yet
Summarise info in bullet lists with green checkmarks
Site-wideUSP bars & benefit icons@kasper_dolk
A
→
B
Idea, no result yet
CTA buttons: action copy, urgency, bigger padding, icon, standout color
Site-wideSales, urgency & limited-time offers@kasper_dolk
A
→
B
Idea, no result yet
Rewrite page copy to a 5th-6th grade reading level
Site-wideHeadlines, product titles & copy@kasper_dolk
A
→
B
Idea, no result yet
Turn dead clicks into info: popup on 'Free Shipping' text
Site-wideMoney-back guarantee & returns@kasper_dolk
A
→
B
Idea, no result yet
Added a non-sticky benefits banner across all pages on desktop
Site-wideUSP bars & benefit icons@peterac_
A
→
B
Idea, no result yet
Split tested shipping offers, one-click bundles and the order form layout
Site-wideShipping & delivery messaging@joshtCRO
A
→
B
Idea, no result yet
Tested bundle offers against discount codes
Site-wideBundles & quantity breaks@joshtCRO
A
→
B
Idea, no result yet
Replace generic headings like 'Our products' with outcome headlines
Site-wideHeadlines, product titles & copy@kasper_dolk
A
→
B
Idea, no result yet
Remove social media links from the footer
Site-wideNavigation & mega menus@kasper_dolk
A
→
B
Idea, no result yet
Added pre-selected bundles at checkout, 'Most popular' badges on high-margin items and post-purchase upsells
Site-wideBundles & quantity breaks@joshtCRO
A
→
B
Idea, no result yet
Tested a 5% price increase, free shipping over $75 and simplified navigation
Site-wideShipping & delivery messaging@joshtCRO
A
→
B
Idea, no result yet
Product page benefit copy, UGC and guarantee; collection reordered by revenue; simplified homepage; trimmed checkout fields
Site-wideUGC & product video@joshtCRO
A
→
B
Idea, no result yet
Simplified navigation, made the cart sticky on mobile and tested shipping copy
Site-wideShipping & delivery messaging@joshtCRO
A
→
B
Idea, no result yet
Add a shoppable UGC video widget to the site
Site-wideUGC & product video@kasper_dolk
A
→
B
Idea, no result yet
Moved from a bloated third-party theme to a clean theme, cutting load time from 2s+ to under 1s
Site-wideThemes, page builders & page speed@joshtCRO
A
→
B
Idea, no result yet
Reduce whitespace and increase font size
Site-wideLayout, fonts & visual design@kasper_dolk
A
→
B
Idea, no result yet
Add a social proof banner to the site
Site-wideReviews & star ratings@DaveDiederen
A
→
B
Idea, no result yet
Rebuilt the landing page flow, added video and testimonials to product pages and simplified checkout navigation
Site-wideReviews & star ratings@joshtCRO
A
→
B
Idea, no result yet
Rebuilt the mobile menu, moved reviews higher on product pages and added low-stock urgency
Site-wideReviews & star ratings@joshtCRO
A
→
B
Idea, no result yet
Place headlines and CTAs along the top-left to bottom-right attention path
Site-wideHeadlines, product titles & copy@kasper_dolk
A
→
B
Idea, no result yet
Simplified homepage navigation, added real photos and diagrams to product pages, and a highlighted review section
Site-wideReviews & star ratings@joshtCRO
A
→
B
Idea, no result yet
Keep the offer consistent from ad to checkout
Site-wideShipping & delivery messaging@kasper_dolk
A
→
B
Idea, no result yet
Replace stock/model shots with real customers holding the product
Site-wideUGC & product video@kasper_dolk
A
→
B
Idea, no result yet
UGC images and transformation headline on product pages, pre-selected bundles in the order form, and a clearer homepage
Site-wideUGC & product video@joshtCRO
A
→
B
Idea, no result yet
Remove outbound links like 'Powered by Shopify' from the footer
Site-wideNavigation & mega menus@DaveDiederen

What a site-wide element has to do

A site-wide element is seen by every visitor on every page. It has to state the offer and remove doubt without getting in the way of browsing, because a small cost repeated on every page adds up fast.

Most-tested site-wide elements

Announcement bars

Seven tests touched the announcement bar, and all seven won. Oliver Kenyon made the bar clickable and linked it to high-ticket bundles for +$74,000/month, and a clickable sale bar linking to clearance added +$57,000/month. Dave Diederen's upgraded bar with a clear offer, timer and link reported +$170K in revenue.

The bar does not always need to be busier. Dave Diederen also hid a scrolling marquee bar and reported +2.10% conversion rate and +$30,500/month.

Shipping fees and geo messaging

Three of Dave Diederen's tests went against the usual advice on free shipping. A $9.49 shipping fee beat the control by +43.81% revenue per visitor, and removing the free-shipping threshold won twice (+9.17% RPV and +7.90% RPV).

Geo-specific copy also won: "Free Shipping To DE" reported +10.42% conversion rate, and a geo-detection popup to confirm country and currency reported +12.32% conversion rate. Dave Diederen also reports that "Free Shipping to [country]" wins every time across multiple stores, though without published figures.

Fonts and images for the real audience

For an older audience, Dave Diederen updated store images to match their age (+6.47% RPV) and increased font size (+3.82% RPV). A separate test that made fonts 5% bigger reported +5.41% conversion rate.

A→
B
+43.81% revenue per visitor
Tested shipping price levels; a $9.49 shipping fee beat the control
Site-wideShipping & delivery messaging@DaveDiederen
A→
B
+15.44% revenue per visitor
Added a 'Shop Now' CTA to the announcement bar and linked it to the offer
Site-wideAdd-to-cart & CTA buttons@DaveDiederen
A→
B
+13.01% revenue per visitor
Added a geo-detection popup asking international visitors to confirm country and switch currency
Site-widePayment icons, express checkout & BNPL@DaveDiederen
A→
B
Revenue per visitor +41.85% (£1.08 to £1.54)
New theme with a BOGO offer vs old theme
Site-wideBundles & quantity breaks@kasper_dolk
A→
B
-35.61% revenue per visitor
Added a countdown timer for a non-US (European) market
Site-wideCountdown timers@DaveDiederen
A→
B
-20.51% revenue per visitor
Removed the email popup
Site-widePopups & email capture@DaveDiederen

Biggest measured wins

Kasper Dolk's new theme with a BOGO offer lifted conversion rate +44.54% (2.44% to 3.53%) at 99.7% probability to beat the old theme. It changed the theme and the offer together, so you cannot credit either alone.

Ruben's trust bar below the navigation (local shipping, patented since 2014, 34,000+ customers) reported +55% conversions. Oliver Kenyon's removal of a live chat feature recovered about $28,000/month.

Want results like this on your store?

Dave Diederen at Syntra Labs. Dave builds and tests Shopify stores at Syntra Labs, and shares most results in public.

Book a CRO call with Dave → See all their tests

Tests that lost (and why)

Dave Diederen's countdown timer for a European market lost -17.35% conversion rate and -35.61% revenue per visitor, tested across 20+ brands. The same practitioner won with timers in announcement bars elsewhere, so the market matters.

Removing the email popup also lost: -12.18% conversion rate and -20.51% revenue per visitor. Clean-up for its own sake is not a strategy.

Ideas not yet tested

  • Kasper Dolk suggests extending the guarantee from 14 or 30 days to 90 days, and rewriting page copy to a 5th-6th grade reading level.
  • Josh Thompson suggests testing free shipping over $80 against flat $4.95 shipping.
  • Dave Diederen suggests making elements clickable where session recordings show dead clicks, and lazy-loading GIFs behind compressed placeholders.

Site-wide checklist built from the results

  • Make the announcement bar clickable, with one clear offer and a link to where it applies.
  • Test a shipping fee or threshold change instead of assuming free shipping wins.
  • Name the visitor's country in shipping messages.
  • Check font size and imagery against your real customer's age.
  • Test timers per market before rolling them out everywhere.
  • Do not remove an email popup without testing it.

Tools to run these tests

Shipping and price tests need a tool that can split pricing logic, not only page layout. See the price testing guide, the Shopify A/B testing apps comparison, and announcement bar tests.

Questions

Does an announcement bar increase conversions?

In this collection, all seven announcement bar tests won. Dave Diederen's Shop Now CTA linked to the offer reported +14.46% conversion rate, and Oliver Kenyon's clickable bar linking to high-ticket bundles reported +$74,000/month.

Is free shipping always better than charging for shipping?

Not in these tests. Dave Diederen found a $9.49 shipping fee beat the control by +43.81% revenue per visitor, and removing the free-shipping threshold won in two separate tests (+9.17% and +7.90% RPV).

Which site-wide tests lost?

Two lost. A countdown timer for a European market cost -35.61% revenue per visitor across 20+ brands, and removing an email popup cost -20.51% revenue per visitor. Both were run by Dave Diederen.