A/B test win rate: what share of 1,724 real tests won, lost or were flat

84% of 1,724 publicly shared A/B tests won. Here's the full split by vertical, page type and element, the typical lift size, and why public win rates run far above real ones.

Of 1,724 real A/B test results in LiftArchive, 1,447 (84%) won, 112 (6%) lost and 165 (10%) came out flat.

That is far higher than the win rate companies measure across every test they run, which is usually 10% to 33%.

The gap is publication bias: practitioners share their wins more often than their losses, so read the numbers below as “what public tests look like”, not your odds on the next test.

Method and sample

The data covers 1,724 tests from 391 practitioners, agencies, testing tools and companies, each credited and linked to its original source.

Ideas without a result are left out.

Flat means the test was shared as no clear difference or not significant.

The numbers update every time the database changes; this version is from November 2026.

Win, loss and flat split by vertical

VerticalTestsWonLostFlat
Ecommerce121982%6%12%
Lead-gen22094%3%3%
SaaS20584%11%5%
Mobile apps8088%12%0%
Shared wins vs. measured win ratesShare of tests that won. LiftArchive counts tests people chose to share; the others count every test a company ran.
LiftArchive: tests people chose to share84%
Microsoft (all experiments)33%
Bing (all experiments)15%
Optimizely customers (127K+ tests)12%
Booking.com, Google Ads, Netflix10%
Airbnb search8%

Sources for the company win rates are on our A/B testing statistics page (Kohavi, Deng and Vermeer 2022; Optimizely 2023).

Typical lift size

When a shared test won, the median reported lift was +12.5% revenue per visitor (n = 357), +12.6% conversion rate (n = 696) and +6.2% average order value (n = 151).

Medians are used because a few huge lifts would drag an average upward.

Win rate by page type

Page types with at least 15 shared tests:

Page typeTestsWon
Product page (Ecommerce)49280%
Collection page (Ecommerce)14373%
Site-wide (Ecommerce)14188%
Homepage (Ecommerce)13381%
Cart (Ecommerce)9685%
Landing page (Lead-gen)9496%
Paywall (Mobile apps)7186%
Landing page (Ecommerce)6790%
Navigation & menu (Ecommerce)6077%
Checkout (Ecommerce)5891%
Landing page (SaaS)5194%
Lead form (Lead-gen)4393%
Homepage (SaaS)3093%
Pricing page (SaaS)2681%

Win rate by element

Ecommerce elements with at least 15 shared tests, highest win rate first:

ElementTestsWon
Product finder quizzes23100%
Themes, page builders & page speed15100%
Payment icons, express checkout & BNPL3995%
Advertorials, listicles & presell pages2295%
Free gifts & gift with purchase1995%
USP bars & benefit icons5394%
Subscriptions & subscribe-and-save5294%
Bundles & quantity breaks4992%
Headlines, product titles & copy12991%
Hero & above-the-fold section7591%
Sales, urgency & limited-time offers3291%
Upsells & cross-sells8690%
Popups & email capture4190%
Reviews & star ratings8789%
Product images & gallery10088%
Countdown timers2286%
Filters, sorting & site search8784%
Money-back guarantee & returns5184%
Shipping & delivery messaging8384%
Cart drawers & slide carts5584%
Social proof, authority & press8184%
Free shipping thresholds & shipping price3884%
Pricing, discounts & savings display11982%
Add-to-cart & CTA buttons8282%
Announcement bars2781%
Navigation & mega menus12880%
Comparison charts & tables1580%
Checkout steps, fields & flow3580%
Collection banners & headers2580%
Low-stock & scarcity messaging1878%
Layout, fonts & visual design21577%
Trust badges & security seals5677%
Ad-to-page message match1776%
Bestseller badges & product labels4475%
Product cards & quick add9173%
Benefit, problem, how-it-works & results sections2673%
Variant, size & option selectors7272%
Sticky add-to-cart bars3672%
UGC & product video2972%

Limits: what these numbers can't tell you

Shared tests are a biased sample: wins get posted, losses mostly don't.

Many tests report one headline metric, so a conversion-rate win may hide a revenue loss.

Sample sizes and run times vary, and few posts report both.

Use this page to pick what to test, then let your own test decide.

Cite this data

Free to quote with a link back to this page.

LiftArchive, “A/B test win rate: what share of 1,724 real tests won, lost or were flat”, November 2026. https://liftarchive.com/research/ab-test-win-rate/

Keep reading