SaaS Email A/B Test Examples: 6 Results

Of 6 measured SaaS email tests, 4 won, 1 lost and 1 was flat, and the most useful pattern is that emails win when they speak to what the reader already uses or cares about.

AppVault took opens from 13% to 66% by naming the prospect's ATS in the subject line, and Adobe's segmented CS3 launch emails gave +41% order rate against sending no email.

Six results is a small base, so treat these as strong leads to test on your own list, not rules.

What a SaaS email has to do

A SaaS email moves a reader one step along: from prospect to reply, from free user to paid, or from existing customer to upgrade.

The tests here measure opens, clicks, responses, orders and upgrades.

The best results tie the email to a step after the open, such as an order or a paid upgrade.

Most-tested changes on the email

Subject lines

Half the tests changed what the subject line or lead promised.

AppVault's subject line named the applicant tracking system the prospect had installed, and unique opens went from 13% to 66%.

MECLABS Institute tested VolunteerMatch subject lines built on different value categories, with mixed results covered below.

Segmenting and copy length

Adobe sent segmented CS3 launch emails and compared them with no contact at all: +41% overall order rate and +72% direct orders.

M7 Corporation tested a long-copy white paper email against short copy and found the long copy roughly 3x more effective.

Biggest measured wins

The AppVault and Adobe results are the largest.

Both made the email about the reader: their own software stack, or the segment they belong to.

Dashlane added customer reviews to a free-to-paid upgrade email for about +1% lift.

That is a small gain, but on an upgrade email sent to a large free base it can still be worth keeping.

Tests that lost or were flat (and why)

In a MECLABS Institute test for VolunteerMatch, subject lines about network size lost to subject lines about passion, with -12.5% click rate for the network-size category.

Telling readers how big the network is did less than speaking to why they would care.

A second MECLABS Institute test led a B2B email with proof instead of network size.

It showed +75% clickthrough against the network version, but the result was not significant, so it is counted as flat.

The lesson from both: size claims did not carry these emails, and a big percentage on a small sample is not a win until it reaches significance.

A SaaS email checklist built from the results

• Name what the reader uses. A subject line naming the prospect's ATS took opens from 13% to 66%.
• Segment launch and upgrade emails. Segmented launch emails beat no contact by +41% order rate.
• Don't assume short copy wins. Long copy was roughly 3x more effective for a white paper email.
• Add proof to upgrade asks. Reviews gave a small lift on a free-to-paid email.
• Lead with why it matters, not how big you are. Network-size subject lines lost.
• Wait for significance. A +75% clickthrough gap was still not significant.

Tools to run these tests

Most email platforms have a built-in A/B split for subject lines and content.

For results that matter to a SaaS team, track the step after the click, such as trials, upgrades or orders, not just opens.

Send each version to enough of your list to reach significance, and run copy tests over more than one send before you roll out a winner.