Two cart checkout buttons with shipping protection: +10.2%, unproven
Commentary byLiftArchiveOur analysis, not theirsSkullcandy's cart with two checkout buttons, one with shipping protection already added, showed a 10.2% higher conversion rate, but we count the result as inconclusive.
SavedBy, the shipping protection app, ran this test with Skullcandy, and it was published as a Shoplift success story.
The test ran for just under seven days, no confidence figures were shared, and the 2.6% order value lift was not significant.
- Conversion rate: +10.2% as reported. We treat it as inconclusive because no confidence level was published.
- Revenue per visitor: +13.1% as reported. Part of this is likely the protection fee.
- Average order value: +2.6%, not statistically significant.
- Skullcandy's main goal was to add protection without losing conversions, and that goal looks met.
The change
The variant replaces one checkout button with two: with protection and without.
Simplified mockup drawn by LiftArchive from the shared screenshots.
Control
Skullcandy's original cart, with no shipping protection featured.
Variant
The cart showed two checkout buttons: a main one with shipping protection added at full price, and a second one to continue without it for less.
Why it likely came out this way
Our reading of the result, not the practitioner's claim.
- Headphones and earbuds are easy to lose or steal in transit, so protection may calm a real worry.
- Two clear buttons make the choice visible instead of hiding a fee.
- A test of under a week can catch a short-term spike that fades, which is why we don't count this as a win yet.
Caveats: Counted as inconclusive: the test ran under seven days and the case study does not share significance for the main lift. It is a partner-app marketing story, and visitors in both groups could also toggle protection at checkout.
Who ran it
SavedBy ran this test for Skullcandy and published the results (Shoplift success story). The numbers are theirs; the summary and commentary on this page are ours.
Read the original case study on SavedBy →
How to run this test on your store
- Hypothesis
- If we show a checkout button with shipping protection added next to one without it, then conversion rate will hold or rise because shoppers get a clear, fair choice.
- Primary metric
- Conversion rate
- Guardrails
- Revenue per visitor excluding protection fees
- Average order value
- Refund and complaint rate
- Who should test it
- Stores where lost, stolen or damaged parcels cost real money, such as electronics brands. Run it for at least two full weeks. It probably won't help for low-value items that rarely go missing.
Questions
Will adding shipping protection to the cart lower conversions?
In this test it did not appear to.
Conversion rate was reported 10.2% higher, though the short test makes that lift unproven.
Is it OK to pre-select shipping protection?
Here the main button had protection already added, but a second button let shoppers skip it.
Making the opt-out just as visible keeps the choice fair.
How long should a cart test run?
At least one to two full weeks, so every day of the week is covered. This one ran just under seven days.
Similar tests
@oliverkenyon@oliverkenyon@oliverkenyon@oliverkenyon