Native-styled in-app onboarding flows: +20% first-week retention

WinnerBefore/after, not a split testOnboarding

ProfitWell added multi-step in-app onboarding flows for new users, and first-week retention improved by 20% within two months.

ProfitWell's product team built the flows, and it was published as an Appcues customer story.

This compares results before and after the flows went live, not a split test.

+20% first-week retention
  • First-week retention: up 20% within two months of launch, as reported by Appcues.
  • The story does not say whether 20% is a relative change or percentage points.
  • No baseline, sample size or detail on the flow content was shared.

Control

New users got no in-app onboarding flows. Adding even a welcome modal needed developer time.

Variant

Multi-step onboarding flows were built in Appcues and given a theme so they looked like part of the product.

Why it likely won

Our reading of the result, not the practitioner's claim.

  • Any guidance can beat none when new users do not know where value is.
  • Flows that look native may feel like part of the product rather than an ad, so users may read them.
  • Letting a product manager ship flows without developers likely meant faster iteration.

Caveats: Before/after with little detail on what the flows said or when they changed. Vendor-published, with no baseline or sample size.

Who ran it

ProfitWell ran this test and published the results (Appcues customer story). The numbers are theirs; the summary and commentary on this page are ours.

Read the original case study on ProfitWell →

How to run this test on your site

Hypothesis
If we add short in-app flows that walk new users to their first value, then more will return in week one because they understand what the product does for them.
Primary metric
First-week retention of new accounts
Guardrails
  • Flow dismissal rate
  • Time to first key action
  • Support contact rate
Who should test it
SaaS products with no onboarding guidance today and a clear first-value moment. If you already have solid onboarding, expect a smaller gain from adding more.

Questions

Does in-app onboarding improve retention?

It can, especially when new users currently get no guidance.

ProfitWell reported a 20% first-week retention gain, though from a before/after comparison.

Should onboarding flows match my product's design?

Usually yes. Styling them like the product makes them feel like help rather than marketing, which may lead more users to read them.

What should I measure after launching onboarding flows?

Track retention and a core activation action for new users, and compare against a holdout group that does not see the flows.

Similar tests