# Real data on day one of a trial: +16 points in engagement

- Outcome: Won
- Page type: Onboarding (SaaS)
- Elements: Time to value
- Test run by: [AURUM](https://liftarchive.com/practitioners/aurum/)
- Commentary by: LiftArchive (our analysis, not theirs)
- Original source: https://wingify.com/success-stories/aurum/
- Page: https://liftarchive.com/test/aurum-astrea-retroactive-clippings/

Giving trial users real legal clippings on first login, instead of making them wait up to 48 hours, raised engagement with clippings by 16 percentage points (+125% relative). AURUM ran this test on Astrea, its legal practice software, and it was published as a VWO case study. It was a back-end change released through a feature-flag rollout.

## Result

**+16 points in engagement**

- Share of trial users engaging with a clipping: +16 percentage points versus the control.
- That is a 125% relative lift.
- It ran as a controlled feature-flag rollout, not a classic page split test.

## Control

Legal clippings, the main input users need in Astrea, were only collected after the account was created. They could take up to 48 hours to appear, so users often took up to three days to reach the first useful moment.

## Variant

Recent clippings from just before sign-up were pulled in through an external API. They were ready the moment users first logged in.

## Why it likely won (our reading)

- Users saw real value on first login instead of an empty product.
- Waiting up to two days in a 10-day trial loses momentum, and some users never come back.
- Real data on day one lets users try the core workflow straight away.

## Caveats

A back-end change released through a controlled feature-flag rollout. No sample size, duration or confidence level was shared.

## How to run this test

- Hypothesis: If we load real data into new trial accounts before first login, then more users will engage with the core feature because they see value right away instead of waiting.
- Primary metric: Share of trial users engaging with the core feature in the trial
- Guardrail: Trial-to-paid conversion
- Guardrail: Error rates and API failures
- Guardrail: Load time on first login
- Who should test it: SaaS products that look empty until data syncs or builds up, such as monitoring, analytics or legal tools. It won't help much if users can get value right away with their own input.

---

Credit: AURUM ran this test and owns the result. Summary and commentary by LiftArchive (https://liftarchive.com/test/aurum-astrea-retroactive-clippings/).
Usage: Free to use, quote and build on, with credit and a link: name the practitioner or organization that ran the test and link to its LiftArchive page. The results belong to the practitioners who ran and shared them; the summaries and commentary are LiftArchive's.