Removing 2 sign-up form fields: no lift, trended slightly worse

Flat / inconclusiveSignup page

Removing two optional-looking questions from a SaaS sign-up form made no difference to conversions, and if anything the shorter form trended slightly worse.

GrowthRock ran this A/B test for a SaaS client and mentioned it in a post on its blog.

The test reached only about 100 conversions per variation, so it can't rule out a small effect either way.

no lift, trended slightly worse
  • Form conversions: no difference between the versions.
  • The shorter form trended slightly worse, but not by a clear margin. Treat this as flat.
  • Sample: about 100 conversions per variation. Exact rates, visitors and duration were not shared.

The change

Control (A)
header
Sign up
Core sign-up fields
How did you hear about us?REPLACED
What industry are you in?REPLACED
Sign up
Variant (B)
header
Sign up
Core sign-up fieldsNEW
Sign up

The attribution and industry fields are removed from the sign-up form

Simplified mockup drawn by LiftArchive from the shared screenshots.

Control

The sign-up form included the fields 'How did you hear about us?' and 'What industry are you in?'.

Variant

The same sign-up form with those two fields removed.

Why it likely came out this way

Our reading of the result, not the practitioner's claim.

  • Two quick questions may add little effort compared with the decision to sign up in the first place.
  • Questions about industry can make a form feel tailored, which may offset the extra effort.
  • With about 100 conversions per side, only a large change would have shown up clearly.

Caveats: Small sample of about 100 conversions per variation, mentioned briefly in a checkout article with few details. The post dates from around 2016.

Who ran it

GrowthRock ran this test for a SaaS client of GrowthRock and published the results (GrowthRock blog). The numbers are theirs; the summary and commentary on this page are ours.

Read the original case study on GrowthRock →

How to run this test on your site

Hypothesis
If we remove non-essential fields such as attribution and industry from our sign-up form, then more visitors will complete it because there is less to fill in.
Primary metric
Sign-up form completion rate
Guardrails
  • Activation rate of new sign-ups
  • Lead quality or sales-qualified rate
  • Quality of attribution data
Who should test it
SaaS teams with long sign-up forms and enough traffic to reach a few hundred conversions per variation. If your form is already short, or sales relies on those fields, expect little gain and real cost.

Questions

Do fewer form fields always increase sign-ups?

No. It is a common rule of thumb, but this test found no difference after removing two fields.

Results depend on which fields go and how much effort they really add.

Should I keep a 'How did you hear about us?' field?

If you use the answers for attribution, keep it unless a test shows it hurts sign-ups.

You could also ask it later, after sign-up.

How many conversions does a form test need?

It depends on the size of the effect you want to detect.

About 100 per variation is only enough to spot large changes, so small differences stay hidden.

Similar tests