Back to the Bible

How year-end specific language on a primary donation page impacts donor conversion

Experiment ID: #10860

Back to the Bible

Experiment Summary

Timeframe: 12/13/2018 - 01/06/2019

During Back to the Bible’s year-end campaign, we hypothesized that we might be able to increase donor conversion on the primary donation page if we used year-end specific language that communicated the overall value proposition of the organization instead of focusing on just one aspect of the organization. 

Research Question

Would year-end specific copy on the primary donation page increase donor conversion during year-end?

Results

 Treatment NameConv. RateRelative DifferenceConfidence
C: Control 28.2%
T1: Extended Value Prop 26.5%-6.1% 30.2%

This experiment has a required sample size of 5,227 in order to be valid. Unfortunately, the required sample size was not met and a level of confidence above 95% was not met so the experiment results are not valid.

Key Learnings

We weren’t able to validate the experiment during the campaign. We hypothesize that this is because the motivation of donors during year-end is higher than other times of the year. We see that people are more motivated during the month of December than any other time of year to give and it is more difficult to positively or negatively impact that motivation.  


Experiment Documented by Courtney Gaines
Courtney Gaines is Vice President at NextAfter.

Question about experiment #10860

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.