How the placement of a campaign’s thermometer impacts campaign revenue
Canadian Taxpayers Federation
Experiment Summary
Ended On: 04/01/2021
As a part of their campaign, the Canadian Taxpayer Foundation wanted to experiment with the placement of a thermometer that would fill to the campaign goal and understand what would drive the highest amount of revenue.
Where would placing the thermometer showing the dollars raised to that point in the campaign drive the most responses and revenue?
Research Question
We believe that moving the thermometer closer to the donation form for prospective donors will achieve an increase in revenue.
Results
Treatment Name | Revenue per Visitor | Relative Difference | Confidence | Average Gift | |
---|---|---|---|---|---|
C: | No thermometer | $22.46 | $61.88 | ||
T1: | Lower Thermometer Placement | $33.14 | 47.5% | 100.0% | $82.58 |
T2: | Upper Thermometer Placement | $25.01 | 11.3% | 74.5% | $66.47 |
This experiment was validated using 3rd party testing tools. Based upon those calculations, a significant level of confidence was met so these experiment results are valid.
Flux Metrics Affected
The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:
0% increase in traffic
× 10.6% increase in conversion rate
× 33.5% increase in average gift
47.5% increase in revenue
Key Learnings
With a 99.9% level of confidence, we observed an increase of +40.7% in revenue. We also observed an increase of 10.6% in the donor conversion rate, but only achieved a 75% level of confidence in that regard.
Overall, the donors with the lower thermometer placement seemed to be motivated to give more when they (a) completely read the donation page copy, and (b) saw how much money had already been raised when it was closest to the point that they were making a decision on what they themselves should give.
When possible, place your thermometer closest to the donation form during a campaign.
Question about experiment #56312
If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.