The Heritage Foundation

How reinforcing the value proposition and adding a call-to-action affects donor conversion.

Experiment ID: #4269

The Heritage Foundation

Experiment Summary

Timeframe: 05/13/2016 - 06/13/2016

In an effort to optimize the main donation page for The Heritage Foundation, we took a look at the copy that was currently there to find ways to improve and increase the force of the value proposition. While the existing copy was strong and provided solid evidentials, we noticed it was missing an important element in the copy, an ask. Our hypothesis was that we would be able to increase donor conversion and overall revenue by adding copy, to what was already there, that included a call-to-action and reinforcement of the value proposition.

Research Question

Will adding a call-to-action and reinforcing the value proposition improve donor conversion and revenue?

Design

C: Control
Array ( [0] => Array ( [ID] => 12827 [id] => 12827 [title] => CTA_and_Value_Prop.png [filename] => CTA_and_Value_Prop.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop.png [link] => https://www.nextafter.com/experiments/how-reinforcing-the-value-proposition-and-adding-a-call-to-action-affects-donor-conversion/attachment/cta_and_value_prop-png/ [alt] => [author] => 9 [description] => [caption] => [name] => cta_and_value_prop-png [status] => inherit [uploaded_to] => 12826 [date] => 2021-02-25 04:23:39 [modified] => 2021-02-25 04:23:39 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 1440 [height] => 2068 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-209x300.png [medium-width] => 209 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-768x1103.png [medium_large-width] => 640 [medium_large-height] => 919 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-713x1024.png [large-width] => 640 [large-height] => 919 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-1070x1536.png [1536x1536-width] => 1070 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-1426x2048.png [2048x2048-width] => 1426 [2048x2048-height] => 2048 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop.png [tp-image-grid-width] => 487 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-35x50.png [admin-width] => 35 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop.png [full-width] => 1440 [full-height] => 2068 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-372x534.png [thumb_372-width] => 372 [thumb_372-height] => 534 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-435x625.png [single_post_thumbnail-width] => 435 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-22x32.png [thumb_32_32-width] => 22 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-33x48.png [thumb_48_48-width] => 33 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-45x64.png [thumb_64_64-width] => 45 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-89x128.png [thumb_128_128-width] => 89 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-47x67.png [thumb_122_67-width] => 47 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-107x153.png [thumb_153_153-width] => 107 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-114x163.png [thumb_130_163-width] => 114 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-123x177.png [thumb_232_177-width] => 123 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-453x650.png [thumb_272_325-width] => 453 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-241x346.png [thumb_271_346-width] => 241 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-189x271.png [thumb_271_271-width] => 189 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-120x172.png [thumb_272_172-width] => 120 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-321x461.png [thumb_372_461-width] => 321 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-348x500.png [thumb_372_500-width] => 348 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-188x270.png [thumb_385_270-width] => 188 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-168x241.png [thumb_416_241-width] => 168 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-285x410.png [thumb_448_410-width] => 285 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-571x820.png [thumb_448_410_retina-width] => 571 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-266x382.png [thumb_574_382-width] => 266 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/CTA_and_Value_Prop-275x395.png [thumb_776_395-width] => 275 [thumb_776_395-height] => 395 ) ) )

Results

 Treatment NameConv. RateRelative DifferenceConfidence
C: Control 10.2%
T1: CTA and Value Prop 15.2%49.4% 95.3%

This experiment has a required sample size of 335 in order to be valid. Since the experiment had a total sample size of 684, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 49.4% increase in conversion rate
× 62.9% increase in average gift
143.5% increase in revenue

Key Learnings

We had arrived at the original copy through a series of prior experiments. As a result, we were relatively confident that it adequately communicated the value proposition of The Heritage Foundation, but by simply adding an additional paragraph that reinforced that message and asking them to make a gift, we were able to not only get more donors to give, but give even more generously. The treatment increased donor conversion by 49%.

Additionally, we saw an increase in average gift by 62.9%. While the average gift lift had not yet statistically validated by the time the test was shut off, the approaching validity seems to indicate that we would be experiencing a combined lift to revenue of 143.5%.

This experiment reinforced the importance of increasing the force of the value proposition by reminding people of what their gift will do and always having a call-to-action in the copy.


Experiment Documented by Courtney Gaines
Courtney Gaines is Vice President at NextAfter.

Question about experiment #4269

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.