Hillsdale College

How the force of the value proposition affects donor conversion rate

Experiment ID: #4401

Hillsdale College

Experiment Summary

Timeframe: 06/24/2016 - 06/29/2016

Hillsdale College was in the middle of their fiscal year-end fundraising campaign when they decided to test a new framework for developing copy on their donation page. Their current donation page started with the headline “You can help defend the Constitution and restore liberty”, which told the reader what they could do. The copy then led into the three points that Hillsdale would do (with their donation) to accomplish these objectives.

But Hillsdale hypothesized that the page was missing a real problem to draw the reader in and set up the three initiatives of the campaign. Additionally, the transitions between each of the initiatives — the glue that draws them together — were missing. They drafted a treatment that started with the problem: “Our Country Stands at a Constitutional Crossroads”. Then, they developed copy that moved seamlessly between the initiatives and called out the fact that Hillsdale receives no government funding, even in the form of student loans.

They launched an A/B copy test on the page, and tested it as they sent multiple email appeals.

Research Question

Will increasing the force of the value proposition increase donor conversion?

Design

C: Control
Array ( [0] => Array ( [ID] => 12867 [id] => 12867 [title] => Control-4-1.png [filename] => Control-4-1.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1.png [link] => https://www.nextafter.com/experiments/how-the-force-of-the-value-proposition-affects-donor-conversion-rate-2/attachment/control-4-1-png/ [alt] => [author] => 6 [description] => [caption] => [name] => control-4-1-png [status] => inherit [uploaded_to] => 12866 [date] => 2021-02-25 04:51:18 [modified] => 2021-02-25 04:51:18 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 1440 [height] => 3381 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-128x300.png [medium-width] => 128 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-768x1803.png [medium_large-width] => 640 [medium_large-height] => 1503 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-436x1024.png [large-width] => 436 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-654x1536.png [1536x1536-width] => 654 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-872x2048.png [2048x2048-width] => 872 [2048x2048-height] => 2048 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1.png [tp-image-grid-width] => 298 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-21x50.png [admin-width] => 21 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1.png [full-width] => 1440 [full-height] => 3381 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-372x873.png [thumb_372-width] => 372 [thumb_372-height] => 873 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-266x625.png [single_post_thumbnail-width] => 266 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-14x32.png [thumb_32_32-width] => 14 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-20x48.png [thumb_48_48-width] => 20 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-27x64.png [thumb_64_64-width] => 27 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-55x128.png [thumb_128_128-width] => 55 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-29x67.png [thumb_122_67-width] => 29 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-65x153.png [thumb_153_153-width] => 65 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-69x163.png [thumb_130_163-width] => 69 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-75x177.png [thumb_232_177-width] => 75 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-277x650.png [thumb_272_325-width] => 277 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-147x346.png [thumb_271_346-width] => 147 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-115x271.png [thumb_271_271-width] => 115 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-73x172.png [thumb_272_172-width] => 73 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-196x461.png [thumb_372_461-width] => 196 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-213x500.png [thumb_372_500-width] => 213 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-115x270.png [thumb_385_270-width] => 115 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-103x241.png [thumb_416_241-width] => 103 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-175x410.png [thumb_448_410-width] => 175 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-349x820.png [thumb_448_410_retina-width] => 349 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-163x382.png [thumb_574_382-width] => 163 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-168x395.png [thumb_776_395-width] => 168 [thumb_776_395-height] => 395 ) ) [1] => Array ( [ID] => 12868 [id] => 12868 [title] => Oratium_Style_Copy.png [filename] => Oratium_Style_Copy.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy.png [link] => https://www.nextafter.com/experiments/how-the-force-of-the-value-proposition-affects-donor-conversion-rate-2/attachment/oratium_style_copy-png/ [alt] => [author] => 6 [description] => [caption] => [name] => oratium_style_copy-png [status] => inherit [uploaded_to] => 12866 [date] => 2021-02-25 04:51:32 [modified] => 2021-02-25 04:51:32 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 1440 [height] => 3154 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-137x300.png [medium-width] => 137 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-768x1682.png [medium_large-width] => 640 [medium_large-height] => 1402 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-468x1024.png [large-width] => 468 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-701x1536.png [1536x1536-width] => 701 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-935x2048.png [2048x2048-width] => 935 [2048x2048-height] => 2048 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy.png [tp-image-grid-width] => 320 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-23x50.png [admin-width] => 23 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy.png [full-width] => 1440 [full-height] => 3154 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-372x815.png [thumb_372-width] => 372 [thumb_372-height] => 815 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-285x625.png [single_post_thumbnail-width] => 285 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-15x32.png [thumb_32_32-width] => 15 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-22x48.png [thumb_48_48-width] => 22 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-29x64.png [thumb_64_64-width] => 29 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-58x128.png [thumb_128_128-width] => 58 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-31x67.png [thumb_122_67-width] => 31 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-70x153.png [thumb_153_153-width] => 70 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-74x163.png [thumb_130_163-width] => 74 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-81x177.png [thumb_232_177-width] => 81 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-297x650.png [thumb_272_325-width] => 297 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-158x346.png [thumb_271_346-width] => 158 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-124x271.png [thumb_271_271-width] => 124 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-79x172.png [thumb_272_172-width] => 79 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-210x461.png [thumb_372_461-width] => 210 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-228x500.png [thumb_372_500-width] => 228 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-123x270.png [thumb_385_270-width] => 123 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-110x241.png [thumb_416_241-width] => 110 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-187x410.png [thumb_448_410-width] => 187 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-374x820.png [thumb_448_410_retina-width] => 374 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-174x382.png [thumb_574_382-width] => 174 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-180x395.png [thumb_776_395-width] => 180 [thumb_776_395-height] => 395 ) ) )
T1: Value Proposition Copy Treatment
Array ( [0] => Array ( [ID] => 12867 [id] => 12867 [title] => Control-4-1.png [filename] => Control-4-1.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1.png [link] => https://www.nextafter.com/experiments/how-the-force-of-the-value-proposition-affects-donor-conversion-rate-2/attachment/control-4-1-png/ [alt] => [author] => 6 [description] => [caption] => [name] => control-4-1-png [status] => inherit [uploaded_to] => 12866 [date] => 2021-02-25 04:51:18 [modified] => 2021-02-25 04:51:18 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 1440 [height] => 3381 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-128x300.png [medium-width] => 128 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-768x1803.png [medium_large-width] => 640 [medium_large-height] => 1503 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-436x1024.png [large-width] => 436 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-654x1536.png [1536x1536-width] => 654 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-872x2048.png [2048x2048-width] => 872 [2048x2048-height] => 2048 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1.png [tp-image-grid-width] => 298 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-21x50.png [admin-width] => 21 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1.png [full-width] => 1440 [full-height] => 3381 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-372x873.png [thumb_372-width] => 372 [thumb_372-height] => 873 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-266x625.png [single_post_thumbnail-width] => 266 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-14x32.png [thumb_32_32-width] => 14 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-20x48.png [thumb_48_48-width] => 20 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-27x64.png [thumb_64_64-width] => 27 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-55x128.png [thumb_128_128-width] => 55 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-29x67.png [thumb_122_67-width] => 29 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-65x153.png [thumb_153_153-width] => 65 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-69x163.png [thumb_130_163-width] => 69 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-75x177.png [thumb_232_177-width] => 75 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-277x650.png [thumb_272_325-width] => 277 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-147x346.png [thumb_271_346-width] => 147 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-115x271.png [thumb_271_271-width] => 115 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-73x172.png [thumb_272_172-width] => 73 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-196x461.png [thumb_372_461-width] => 196 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-213x500.png [thumb_372_500-width] => 213 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-115x270.png [thumb_385_270-width] => 115 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-103x241.png [thumb_416_241-width] => 103 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-175x410.png [thumb_448_410-width] => 175 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-349x820.png [thumb_448_410_retina-width] => 349 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-163x382.png [thumb_574_382-width] => 163 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4-1-168x395.png [thumb_776_395-width] => 168 [thumb_776_395-height] => 395 ) ) [1] => Array ( [ID] => 12868 [id] => 12868 [title] => Oratium_Style_Copy.png [filename] => Oratium_Style_Copy.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy.png [link] => https://www.nextafter.com/experiments/how-the-force-of-the-value-proposition-affects-donor-conversion-rate-2/attachment/oratium_style_copy-png/ [alt] => [author] => 6 [description] => [caption] => [name] => oratium_style_copy-png [status] => inherit [uploaded_to] => 12866 [date] => 2021-02-25 04:51:32 [modified] => 2021-02-25 04:51:32 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 1440 [height] => 3154 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-137x300.png [medium-width] => 137 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-768x1682.png [medium_large-width] => 640 [medium_large-height] => 1402 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-468x1024.png [large-width] => 468 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-701x1536.png [1536x1536-width] => 701 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-935x2048.png [2048x2048-width] => 935 [2048x2048-height] => 2048 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy.png [tp-image-grid-width] => 320 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-23x50.png [admin-width] => 23 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy.png [full-width] => 1440 [full-height] => 3154 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-372x815.png [thumb_372-width] => 372 [thumb_372-height] => 815 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-285x625.png [single_post_thumbnail-width] => 285 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-15x32.png [thumb_32_32-width] => 15 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-22x48.png [thumb_48_48-width] => 22 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-29x64.png [thumb_64_64-width] => 29 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-58x128.png [thumb_128_128-width] => 58 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-31x67.png [thumb_122_67-width] => 31 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-70x153.png [thumb_153_153-width] => 70 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-74x163.png [thumb_130_163-width] => 74 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-81x177.png [thumb_232_177-width] => 81 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-297x650.png [thumb_272_325-width] => 297 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-158x346.png [thumb_271_346-width] => 158 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-124x271.png [thumb_271_271-width] => 124 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-79x172.png [thumb_272_172-width] => 79 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-210x461.png [thumb_372_461-width] => 210 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-228x500.png [thumb_372_500-width] => 228 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-123x270.png [thumb_385_270-width] => 123 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-110x241.png [thumb_416_241-width] => 110 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-187x410.png [thumb_448_410-width] => 187 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-374x820.png [thumb_448_410_retina-width] => 374 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-174x382.png [thumb_574_382-width] => 174 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Oratium_Style_Copy-180x395.png [thumb_776_395-width] => 180 [thumb_776_395-height] => 395 ) ) )

Results

 Treatment NameConv. RateRelative DifferenceConfidence
C: Control 46.0%
T1: Value Proposition Copy Treatment 54.5%18.4% 97.5%

This experiment has a required sample size of 268 in order to be valid. Since the experiment had a total sample size of 695, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 18.4% increase in conversion rate
× 0% increase in average gift

Key Learnings

The new copy produced an 18.4% lift in donor conversion, with a directional increase in average gift as well.

This shows that the new framework for donation page copy and presentation of the value proposition may increase fundraising results. While this was just one campaign, it certainly makes the case for continued testing of this copy model in future campaigns.

This experiment also shows the importance of frameworks. Without a framework, or a hypothesis behind why the copy was changed, we might just conclude that one landing page was “just better than the other”. But the framework tells us exactly what elements were changed, strengthened, and re-ordered to create better-performing copy with a stronger value proposition. This framework ensures that the result can be replicated on future campaigns.


Experiment Documented by Jeff Giddens
Jeff Giddens is President of NextAfter.

Question about experiment #4401

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.