Illinois Policy Institute

How direct donation asks in an email impact performance

Experiment ID: #6186

Illinois Policy Institute

Experiment Summary

Timeframe: 02/16/2017 - 02/21/2017

As part of their February appeal, the Illinois Policy Institute was going to be sending a solicitation to their house file. Historically, the appeals had often used a softer call-to-action with the goal of getting more subscribers to the landing page for potential donor conversion. However, we had the hypothesis that by using the softer call-to-action of “learn more,” we may be losing the interest of people that would be more inclined to make a donation. We decided to split the file in half and test a direct ask in the email vs. the standard “Learn more” approach. The learnings from this test could then inform future appeals.

Research Question

How will a direct ask in an email impact overall donor conversion?

Design

C: Soft Call to Action
Array ( [0] => Array ( [ID] => 13420 [id] => 13420 [title] => Screenshot-2017-02-27-10.35.37.png [filename] => Screenshot-2017-02-27-10.35.37.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37.png [link] => https://www.nextafter.com/experiments/how-direct-donation-asks-in-an-email-impact-performance/attachment/screenshot-2017-02-27-10-35-37-png/ [alt] => [author] => 6 [description] => [caption] => [name] => screenshot-2017-02-27-10-35-37-png [status] => inherit [uploaded_to] => 13419 [date] => 2021-02-25 06:10:09 [modified] => 2021-02-25 06:10:09 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 960 [height] => 1276 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-226x300.png [medium-width] => 226 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-768x1021.png [medium_large-width] => 640 [medium_large-height] => 851 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-770x1024.png [large-width] => 640 [large-height] => 851 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37.png [1536x1536-width] => 960 [1536x1536-height] => 1276 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37.png [2048x2048-width] => 960 [2048x2048-height] => 1276 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37.png [tp-image-grid-width] => 527 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-38x50.png [admin-width] => 38 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37.png [full-width] => 960 [full-height] => 1276 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-372x494.png [thumb_372-width] => 372 [thumb_372-height] => 494 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-470x625.png [single_post_thumbnail-width] => 470 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-24x32.png [thumb_32_32-width] => 24 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-36x48.png [thumb_48_48-width] => 36 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-48x64.png [thumb_64_64-width] => 48 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-96x128.png [thumb_128_128-width] => 96 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-50x67.png [thumb_122_67-width] => 50 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-115x153.png [thumb_153_153-width] => 115 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-123x163.png [thumb_130_163-width] => 123 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-133x177.png [thumb_232_177-width] => 133 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-489x650.png [thumb_272_325-width] => 489 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-260x346.png [thumb_271_346-width] => 260 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-204x271.png [thumb_271_271-width] => 204 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-129x172.png [thumb_272_172-width] => 129 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-347x461.png [thumb_372_461-width] => 347 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-372x494.png [thumb_372_500-width] => 372 [thumb_372_500-height] => 494 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-203x270.png [thumb_385_270-width] => 203 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-181x241.png [thumb_416_241-width] => 181 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-308x410.png [thumb_448_410-width] => 308 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-617x820.png [thumb_448_410_retina-width] => 617 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-287x382.png [thumb_574_382-width] => 287 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-297x395.png [thumb_776_395-width] => 297 [thumb_776_395-height] => 395 ) ) [1] => Array ( [ID] => 13421 [id] => 13421 [title] => Screenshot-2017-02-27-10.36.54.png [filename] => Screenshot-2017-02-27-10.36.54.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54.png [link] => https://www.nextafter.com/experiments/how-direct-donation-asks-in-an-email-impact-performance/attachment/screenshot-2017-02-27-10-36-54-png/ [alt] => [author] => 6 [description] => [caption] => [name] => screenshot-2017-02-27-10-36-54-png [status] => inherit [uploaded_to] => 13419 [date] => 2021-02-25 06:10:17 [modified] => 2021-02-25 06:10:17 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 592 [height] => 914 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-194x300.png [medium-width] => 194 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54.png [medium_large-width] => 592 [medium_large-height] => 914 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54.png [large-width] => 592 [large-height] => 914 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54.png [1536x1536-width] => 592 [1536x1536-height] => 914 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54.png [2048x2048-width] => 592 [2048x2048-height] => 914 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-592x400.png [ab-block-post-grid-landscape-width] => 592 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-592x600.png [ab-block-post-grid-square-width] => 592 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54.png [tp-image-grid-width] => 453 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-32x50.png [admin-width] => 32 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54.png [full-width] => 592 [full-height] => 914 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-372x574.png [thumb_372-width] => 372 [thumb_372-height] => 574 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-405x625.png [single_post_thumbnail-width] => 405 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-21x32.png [thumb_32_32-width] => 21 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-31x48.png [thumb_48_48-width] => 31 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-41x64.png [thumb_64_64-width] => 41 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-83x128.png [thumb_128_128-width] => 83 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-43x67.png [thumb_122_67-width] => 43 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-99x153.png [thumb_153_153-width] => 99 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-106x163.png [thumb_130_163-width] => 106 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-115x177.png [thumb_232_177-width] => 115 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-421x650.png [thumb_272_325-width] => 421 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-224x346.png [thumb_271_346-width] => 224 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-176x271.png [thumb_271_271-width] => 176 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-111x172.png [thumb_272_172-width] => 111 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-299x461.png [thumb_372_461-width] => 299 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-324x500.png [thumb_372_500-width] => 324 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-175x270.png [thumb_385_270-width] => 175 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-156x241.png [thumb_416_241-width] => 156 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-266x410.png [thumb_448_410-width] => 266 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-531x820.png [thumb_448_410_retina-width] => 531 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-247x382.png [thumb_574_382-width] => 247 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-256x395.png [thumb_776_395-width] => 256 [thumb_776_395-height] => 395 ) ) )
T1: Direct Asks
Array ( [0] => Array ( [ID] => 13420 [id] => 13420 [title] => Screenshot-2017-02-27-10.35.37.png [filename] => Screenshot-2017-02-27-10.35.37.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37.png [link] => https://www.nextafter.com/experiments/how-direct-donation-asks-in-an-email-impact-performance/attachment/screenshot-2017-02-27-10-35-37-png/ [alt] => [author] => 6 [description] => [caption] => [name] => screenshot-2017-02-27-10-35-37-png [status] => inherit [uploaded_to] => 13419 [date] => 2021-02-25 06:10:09 [modified] => 2021-02-25 06:10:09 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 960 [height] => 1276 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-226x300.png [medium-width] => 226 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-768x1021.png [medium_large-width] => 640 [medium_large-height] => 851 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-770x1024.png [large-width] => 640 [large-height] => 851 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37.png [1536x1536-width] => 960 [1536x1536-height] => 1276 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37.png [2048x2048-width] => 960 [2048x2048-height] => 1276 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37.png [tp-image-grid-width] => 527 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-38x50.png [admin-width] => 38 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37.png [full-width] => 960 [full-height] => 1276 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-372x494.png [thumb_372-width] => 372 [thumb_372-height] => 494 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-470x625.png [single_post_thumbnail-width] => 470 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-24x32.png [thumb_32_32-width] => 24 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-36x48.png [thumb_48_48-width] => 36 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-48x64.png [thumb_64_64-width] => 48 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-96x128.png [thumb_128_128-width] => 96 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-50x67.png [thumb_122_67-width] => 50 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-115x153.png [thumb_153_153-width] => 115 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-123x163.png [thumb_130_163-width] => 123 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-133x177.png [thumb_232_177-width] => 133 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-489x650.png [thumb_272_325-width] => 489 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-260x346.png [thumb_271_346-width] => 260 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-204x271.png [thumb_271_271-width] => 204 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-129x172.png [thumb_272_172-width] => 129 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-347x461.png [thumb_372_461-width] => 347 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-372x494.png [thumb_372_500-width] => 372 [thumb_372_500-height] => 494 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-203x270.png [thumb_385_270-width] => 203 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-181x241.png [thumb_416_241-width] => 181 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-308x410.png [thumb_448_410-width] => 308 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-617x820.png [thumb_448_410_retina-width] => 617 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-287x382.png [thumb_574_382-width] => 287 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.35.37-297x395.png [thumb_776_395-width] => 297 [thumb_776_395-height] => 395 ) ) [1] => Array ( [ID] => 13421 [id] => 13421 [title] => Screenshot-2017-02-27-10.36.54.png [filename] => Screenshot-2017-02-27-10.36.54.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54.png [link] => https://www.nextafter.com/experiments/how-direct-donation-asks-in-an-email-impact-performance/attachment/screenshot-2017-02-27-10-36-54-png/ [alt] => [author] => 6 [description] => [caption] => [name] => screenshot-2017-02-27-10-36-54-png [status] => inherit [uploaded_to] => 13419 [date] => 2021-02-25 06:10:17 [modified] => 2021-02-25 06:10:17 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 592 [height] => 914 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-194x300.png [medium-width] => 194 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54.png [medium_large-width] => 592 [medium_large-height] => 914 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54.png [large-width] => 592 [large-height] => 914 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54.png [1536x1536-width] => 592 [1536x1536-height] => 914 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54.png [2048x2048-width] => 592 [2048x2048-height] => 914 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-592x400.png [ab-block-post-grid-landscape-width] => 592 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-592x600.png [ab-block-post-grid-square-width] => 592 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54.png [tp-image-grid-width] => 453 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-32x50.png [admin-width] => 32 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54.png [full-width] => 592 [full-height] => 914 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-372x574.png [thumb_372-width] => 372 [thumb_372-height] => 574 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-405x625.png [single_post_thumbnail-width] => 405 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-21x32.png [thumb_32_32-width] => 21 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-31x48.png [thumb_48_48-width] => 31 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-41x64.png [thumb_64_64-width] => 41 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-83x128.png [thumb_128_128-width] => 83 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-43x67.png [thumb_122_67-width] => 43 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-99x153.png [thumb_153_153-width] => 99 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-106x163.png [thumb_130_163-width] => 106 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-115x177.png [thumb_232_177-width] => 115 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-421x650.png [thumb_272_325-width] => 421 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-224x346.png [thumb_271_346-width] => 224 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-176x271.png [thumb_271_271-width] => 176 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-111x172.png [thumb_272_172-width] => 111 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-299x461.png [thumb_372_461-width] => 299 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-324x500.png [thumb_372_500-width] => 324 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-175x270.png [thumb_385_270-width] => 175 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-156x241.png [thumb_416_241-width] => 156 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-266x410.png [thumb_448_410-width] => 266 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-531x820.png [thumb_448_410_retina-width] => 531 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-247x382.png [thumb_574_382-width] => 247 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Screenshot-2017-02-27-10.36.54-256x395.png [thumb_776_395-width] => 256 [thumb_776_395-height] => 395 ) ) )

Results

 Treatment NameConv. RateRelative DifferenceConfidence
C: Soft Call to Action 0.06%
T1: Direct Asks 0.20%246.1% 99.2%

This experiment has a required sample size of 4,683 in order to be valid. Since the experiment had a total sample size of 19,137, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 246.1% increase in conversion rate
× 10.7% decrease in average gift
209.0% increase in revenue

Key Learnings

The direct ask in the email resulted in a 246.1% lift to donor conversion rate. What is interesting is that the direct ask also resulted in a statistically significant 67% decrease in the number of visitors to the donation page. What this shows is that the direct ask for a donation is not as widely appealing as the “learn more” approach but it drove the right kind of visitors to the page; those subscribers that were more likely to make a gift.


Experiment Documented by Jeff Giddens
Jeff Giddens is President of NextAfter.

Question about experiment #6186

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.