The Heritage Foundation

How increasing the gift array on a donor acquisition page impacted overall revenue

Experiment ID: #11941

The Heritage Foundation

Experiment Summary

Ended On: 02/19/2019

Continuous testing to improve revenue from clickthrough traffic from The Daily Signal’s “Dear Reader” visitors has yielded consistent wins by the control. At this point, we wanted to experiment with the gift array to see if we could increase the revenue by just simply asking for a higher gift amount.

Research Question

Will increasing the gift array improve donor conversion rates and revenue?

Design

C: $25, $50, $100
Array ( [0] => Array ( [ID] => 15941 [id] => 15941 [title] => 25_50_100.jpg [filename] => 25_50_100-scaled.jpg [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-scaled.jpg [link] => https://www.nextafter.com/experiments/how-increasing-the-gift-array-on-a-donor-acquisition-page-impacted-overall-revenue/attachment/25_50_100-jpg/ [alt] => [author] => 16 [description] => [caption] => [name] => 25_50_100-jpg [status] => inherit [uploaded_to] => 15940 [date] => 2021-02-25 10:51:14 [modified] => 2021-02-25 10:51:14 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 624 [height] => 2560 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-73x300.jpg [medium-width] => 73 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-768x3151.jpg [medium_large-width] => 640 [medium_large-height] => 2626 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-250x1024.jpg [large-width] => 250 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-374x1536.jpg [1536x1536-width] => 374 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-499x2048.jpg [2048x2048-width] => 499 [2048x2048-height] => 2048 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-600x400.jpg [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-600x600.jpg [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-scaled.jpg [tp-image-grid-width] => 171 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-12x50.jpg [admin-width] => 12 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-scaled.jpg [full-width] => 624 [full-height] => 2560 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-372x1526.jpg [thumb_372-width] => 372 [thumb_372-height] => 1526 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-152x625.jpg [single_post_thumbnail-width] => 152 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-8x32.jpg [thumb_32_32-width] => 8 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-12x48.jpg [thumb_48_48-width] => 12 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-16x64.jpg [thumb_64_64-width] => 16 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-31x128.jpg [thumb_128_128-width] => 31 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-16x67.jpg [thumb_122_67-width] => 16 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-37x153.jpg [thumb_153_153-width] => 37 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-40x163.jpg [thumb_130_163-width] => 40 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-43x177.jpg [thumb_232_177-width] => 43 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-158x650.jpg [thumb_272_325-width] => 158 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-84x346.jpg [thumb_271_346-width] => 84 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-66x271.jpg [thumb_271_271-width] => 66 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-42x172.jpg [thumb_272_172-width] => 42 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-112x461.jpg [thumb_372_461-width] => 112 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-122x500.jpg [thumb_372_500-width] => 122 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-66x270.jpg [thumb_385_270-width] => 66 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-59x241.jpg [thumb_416_241-width] => 59 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-100x410.jpg [thumb_448_410-width] => 100 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-200x820.jpg [thumb_448_410_retina-width] => 200 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-93x382.jpg [thumb_574_382-width] => 93 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-96x395.jpg [thumb_776_395-width] => 96 [thumb_776_395-height] => 395 ) ) [1] => Array ( [ID] => 15942 [id] => 15942 [title] => 50_75_100.jpg [filename] => 50_75_100-scaled.jpg [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-scaled.jpg [link] => https://www.nextafter.com/experiments/how-increasing-the-gift-array-on-a-donor-acquisition-page-impacted-overall-revenue/attachment/50_75_100-jpg/ [alt] => [author] => 16 [description] => [caption] => [name] => 50_75_100-jpg [status] => inherit [uploaded_to] => 15940 [date] => 2021-02-25 10:51:34 [modified] => 2021-02-25 10:51:34 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 638 [height] => 2560 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-75x300.jpg [medium-width] => 75 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-768x3081.jpg [medium_large-width] => 640 [medium_large-height] => 2568 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-255x1024.jpg [large-width] => 255 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-383x1536.jpg [1536x1536-width] => 383 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-511x2048.jpg [2048x2048-width] => 511 [2048x2048-height] => 2048 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-600x400.jpg [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-600x600.jpg [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-scaled.jpg [tp-image-grid-width] => 174 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-12x50.jpg [admin-width] => 12 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-scaled.jpg [full-width] => 638 [full-height] => 2560 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-372x1492.jpg [thumb_372-width] => 372 [thumb_372-height] => 1492 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-156x625.jpg [single_post_thumbnail-width] => 156 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-8x32.jpg [thumb_32_32-width] => 8 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-12x48.jpg [thumb_48_48-width] => 12 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-16x64.jpg [thumb_64_64-width] => 16 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-32x128.jpg [thumb_128_128-width] => 32 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-17x67.jpg [thumb_122_67-width] => 17 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-38x153.jpg [thumb_153_153-width] => 38 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-41x163.jpg [thumb_130_163-width] => 41 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-44x177.jpg [thumb_232_177-width] => 44 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-162x650.jpg [thumb_272_325-width] => 162 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-86x346.jpg [thumb_271_346-width] => 86 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-68x271.jpg [thumb_271_271-width] => 68 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-43x172.jpg [thumb_272_172-width] => 43 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-115x461.jpg [thumb_372_461-width] => 115 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-125x500.jpg [thumb_372_500-width] => 125 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-67x270.jpg [thumb_385_270-width] => 67 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-60x241.jpg [thumb_416_241-width] => 60 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-102x410.jpg [thumb_448_410-width] => 102 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-204x820.jpg [thumb_448_410_retina-width] => 204 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-95x382.jpg [thumb_574_382-width] => 95 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-98x395.jpg [thumb_776_395-width] => 98 [thumb_776_395-height] => 395 ) ) )
T1: $50, $75, $100
Array ( [0] => Array ( [ID] => 15941 [id] => 15941 [title] => 25_50_100.jpg [filename] => 25_50_100-scaled.jpg [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-scaled.jpg [link] => https://www.nextafter.com/experiments/how-increasing-the-gift-array-on-a-donor-acquisition-page-impacted-overall-revenue/attachment/25_50_100-jpg/ [alt] => [author] => 16 [description] => [caption] => [name] => 25_50_100-jpg [status] => inherit [uploaded_to] => 15940 [date] => 2021-02-25 10:51:14 [modified] => 2021-02-25 10:51:14 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 624 [height] => 2560 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-73x300.jpg [medium-width] => 73 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-768x3151.jpg [medium_large-width] => 640 [medium_large-height] => 2626 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-250x1024.jpg [large-width] => 250 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-374x1536.jpg [1536x1536-width] => 374 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-499x2048.jpg [2048x2048-width] => 499 [2048x2048-height] => 2048 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-600x400.jpg [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-600x600.jpg [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-scaled.jpg [tp-image-grid-width] => 171 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-12x50.jpg [admin-width] => 12 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-scaled.jpg [full-width] => 624 [full-height] => 2560 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-372x1526.jpg [thumb_372-width] => 372 [thumb_372-height] => 1526 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-152x625.jpg [single_post_thumbnail-width] => 152 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-8x32.jpg [thumb_32_32-width] => 8 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-12x48.jpg [thumb_48_48-width] => 12 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-16x64.jpg [thumb_64_64-width] => 16 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-31x128.jpg [thumb_128_128-width] => 31 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-16x67.jpg [thumb_122_67-width] => 16 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-37x153.jpg [thumb_153_153-width] => 37 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-40x163.jpg [thumb_130_163-width] => 40 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-43x177.jpg [thumb_232_177-width] => 43 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-158x650.jpg [thumb_272_325-width] => 158 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-84x346.jpg [thumb_271_346-width] => 84 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-66x271.jpg [thumb_271_271-width] => 66 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-42x172.jpg [thumb_272_172-width] => 42 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-112x461.jpg [thumb_372_461-width] => 112 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-122x500.jpg [thumb_372_500-width] => 122 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-66x270.jpg [thumb_385_270-width] => 66 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-59x241.jpg [thumb_416_241-width] => 59 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-100x410.jpg [thumb_448_410-width] => 100 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-200x820.jpg [thumb_448_410_retina-width] => 200 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-93x382.jpg [thumb_574_382-width] => 93 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/25_50_100-96x395.jpg [thumb_776_395-width] => 96 [thumb_776_395-height] => 395 ) ) [1] => Array ( [ID] => 15942 [id] => 15942 [title] => 50_75_100.jpg [filename] => 50_75_100-scaled.jpg [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-scaled.jpg [link] => https://www.nextafter.com/experiments/how-increasing-the-gift-array-on-a-donor-acquisition-page-impacted-overall-revenue/attachment/50_75_100-jpg/ [alt] => [author] => 16 [description] => [caption] => [name] => 50_75_100-jpg [status] => inherit [uploaded_to] => 15940 [date] => 2021-02-25 10:51:34 [modified] => 2021-02-25 10:51:34 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 638 [height] => 2560 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-75x300.jpg [medium-width] => 75 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-768x3081.jpg [medium_large-width] => 640 [medium_large-height] => 2568 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-255x1024.jpg [large-width] => 255 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-383x1536.jpg [1536x1536-width] => 383 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-511x2048.jpg [2048x2048-width] => 511 [2048x2048-height] => 2048 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-600x400.jpg [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-600x600.jpg [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-scaled.jpg [tp-image-grid-width] => 174 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-12x50.jpg [admin-width] => 12 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-scaled.jpg [full-width] => 638 [full-height] => 2560 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-372x1492.jpg [thumb_372-width] => 372 [thumb_372-height] => 1492 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-156x625.jpg [single_post_thumbnail-width] => 156 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-8x32.jpg [thumb_32_32-width] => 8 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-12x48.jpg [thumb_48_48-width] => 12 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-16x64.jpg [thumb_64_64-width] => 16 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-32x128.jpg [thumb_128_128-width] => 32 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-17x67.jpg [thumb_122_67-width] => 17 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-38x153.jpg [thumb_153_153-width] => 38 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-41x163.jpg [thumb_130_163-width] => 41 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-44x177.jpg [thumb_232_177-width] => 44 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-162x650.jpg [thumb_272_325-width] => 162 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-86x346.jpg [thumb_271_346-width] => 86 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-68x271.jpg [thumb_271_271-width] => 68 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-43x172.jpg [thumb_272_172-width] => 43 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-115x461.jpg [thumb_372_461-width] => 115 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-125x500.jpg [thumb_372_500-width] => 125 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-67x270.jpg [thumb_385_270-width] => 67 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-60x241.jpg [thumb_416_241-width] => 60 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-102x410.jpg [thumb_448_410-width] => 102 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-204x820.jpg [thumb_448_410_retina-width] => 204 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-95x382.jpg [thumb_574_382-width] => 95 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/50_75_100-98x395.jpg [thumb_776_395-width] => 98 [thumb_776_395-height] => 395 ) ) )

Results

 Treatment NameRevenue per VisitorRelative DifferenceConfidenceAverage Gift
C: $25, $50, $100 $0.03$41.03
T1: $50, $75, $100 $0.01-63.1% 99.8%$42.28

This experiment was validated using 3rd party testing tools. Based upon those calculations, a significant level of confidence was met so these experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 64.2% decrease in conversion rate
× 3.0% increase in average gift
63.1% decrease in revenue

Key Learnings

With a 99.7% level of confidence, we validated a decrease of revenue by 63%. We also validated (with a 99% LoC) that a higher gift array (starting at $50) decreased the donor conversion rates on this page by 64%, as well.

Meanwhile, the increase in average gift for the treatment did increase, but by only a negligible amount.

Typically, we would want to collect a sample of at least 100 donations, but we pulled the plug because the revenue disparity was so large between the two treatments.


Experiment Documented by Greg Colunga
Greg Colunga is Chief Operating Office at NextAfter.

Question about experiment #11941

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.