How asking for less impacted overall revenue
Experiment ID: #78478
The Heritage Foundation
Experiment Summary
Timeframe: 11/30/2021 - 12/02/2021
As part of their Giving Tuesday campaign, The Heritage Foundation wanted to test a relatively new concept known as the downgraded ask. For this experiment, they created a chart of standards based upon the donors’ previous highest contribution where they would ask for a certain number of donors to give a specific amount. For the treatment version of this ask, they asked for a level below what the donor had previously given and added language acknowledging that they were being asked for less.
This was then tested across both emails that were sent out on Giving Tuesday and results were determined based upon all online giving (excluding recurring gifts) during Giving Tuesday and the day following.
Research Question
We believe that asking for less than their previous highest contribution for existing donors will achieve increase overall response and revenue.
Design
C: Control
Array
(
[0] => Array
(
[ID] => 28105
[id] => 28105
[title] => Control.png
[filename] => Control-1328.png
[filesize] => 0
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328.png
[link] => https://www.nextafter.com/experiments/how-asking-for-less-impacted-overall-revenue-2/attachment/control-png-1430/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => control-png-1430
[status] => inherit
[uploaded_to] => 22591
[date] => 2022-04-21 14:40:34
[modified] => 2022-04-21 14:40:34
[menu_order] => 0
[mime_type] => image/png
[type] => image
[subtype] => png
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 1333
[height] => 995
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-150x150.png
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-300x224.png
[medium-width] => 300
[medium-height] => 224
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-768x573.png
[medium_large-width] => 640
[medium_large-height] => 478
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-1024x764.png
[large-width] => 640
[large-height] => 478
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328.png
[1536x1536-width] => 1333
[1536x1536-height] => 995
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328.png
[2048x2048-width] => 1333
[2048x2048-height] => 995
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-600x400.png
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-600x600.png
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328.png
[tp-image-grid-width] => 700
[tp-image-grid-height] => 523
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-150x150.png
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-50x37.png
[admin-width] => 50
[admin-height] => 37
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328.png
[full-width] => 1333
[full-height] => 995
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-372x278.png
[thumb_372-width] => 372
[thumb_372-height] => 278
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-837x625.png
[single_post_thumbnail-width] => 837
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-32x24.png
[thumb_32_32-width] => 32
[thumb_32_32-height] => 24
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-48x36.png
[thumb_48_48-width] => 48
[thumb_48_48-height] => 36
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-64x48.png
[thumb_64_64-width] => 64
[thumb_64_64-height] => 48
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-128x96.png
[thumb_128_128-width] => 128
[thumb_128_128-height] => 96
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-90x67.png
[thumb_122_67-width] => 90
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-153x114.png
[thumb_153_153-width] => 153
[thumb_153_153-height] => 114
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-130x97.png
[thumb_130_163-width] => 130
[thumb_130_163-height] => 97
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-232x173.png
[thumb_232_177-width] => 232
[thumb_232_177-height] => 173
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-544x406.png
[thumb_272_325-width] => 544
[thumb_272_325-height] => 406
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-271x202.png
[thumb_271_346-width] => 271
[thumb_271_346-height] => 202
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-271x202.png
[thumb_271_271-width] => 271
[thumb_271_271-height] => 202
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-230x172.png
[thumb_272_172-width] => 230
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-372x278.png
[thumb_372_461-width] => 372
[thumb_372_461-height] => 278
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-372x278.png
[thumb_372_500-width] => 372
[thumb_372_500-height] => 278
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-362x270.png
[thumb_385_270-width] => 362
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-323x241.png
[thumb_416_241-width] => 323
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-448x334.png
[thumb_448_410-width] => 448
[thumb_448_410-height] => 334
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-896x669.png
[thumb_448_410_retina-width] => 896
[thumb_448_410_retina-height] => 669
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-512x382.png
[thumb_574_382-width] => 512
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-529x395.png
[thumb_776_395-width] => 529
[thumb_776_395-height] => 395
) ) [1] => Array
(
[ID] => 28106
[id] => 28106
[title] => Downgrade_Treatment.png
[filename] => Downgrade_Treatment-2.png
[filesize] => 0
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2.png
[link] => https://www.nextafter.com/experiments/how-asking-for-less-impacted-overall-revenue-2/attachment/downgrade_treatment-png-3/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => downgrade_treatment-png-3
[status] => inherit
[uploaded_to] => 22591
[date] => 2022-04-21 14:41:03
[modified] => 2022-04-21 14:41:03
[menu_order] => 0
[mime_type] => image/png
[type] => image
[subtype] => png
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 1362
[height] => 1038
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-150x150.png
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-300x229.png
[medium-width] => 300
[medium-height] => 229
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-768x585.png
[medium_large-width] => 640
[medium_large-height] => 488
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-1024x780.png
[large-width] => 640
[large-height] => 488
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2.png
[1536x1536-width] => 1362
[1536x1536-height] => 1038
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2.png
[2048x2048-width] => 1362
[2048x2048-height] => 1038
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-600x400.png
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-600x600.png
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2.png
[tp-image-grid-width] => 700
[tp-image-grid-height] => 533
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-150x150.png
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-50x38.png
[admin-width] => 50
[admin-height] => 38
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2.png
[full-width] => 1362
[full-height] => 1038
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-372x284.png
[thumb_372-width] => 372
[thumb_372-height] => 284
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-820x625.png
[single_post_thumbnail-width] => 820
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-32x24.png
[thumb_32_32-width] => 32
[thumb_32_32-height] => 24
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-48x37.png
[thumb_48_48-width] => 48
[thumb_48_48-height] => 37
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-64x49.png
[thumb_64_64-width] => 64
[thumb_64_64-height] => 49
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-128x98.png
[thumb_128_128-width] => 128
[thumb_128_128-height] => 98
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-88x67.png
[thumb_122_67-width] => 88
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-153x117.png
[thumb_153_153-width] => 153
[thumb_153_153-height] => 117
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-130x99.png
[thumb_130_163-width] => 130
[thumb_130_163-height] => 99
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-232x177.png
[thumb_232_177-width] => 232
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-544x415.png
[thumb_272_325-width] => 544
[thumb_272_325-height] => 415
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-271x207.png
[thumb_271_346-width] => 271
[thumb_271_346-height] => 207
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-271x207.png
[thumb_271_271-width] => 271
[thumb_271_271-height] => 207
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-226x172.png
[thumb_272_172-width] => 226
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-372x284.png
[thumb_372_461-width] => 372
[thumb_372_461-height] => 284
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-372x284.png
[thumb_372_500-width] => 372
[thumb_372_500-height] => 284
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-354x270.png
[thumb_385_270-width] => 354
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-316x241.png
[thumb_416_241-width] => 316
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-448x341.png
[thumb_448_410-width] => 448
[thumb_448_410-height] => 341
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-896x683.png
[thumb_448_410_retina-width] => 896
[thumb_448_410_retina-height] => 683
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-501x382.png
[thumb_574_382-width] => 501
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-518x395.png
[thumb_776_395-width] => 518
[thumb_776_395-height] => 395
) ) )
T1: Downgrade Treatment
Array
(
[0] => Array
(
[ID] => 28105
[id] => 28105
[title] => Control.png
[filename] => Control-1328.png
[filesize] => 0
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328.png
[link] => https://www.nextafter.com/experiments/how-asking-for-less-impacted-overall-revenue-2/attachment/control-png-1430/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => control-png-1430
[status] => inherit
[uploaded_to] => 22591
[date] => 2022-04-21 14:40:34
[modified] => 2022-04-21 14:40:34
[menu_order] => 0
[mime_type] => image/png
[type] => image
[subtype] => png
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 1333
[height] => 995
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-150x150.png
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-300x224.png
[medium-width] => 300
[medium-height] => 224
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-768x573.png
[medium_large-width] => 640
[medium_large-height] => 478
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-1024x764.png
[large-width] => 640
[large-height] => 478
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328.png
[1536x1536-width] => 1333
[1536x1536-height] => 995
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328.png
[2048x2048-width] => 1333
[2048x2048-height] => 995
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-600x400.png
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-600x600.png
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328.png
[tp-image-grid-width] => 700
[tp-image-grid-height] => 523
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-150x150.png
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-50x37.png
[admin-width] => 50
[admin-height] => 37
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328.png
[full-width] => 1333
[full-height] => 995
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-372x278.png
[thumb_372-width] => 372
[thumb_372-height] => 278
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-837x625.png
[single_post_thumbnail-width] => 837
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-32x24.png
[thumb_32_32-width] => 32
[thumb_32_32-height] => 24
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-48x36.png
[thumb_48_48-width] => 48
[thumb_48_48-height] => 36
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-64x48.png
[thumb_64_64-width] => 64
[thumb_64_64-height] => 48
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-128x96.png
[thumb_128_128-width] => 128
[thumb_128_128-height] => 96
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-90x67.png
[thumb_122_67-width] => 90
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-153x114.png
[thumb_153_153-width] => 153
[thumb_153_153-height] => 114
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-130x97.png
[thumb_130_163-width] => 130
[thumb_130_163-height] => 97
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-232x173.png
[thumb_232_177-width] => 232
[thumb_232_177-height] => 173
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-544x406.png
[thumb_272_325-width] => 544
[thumb_272_325-height] => 406
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-271x202.png
[thumb_271_346-width] => 271
[thumb_271_346-height] => 202
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-271x202.png
[thumb_271_271-width] => 271
[thumb_271_271-height] => 202
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-230x172.png
[thumb_272_172-width] => 230
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-372x278.png
[thumb_372_461-width] => 372
[thumb_372_461-height] => 278
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-372x278.png
[thumb_372_500-width] => 372
[thumb_372_500-height] => 278
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-362x270.png
[thumb_385_270-width] => 362
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-323x241.png
[thumb_416_241-width] => 323
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-448x334.png
[thumb_448_410-width] => 448
[thumb_448_410-height] => 334
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-896x669.png
[thumb_448_410_retina-width] => 896
[thumb_448_410_retina-height] => 669
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-512x382.png
[thumb_574_382-width] => 512
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-1328-529x395.png
[thumb_776_395-width] => 529
[thumb_776_395-height] => 395
) ) [1] => Array
(
[ID] => 28106
[id] => 28106
[title] => Downgrade_Treatment.png
[filename] => Downgrade_Treatment-2.png
[filesize] => 0
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2.png
[link] => https://www.nextafter.com/experiments/how-asking-for-less-impacted-overall-revenue-2/attachment/downgrade_treatment-png-3/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => downgrade_treatment-png-3
[status] => inherit
[uploaded_to] => 22591
[date] => 2022-04-21 14:41:03
[modified] => 2022-04-21 14:41:03
[menu_order] => 0
[mime_type] => image/png
[type] => image
[subtype] => png
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 1362
[height] => 1038
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-150x150.png
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-300x229.png
[medium-width] => 300
[medium-height] => 229
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-768x585.png
[medium_large-width] => 640
[medium_large-height] => 488
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-1024x780.png
[large-width] => 640
[large-height] => 488
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2.png
[1536x1536-width] => 1362
[1536x1536-height] => 1038
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2.png
[2048x2048-width] => 1362
[2048x2048-height] => 1038
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-600x400.png
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-600x600.png
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2.png
[tp-image-grid-width] => 700
[tp-image-grid-height] => 533
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-150x150.png
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-50x38.png
[admin-width] => 50
[admin-height] => 38
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2.png
[full-width] => 1362
[full-height] => 1038
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-372x284.png
[thumb_372-width] => 372
[thumb_372-height] => 284
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-820x625.png
[single_post_thumbnail-width] => 820
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-32x24.png
[thumb_32_32-width] => 32
[thumb_32_32-height] => 24
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-48x37.png
[thumb_48_48-width] => 48
[thumb_48_48-height] => 37
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-64x49.png
[thumb_64_64-width] => 64
[thumb_64_64-height] => 49
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-128x98.png
[thumb_128_128-width] => 128
[thumb_128_128-height] => 98
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-88x67.png
[thumb_122_67-width] => 88
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-153x117.png
[thumb_153_153-width] => 153
[thumb_153_153-height] => 117
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-130x99.png
[thumb_130_163-width] => 130
[thumb_130_163-height] => 99
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-232x177.png
[thumb_232_177-width] => 232
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-544x415.png
[thumb_272_325-width] => 544
[thumb_272_325-height] => 415
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-271x207.png
[thumb_271_346-width] => 271
[thumb_271_346-height] => 207
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-271x207.png
[thumb_271_271-width] => 271
[thumb_271_271-height] => 207
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-226x172.png
[thumb_272_172-width] => 226
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-372x284.png
[thumb_372_461-width] => 372
[thumb_372_461-height] => 284
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-372x284.png
[thumb_372_500-width] => 372
[thumb_372_500-height] => 284
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-354x270.png
[thumb_385_270-width] => 354
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-316x241.png
[thumb_416_241-width] => 316
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-448x341.png
[thumb_448_410-width] => 448
[thumb_448_410-height] => 341
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-896x683.png
[thumb_448_410_retina-width] => 896
[thumb_448_410_retina-height] => 683
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-501x382.png
[thumb_574_382-width] => 501
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Downgrade_Treatment-2-518x395.png
[thumb_776_395-width] => 518
[thumb_776_395-height] => 395
) ) )
Results
| Treatment Name | Revenue per Visitor | Relative Difference | Confidence | Average Gift | |
|---|---|---|---|---|---|
| C: | Control | $0.08 | $59.61 | ||
| T1: | Downgrade Treatment | $0.11 | 34.4% | 95.1% | $74.28 |
This experiment was validated using 3rd party testing tools. Based upon those calculations, a significant level of confidence was met so these experiment results are valid.
Flux Metrics Affected
The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:
0% increase in traffic
× 7.8% increase in conversion rate
× 24.6% increase in average gift
34.4% increase in revenue
Key Learnings
The “downgrade” treatment resulted in a 34% increase in overall revenue with a 95% level of confidence. However, it did not reach the required sample size to statistically validate this learning so it should be viewed as a directional lift.
When digging into the data, we analyzed a few distinct segments to better understand how the decreased giving language impacted donors based upon how much they have given in the past. Here is what we observed:
- Highest gift between $1 – $99: We saw a 10% increase in conversion rate but an 8% decrease in average gift. The net result was a 1% increase in overall revenue which was not statistically significant.
- Highest gift between $100 – $999: The treatment segment saw an increase in both conversion rate (10%) and average gift (52%) which resulted in a 67.3% statistically significant increase in revenue (both LoC and Sample Size validated). This means we that, despite asking for less than they have given in the past, the segment actually gave more!
- Highest gift greater than $1K: This segment did not have enough gifts to be able to observe a trend.
This means that for the lower-dollar donors, the tactic was able to increase overall response rate but at the cost of average gift. In the future, for this segment, we would want to consider this tactic only for those we’re trying to reactivate (like lapsed donors) rather than the whole file.
For the $100-$999 donors, this is absolutely a tactic that should be repeated in future campaign. We would need additional testing to validate the $1K+ segment in the future.