The Heritage Foundation
How centering an ask around a specific initiative affects donation rates for house file traffic during a Giving Tuesday campaign
Experiment ID: #116803
The Heritage Foundation
Experiment Summary
Ended On: 11/30/2022
In an effort to help a public policy client differentiate their message on a day when we know that donors will be inundated with a flood of appeals, we wanted to know how focusing the messaging around a specific initiative would affect donation rates during a one-day Giving Tuesday campaign.
We ran this test for one day, splitting house file traffic between a control that focused on high-level value language and a treatment that focused on supporting a specific initiative.
Research Question
We believe that centering an ask around a specific initiative will increase donation rates during a Giving Tuesday campaign by adding exclusivity and tangibility to the appeal.
Design
C: Control
Array
(
[0] => Array
(
[ID] => 53883
[id] => 53883
[title] => Control.png
[filename] => Control-4918.png
[filesize] => 935101
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918.png
[link] => https://www.nextafter.com/experiments/how-centering-an-ask-around-a-specific-initiative-affects-donation-rates-for-house-file-traffic-during-a-giving-tuesday-campaign/attachment/control-png-5780/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => control-png-5780
[status] => inherit
[uploaded_to] => 48110
[date] => 2023-07-18 20:24:27
[modified] => 2023-07-18 20:24:27
[menu_order] => 0
[mime_type] => image/png
[type] => image
[subtype] => png
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 1248
[height] => 3084
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-150x150.png
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-121x300.png
[medium-width] => 121
[medium-height] => 300
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-768x1898.png
[medium_large-width] => 640
[medium_large-height] => 1582
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-414x1024.png
[large-width] => 414
[large-height] => 1024
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-622x1536.png
[1536x1536-width] => 622
[1536x1536-height] => 1536
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-829x2048.png
[2048x2048-width] => 829
[2048x2048-height] => 2048
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-600x400.png
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-600x600.png
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918.png
[tp-image-grid-width] => 283
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-150x150.png
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-20x50.png
[admin-width] => 20
[admin-height] => 50
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918.png
[full-width] => 1248
[full-height] => 3084
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-372x919.png
[thumb_372-width] => 372
[thumb_372-height] => 919
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-253x625.png
[single_post_thumbnail-width] => 253
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-13x32.png
[thumb_32_32-width] => 13
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-19x48.png
[thumb_48_48-width] => 19
[thumb_48_48-height] => 48
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-26x64.png
[thumb_64_64-width] => 26
[thumb_64_64-height] => 64
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-52x128.png
[thumb_128_128-width] => 52
[thumb_128_128-height] => 128
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-27x67.png
[thumb_122_67-width] => 27
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-62x153.png
[thumb_153_153-width] => 62
[thumb_153_153-height] => 153
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-66x163.png
[thumb_130_163-width] => 66
[thumb_130_163-height] => 163
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-72x177.png
[thumb_232_177-width] => 72
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-263x650.png
[thumb_272_325-width] => 263
[thumb_272_325-height] => 650
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-140x346.png
[thumb_271_346-width] => 140
[thumb_271_346-height] => 346
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-110x271.png
[thumb_271_271-width] => 110
[thumb_271_271-height] => 271
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-70x172.png
[thumb_272_172-width] => 70
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-187x461.png
[thumb_372_461-width] => 187
[thumb_372_461-height] => 461
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-202x500.png
[thumb_372_500-width] => 202
[thumb_372_500-height] => 500
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-109x270.png
[thumb_385_270-width] => 109
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-98x241.png
[thumb_416_241-width] => 98
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-166x410.png
[thumb_448_410-width] => 166
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-332x820.png
[thumb_448_410_retina-width] => 332
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-155x382.png
[thumb_574_382-width] => 155
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-160x395.png
[thumb_776_395-width] => 160
[thumb_776_395-height] => 395
) ) [1] => Array
(
[ID] => 53885
[id] => 53885
[title] => Treatment_#1.png
[filename] => Treatment_1-1395.png
[filesize] => 859949
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395.png
[link] => https://www.nextafter.com/experiments/how-centering-an-ask-around-a-specific-initiative-affects-donation-rates-for-house-file-traffic-during-a-giving-tuesday-campaign/attachment/treatment_1-png-1682/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => treatment_1-png-1682
[status] => inherit
[uploaded_to] => 48110
[date] => 2023-07-18 20:24:46
[modified] => 2023-07-18 20:24:46
[menu_order] => 0
[mime_type] => image/png
[type] => image
[subtype] => png
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 1248
[height] => 2760
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-150x150.png
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-136x300.png
[medium-width] => 136
[medium-height] => 300
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-768x1698.png
[medium_large-width] => 640
[medium_large-height] => 1415
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-463x1024.png
[large-width] => 463
[large-height] => 1024
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-695x1536.png
[1536x1536-width] => 695
[1536x1536-height] => 1536
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-926x2048.png
[2048x2048-width] => 926
[2048x2048-height] => 2048
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-600x400.png
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-600x600.png
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395.png
[tp-image-grid-width] => 317
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-150x150.png
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-23x50.png
[admin-width] => 23
[admin-height] => 50
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395.png
[full-width] => 1248
[full-height] => 2760
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-372x823.png
[thumb_372-width] => 372
[thumb_372-height] => 823
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-283x625.png
[single_post_thumbnail-width] => 283
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-14x32.png
[thumb_32_32-width] => 14
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-22x48.png
[thumb_48_48-width] => 22
[thumb_48_48-height] => 48
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-29x64.png
[thumb_64_64-width] => 29
[thumb_64_64-height] => 64
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-58x128.png
[thumb_128_128-width] => 58
[thumb_128_128-height] => 128
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-30x67.png
[thumb_122_67-width] => 30
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-69x153.png
[thumb_153_153-width] => 69
[thumb_153_153-height] => 153
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-74x163.png
[thumb_130_163-width] => 74
[thumb_130_163-height] => 163
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-80x177.png
[thumb_232_177-width] => 80
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-294x650.png
[thumb_272_325-width] => 294
[thumb_272_325-height] => 650
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-156x346.png
[thumb_271_346-width] => 156
[thumb_271_346-height] => 346
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-123x271.png
[thumb_271_271-width] => 123
[thumb_271_271-height] => 271
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-78x172.png
[thumb_272_172-width] => 78
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-208x461.png
[thumb_372_461-width] => 208
[thumb_372_461-height] => 461
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-226x500.png
[thumb_372_500-width] => 226
[thumb_372_500-height] => 500
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-122x270.png
[thumb_385_270-width] => 122
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-109x241.png
[thumb_416_241-width] => 109
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-185x410.png
[thumb_448_410-width] => 185
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-371x820.png
[thumb_448_410_retina-width] => 371
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-173x382.png
[thumb_574_382-width] => 173
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-179x395.png
[thumb_776_395-width] => 179
[thumb_776_395-height] => 395
) ) )
T1: Treatment #1
Array
(
[0] => Array
(
[ID] => 53883
[id] => 53883
[title] => Control.png
[filename] => Control-4918.png
[filesize] => 935101
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918.png
[link] => https://www.nextafter.com/experiments/how-centering-an-ask-around-a-specific-initiative-affects-donation-rates-for-house-file-traffic-during-a-giving-tuesday-campaign/attachment/control-png-5780/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => control-png-5780
[status] => inherit
[uploaded_to] => 48110
[date] => 2023-07-18 20:24:27
[modified] => 2023-07-18 20:24:27
[menu_order] => 0
[mime_type] => image/png
[type] => image
[subtype] => png
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 1248
[height] => 3084
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-150x150.png
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-121x300.png
[medium-width] => 121
[medium-height] => 300
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-768x1898.png
[medium_large-width] => 640
[medium_large-height] => 1582
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-414x1024.png
[large-width] => 414
[large-height] => 1024
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-622x1536.png
[1536x1536-width] => 622
[1536x1536-height] => 1536
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-829x2048.png
[2048x2048-width] => 829
[2048x2048-height] => 2048
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-600x400.png
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-600x600.png
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918.png
[tp-image-grid-width] => 283
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-150x150.png
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-20x50.png
[admin-width] => 20
[admin-height] => 50
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918.png
[full-width] => 1248
[full-height] => 3084
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-372x919.png
[thumb_372-width] => 372
[thumb_372-height] => 919
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-253x625.png
[single_post_thumbnail-width] => 253
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-13x32.png
[thumb_32_32-width] => 13
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-19x48.png
[thumb_48_48-width] => 19
[thumb_48_48-height] => 48
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-26x64.png
[thumb_64_64-width] => 26
[thumb_64_64-height] => 64
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-52x128.png
[thumb_128_128-width] => 52
[thumb_128_128-height] => 128
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-27x67.png
[thumb_122_67-width] => 27
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-62x153.png
[thumb_153_153-width] => 62
[thumb_153_153-height] => 153
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-66x163.png
[thumb_130_163-width] => 66
[thumb_130_163-height] => 163
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-72x177.png
[thumb_232_177-width] => 72
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-263x650.png
[thumb_272_325-width] => 263
[thumb_272_325-height] => 650
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-140x346.png
[thumb_271_346-width] => 140
[thumb_271_346-height] => 346
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-110x271.png
[thumb_271_271-width] => 110
[thumb_271_271-height] => 271
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-70x172.png
[thumb_272_172-width] => 70
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-187x461.png
[thumb_372_461-width] => 187
[thumb_372_461-height] => 461
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-202x500.png
[thumb_372_500-width] => 202
[thumb_372_500-height] => 500
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-109x270.png
[thumb_385_270-width] => 109
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-98x241.png
[thumb_416_241-width] => 98
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-166x410.png
[thumb_448_410-width] => 166
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-332x820.png
[thumb_448_410_retina-width] => 332
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-155x382.png
[thumb_574_382-width] => 155
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-4918-160x395.png
[thumb_776_395-width] => 160
[thumb_776_395-height] => 395
) ) [1] => Array
(
[ID] => 53885
[id] => 53885
[title] => Treatment_#1.png
[filename] => Treatment_1-1395.png
[filesize] => 859949
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395.png
[link] => https://www.nextafter.com/experiments/how-centering-an-ask-around-a-specific-initiative-affects-donation-rates-for-house-file-traffic-during-a-giving-tuesday-campaign/attachment/treatment_1-png-1682/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => treatment_1-png-1682
[status] => inherit
[uploaded_to] => 48110
[date] => 2023-07-18 20:24:46
[modified] => 2023-07-18 20:24:46
[menu_order] => 0
[mime_type] => image/png
[type] => image
[subtype] => png
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 1248
[height] => 2760
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-150x150.png
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-136x300.png
[medium-width] => 136
[medium-height] => 300
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-768x1698.png
[medium_large-width] => 640
[medium_large-height] => 1415
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-463x1024.png
[large-width] => 463
[large-height] => 1024
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-695x1536.png
[1536x1536-width] => 695
[1536x1536-height] => 1536
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-926x2048.png
[2048x2048-width] => 926
[2048x2048-height] => 2048
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-600x400.png
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-600x600.png
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395.png
[tp-image-grid-width] => 317
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-150x150.png
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-23x50.png
[admin-width] => 23
[admin-height] => 50
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395.png
[full-width] => 1248
[full-height] => 2760
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-372x823.png
[thumb_372-width] => 372
[thumb_372-height] => 823
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-283x625.png
[single_post_thumbnail-width] => 283
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-14x32.png
[thumb_32_32-width] => 14
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-22x48.png
[thumb_48_48-width] => 22
[thumb_48_48-height] => 48
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-29x64.png
[thumb_64_64-width] => 29
[thumb_64_64-height] => 64
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-58x128.png
[thumb_128_128-width] => 58
[thumb_128_128-height] => 128
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-30x67.png
[thumb_122_67-width] => 30
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-69x153.png
[thumb_153_153-width] => 69
[thumb_153_153-height] => 153
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-74x163.png
[thumb_130_163-width] => 74
[thumb_130_163-height] => 163
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-80x177.png
[thumb_232_177-width] => 80
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-294x650.png
[thumb_272_325-width] => 294
[thumb_272_325-height] => 650
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-156x346.png
[thumb_271_346-width] => 156
[thumb_271_346-height] => 346
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-123x271.png
[thumb_271_271-width] => 123
[thumb_271_271-height] => 271
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-78x172.png
[thumb_272_172-width] => 78
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-208x461.png
[thumb_372_461-width] => 208
[thumb_372_461-height] => 461
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-226x500.png
[thumb_372_500-width] => 226
[thumb_372_500-height] => 500
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-122x270.png
[thumb_385_270-width] => 122
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-109x241.png
[thumb_416_241-width] => 109
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-185x410.png
[thumb_448_410-width] => 185
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-371x820.png
[thumb_448_410_retina-width] => 371
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-173x382.png
[thumb_574_382-width] => 173
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1395-179x395.png
[thumb_776_395-width] => 179
[thumb_776_395-height] => 395
) ) )
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence |
---|
C: | Control | 1.1% | | |
T1: | Treatment #1 | 4.1% | 275.1% | 100.0% |
This experiment has a required sample size of
184 in order to be valid. Since the experiment had a total sample size of
2,771, and
the level of confidence is above 95% the experiment results are
valid.
Flux Metrics Affected
The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average
gift).
This experiment produced the following results:
0% increase in traffic
× 275.1% increase in conversion rate
× 0% increase in average gift
Key Learnings
After running this experiment for one day, with one email appeal sent in the morning and one in the afternoon, the treatment focusing its messaging around a specific initiative produced a 275% statistically valid lift in donation rates with a 99.9% level of confidence.
We believe that one of the main contributing factors to this result is that focusing the appeal on a specific initiative helps to increase the perceived value of a donor’s gift by adding exclusivity, authority, tangibility, and specificity to the appeal.
The initiative-specific appeal offered a tangible solution to an issue recipients care about by letting them know exactly what their gift would support, and the concrete steps our client would be taking on their behalf to influence the outcome donors desired.
It also leveraged exclusivity by offering a solution that is unique to this organization and authority by making it clear that they would be working with a broad coalition of other influential organizations to get the job done.
Specificity adds texture to the appeal while building trust by not just saying what the organization planned to do but also how they planned to do it.
Finally, we believe all of these elements combined to differentiate the message of the appeal on a day when donors received a large concentration of emails which were typically focused on very high-level messaging containing nearly identical language … ultimately making the treatment appeal stand out from the crowd, hold their prospects’ attention, and motivate them to support the initiative at hand.