How reinforcing the recurring gift option may have impacted single gift donor conversion
Experiment ID: #30255
Americans for Prosperity
Experiment Summary
Ended On: 04/29/2020
As a part of the COVID-19 (Coronavirus) response efforts, American’s For Prosperity made available to concerned Americans an opportunity to add their name to an open letter to Congress as they planned a government response to provide citizens aid, as well as focused stimulus dollars to “restart the economy” again after the pandemic.
The open letter had become a wonderful engagement piece for the housefile, so they decided to open it up to prospective supporters to give them the opportunity to add their name alongside tens of thousands of other signers, as well.
Because the open letter was so popular, they decided to put a donation appeal behind it and test acquiring new donors, and did so very effectively.
But as time went on, they thought: “Would people activate a recurring gift if asked?” — so we decided to test it.
Research Question
Would presenting a reinforcement as to why the donor should consider a recurring gift impact donor conversion or revenue by single or recurring gift types?
Design
C: Control
Array
(
[0] => Array
(
[ID] => 47217
[id] => 47217
[title] => Control.jpg
[filename] => Control-2355.jpg
[filesize] => 63084
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[link] => https://www.nextafter.com/experiments/how-reinforcing-the-recurring-gift-option-may-have-impacted-single-gift-donor-conversion/attachment/control-jpg-2831/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => control-jpg-2831
[status] => inherit
[uploaded_to] => 17085
[date] => 2022-11-04 18:34:08
[modified] => 2022-11-04 18:34:08
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 678
[height] => 530
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-300x235.jpg
[medium-width] => 300
[medium-height] => 235
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[medium_large-width] => 640
[medium_large-height] => 500
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[large-width] => 640
[large-height] => 500
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[1536x1536-width] => 678
[1536x1536-height] => 530
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[2048x2048-width] => 678
[2048x2048-height] => 530
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-600x530.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 530
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[tp-image-grid-width] => 678
[tp-image-grid-height] => 530
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-50x39.jpg
[admin-width] => 50
[admin-height] => 39
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[full-width] => 678
[full-height] => 530
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-372x291.jpg
[thumb_372-width] => 372
[thumb_372-height] => 291
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[single_post_thumbnail-width] => 678
[single_post_thumbnail-height] => 530
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-32x25.jpg
[thumb_32_32-width] => 32
[thumb_32_32-height] => 25
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-48x38.jpg
[thumb_48_48-width] => 48
[thumb_48_48-height] => 38
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-64x50.jpg
[thumb_64_64-width] => 64
[thumb_64_64-height] => 50
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-128x100.jpg
[thumb_128_128-width] => 128
[thumb_128_128-height] => 100
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-86x67.jpg
[thumb_122_67-width] => 86
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-153x120.jpg
[thumb_153_153-width] => 153
[thumb_153_153-height] => 120
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-130x102.jpg
[thumb_130_163-width] => 130
[thumb_130_163-height] => 102
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-226x177.jpg
[thumb_232_177-width] => 226
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-544x425.jpg
[thumb_272_325-width] => 544
[thumb_272_325-height] => 425
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-271x212.jpg
[thumb_271_346-width] => 271
[thumb_271_346-height] => 212
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-271x212.jpg
[thumb_271_271-width] => 271
[thumb_271_271-height] => 212
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-220x172.jpg
[thumb_272_172-width] => 220
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-372x291.jpg
[thumb_372_461-width] => 372
[thumb_372_461-height] => 291
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-372x291.jpg
[thumb_372_500-width] => 372
[thumb_372_500-height] => 291
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-345x270.jpg
[thumb_385_270-width] => 345
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-308x241.jpg
[thumb_416_241-width] => 308
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-448x350.jpg
[thumb_448_410-width] => 448
[thumb_448_410-height] => 350
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[thumb_448_410_retina-width] => 678
[thumb_448_410_retina-height] => 530
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-489x382.jpg
[thumb_574_382-width] => 489
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-505x395.jpg
[thumb_776_395-width] => 505
[thumb_776_395-height] => 395
) ) [1] => Array
(
[ID] => 47218
[id] => 47218
[title] => Treatment_#1.jpg
[filename] => Treatment_1-1026.jpg
[filesize] => 89087
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[link] => https://www.nextafter.com/experiments/how-reinforcing-the-recurring-gift-option-may-have-impacted-single-gift-donor-conversion/attachment/treatment_1-jpg-1244/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => treatment_1-jpg-1244
[status] => inherit
[uploaded_to] => 17085
[date] => 2022-11-04 18:34:38
[modified] => 2022-11-04 18:34:38
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 693
[height] => 610
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-300x264.jpg
[medium-width] => 300
[medium-height] => 264
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[medium_large-width] => 640
[medium_large-height] => 563
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[large-width] => 640
[large-height] => 563
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[1536x1536-width] => 693
[1536x1536-height] => 610
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[2048x2048-width] => 693
[2048x2048-height] => 610
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-600x600.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[tp-image-grid-width] => 693
[tp-image-grid-height] => 610
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-50x44.jpg
[admin-width] => 50
[admin-height] => 44
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[full-width] => 693
[full-height] => 610
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-372x327.jpg
[thumb_372-width] => 372
[thumb_372-height] => 327
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[single_post_thumbnail-width] => 693
[single_post_thumbnail-height] => 610
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-32x28.jpg
[thumb_32_32-width] => 32
[thumb_32_32-height] => 28
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-48x42.jpg
[thumb_48_48-width] => 48
[thumb_48_48-height] => 42
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-64x56.jpg
[thumb_64_64-width] => 64
[thumb_64_64-height] => 56
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-128x113.jpg
[thumb_128_128-width] => 128
[thumb_128_128-height] => 113
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-76x67.jpg
[thumb_122_67-width] => 76
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-153x135.jpg
[thumb_153_153-width] => 153
[thumb_153_153-height] => 135
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-130x114.jpg
[thumb_130_163-width] => 130
[thumb_130_163-height] => 114
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-201x177.jpg
[thumb_232_177-width] => 201
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-544x479.jpg
[thumb_272_325-width] => 544
[thumb_272_325-height] => 479
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-271x239.jpg
[thumb_271_346-width] => 271
[thumb_271_346-height] => 239
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-271x239.jpg
[thumb_271_271-width] => 271
[thumb_271_271-height] => 239
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-195x172.jpg
[thumb_272_172-width] => 195
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-372x327.jpg
[thumb_372_461-width] => 372
[thumb_372_461-height] => 327
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-372x327.jpg
[thumb_372_500-width] => 372
[thumb_372_500-height] => 327
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-307x270.jpg
[thumb_385_270-width] => 307
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-274x241.jpg
[thumb_416_241-width] => 274
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-448x394.jpg
[thumb_448_410-width] => 448
[thumb_448_410-height] => 394
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[thumb_448_410_retina-width] => 693
[thumb_448_410_retina-height] => 610
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-434x382.jpg
[thumb_574_382-width] => 434
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-449x395.jpg
[thumb_776_395-width] => 449
[thumb_776_395-height] => 395
) ) )
T1: Treatment #1
Array
(
[0] => Array
(
[ID] => 47217
[id] => 47217
[title] => Control.jpg
[filename] => Control-2355.jpg
[filesize] => 63084
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[link] => https://www.nextafter.com/experiments/how-reinforcing-the-recurring-gift-option-may-have-impacted-single-gift-donor-conversion/attachment/control-jpg-2831/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => control-jpg-2831
[status] => inherit
[uploaded_to] => 17085
[date] => 2022-11-04 18:34:08
[modified] => 2022-11-04 18:34:08
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 678
[height] => 530
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-300x235.jpg
[medium-width] => 300
[medium-height] => 235
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[medium_large-width] => 640
[medium_large-height] => 500
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[large-width] => 640
[large-height] => 500
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[1536x1536-width] => 678
[1536x1536-height] => 530
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[2048x2048-width] => 678
[2048x2048-height] => 530
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-600x530.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 530
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[tp-image-grid-width] => 678
[tp-image-grid-height] => 530
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-50x39.jpg
[admin-width] => 50
[admin-height] => 39
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[full-width] => 678
[full-height] => 530
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-372x291.jpg
[thumb_372-width] => 372
[thumb_372-height] => 291
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[single_post_thumbnail-width] => 678
[single_post_thumbnail-height] => 530
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-32x25.jpg
[thumb_32_32-width] => 32
[thumb_32_32-height] => 25
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-48x38.jpg
[thumb_48_48-width] => 48
[thumb_48_48-height] => 38
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-64x50.jpg
[thumb_64_64-width] => 64
[thumb_64_64-height] => 50
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-128x100.jpg
[thumb_128_128-width] => 128
[thumb_128_128-height] => 100
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-86x67.jpg
[thumb_122_67-width] => 86
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-153x120.jpg
[thumb_153_153-width] => 153
[thumb_153_153-height] => 120
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-130x102.jpg
[thumb_130_163-width] => 130
[thumb_130_163-height] => 102
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-226x177.jpg
[thumb_232_177-width] => 226
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-544x425.jpg
[thumb_272_325-width] => 544
[thumb_272_325-height] => 425
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-271x212.jpg
[thumb_271_346-width] => 271
[thumb_271_346-height] => 212
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-271x212.jpg
[thumb_271_271-width] => 271
[thumb_271_271-height] => 212
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-220x172.jpg
[thumb_272_172-width] => 220
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-372x291.jpg
[thumb_372_461-width] => 372
[thumb_372_461-height] => 291
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-372x291.jpg
[thumb_372_500-width] => 372
[thumb_372_500-height] => 291
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-345x270.jpg
[thumb_385_270-width] => 345
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-308x241.jpg
[thumb_416_241-width] => 308
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-448x350.jpg
[thumb_448_410-width] => 448
[thumb_448_410-height] => 350
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355.jpg
[thumb_448_410_retina-width] => 678
[thumb_448_410_retina-height] => 530
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-489x382.jpg
[thumb_574_382-width] => 489
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2355-505x395.jpg
[thumb_776_395-width] => 505
[thumb_776_395-height] => 395
) ) [1] => Array
(
[ID] => 47218
[id] => 47218
[title] => Treatment_#1.jpg
[filename] => Treatment_1-1026.jpg
[filesize] => 89087
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[link] => https://www.nextafter.com/experiments/how-reinforcing-the-recurring-gift-option-may-have-impacted-single-gift-donor-conversion/attachment/treatment_1-jpg-1244/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => treatment_1-jpg-1244
[status] => inherit
[uploaded_to] => 17085
[date] => 2022-11-04 18:34:38
[modified] => 2022-11-04 18:34:38
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 693
[height] => 610
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-300x264.jpg
[medium-width] => 300
[medium-height] => 264
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[medium_large-width] => 640
[medium_large-height] => 563
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[large-width] => 640
[large-height] => 563
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[1536x1536-width] => 693
[1536x1536-height] => 610
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[2048x2048-width] => 693
[2048x2048-height] => 610
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-600x600.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[tp-image-grid-width] => 693
[tp-image-grid-height] => 610
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-50x44.jpg
[admin-width] => 50
[admin-height] => 44
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[full-width] => 693
[full-height] => 610
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-372x327.jpg
[thumb_372-width] => 372
[thumb_372-height] => 327
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[single_post_thumbnail-width] => 693
[single_post_thumbnail-height] => 610
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-32x28.jpg
[thumb_32_32-width] => 32
[thumb_32_32-height] => 28
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-48x42.jpg
[thumb_48_48-width] => 48
[thumb_48_48-height] => 42
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-64x56.jpg
[thumb_64_64-width] => 64
[thumb_64_64-height] => 56
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-128x113.jpg
[thumb_128_128-width] => 128
[thumb_128_128-height] => 113
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-76x67.jpg
[thumb_122_67-width] => 76
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-153x135.jpg
[thumb_153_153-width] => 153
[thumb_153_153-height] => 135
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-130x114.jpg
[thumb_130_163-width] => 130
[thumb_130_163-height] => 114
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-201x177.jpg
[thumb_232_177-width] => 201
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-544x479.jpg
[thumb_272_325-width] => 544
[thumb_272_325-height] => 479
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-271x239.jpg
[thumb_271_346-width] => 271
[thumb_271_346-height] => 239
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-271x239.jpg
[thumb_271_271-width] => 271
[thumb_271_271-height] => 239
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-195x172.jpg
[thumb_272_172-width] => 195
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-372x327.jpg
[thumb_372_461-width] => 372
[thumb_372_461-height] => 327
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-372x327.jpg
[thumb_372_500-width] => 372
[thumb_372_500-height] => 327
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-307x270.jpg
[thumb_385_270-width] => 307
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-274x241.jpg
[thumb_416_241-width] => 274
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-448x394.jpg
[thumb_448_410-width] => 448
[thumb_448_410-height] => 394
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026.jpg
[thumb_448_410_retina-width] => 693
[thumb_448_410_retina-height] => 610
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-434x382.jpg
[thumb_574_382-width] => 434
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-1026-449x395.jpg
[thumb_776_395-width] => 449
[thumb_776_395-height] => 395
) ) )
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | |
|---|---|---|---|---|
| C: | Control | 4.0% | ||
| T1: | Treatment #1 | 3.3% | -16.1% | 97.6% |
This experiment has a required sample size of 6,672 in order to be valid. Since the experiment had a total sample size of 17,626, and the level of confidence is above 95% the experiment results are valid.
Flux Metrics Affected
The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:
0% increase in traffic
× 16.1% decrease in conversion rate
× 0% increase in average gift
Key Learnings
With 97.5% level of confidence, we identified that the single gift donor conversion rate decreased by -16.1% with this treatment.
With fewer donors coming through the single gift option, it’s worth noting that the average gift of those going through the treatment (and being exposed to the organization’s core value proposition in the recurring gift reinforcement message), we did notice an average gift that was 14% higher than the gifts collected in the control experience.
But how did this do overall at converting recurring donors?
It did slightly better—achieving a +39% increase in donors choosing the recurring gift option, and subsequently +90% more monthly recurring dollars, however neither of those metrics were validated in this study.
So, what is causing this decrease in single gift donor conversion? We actually believe that it is because the 50/50 traffic split is sending less motivated traffic to the treatment experience, rather than the control. However, the offer is time-relevant, and time is running out. With the need to maximize results before the opportunity is gone, we decided to pull the treatment and eliminate the potential threat to results that it was indeed the cause of decreased results.
Further experimentation with this treatment is advised when it has an opportunity to run for a longer period of time.