How replacing older donation page copy impacted donor conversion rate for a new offer
Experiment ID: #19323
The Heritage Foundation
Experiment Summary
Timeframe: 11/01/2019 - 12/13/2019
When launching a new content offer related to the impeachment of the president and how the process works, we decided to launch with to donation page treatments–one that had been used as the donation page for a short series of emails when the news was released, and another that had not yet been tested. This approach was used to mitigate risk with new donation page related to the topic, and since the housefile emails along with the control donation page had produced some nice results, we assumed we would be able to capitalize upon this page’s positioning of the fundraising appeal for new content downloaders.
Research Question
Would reusing the donation page copy previously used to send a series of appeals work behind a new content offer for a related subject?
Design
C: Control
Array
(
[0] => Array
(
[ID] => 16857
[id] => 16857
[title] => Control-26-2.jpg
[filename] => Control-26-2.jpg
[filesize] => 0
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2.jpg
[link] => https://www.nextafter.com/experiments/how-replacing-older-donation-page-copy-impacted-donor-conversion-rate-for-a-new-offer/attachment/control-26-2-jpg/
[alt] =>
[author] => 16
[description] =>
[caption] =>
[name] => control-26-2-jpg
[status] => inherit
[uploaded_to] => 16856
[date] => 2021-02-25 12:12:25
[modified] => 2021-02-25 12:12:25
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 1440
[height] => 2554
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-169x300.jpg
[medium-width] => 169
[medium-height] => 300
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-768x1362.jpg
[medium_large-width] => 640
[medium_large-height] => 1135
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-577x1024.jpg
[large-width] => 577
[large-height] => 1024
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-866x1536.jpg
[1536x1536-width] => 866
[1536x1536-height] => 1536
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-1155x2048.jpg
[2048x2048-width] => 1155
[2048x2048-height] => 2048
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-600x600.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2.jpg
[tp-image-grid-width] => 395
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-28x50.jpg
[admin-width] => 28
[admin-height] => 50
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2.jpg
[full-width] => 1440
[full-height] => 2554
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-372x660.jpg
[thumb_372-width] => 372
[thumb_372-height] => 660
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-352x625.jpg
[single_post_thumbnail-width] => 352
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-18x32.jpg
[thumb_32_32-width] => 18
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-27x48.jpg
[thumb_48_48-width] => 27
[thumb_48_48-height] => 48
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-36x64.jpg
[thumb_64_64-width] => 36
[thumb_64_64-height] => 64
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-72x128.jpg
[thumb_128_128-width] => 72
[thumb_128_128-height] => 128
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-38x67.jpg
[thumb_122_67-width] => 38
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-86x153.jpg
[thumb_153_153-width] => 86
[thumb_153_153-height] => 153
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-92x163.jpg
[thumb_130_163-width] => 92
[thumb_130_163-height] => 163
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-100x177.jpg
[thumb_232_177-width] => 100
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-366x650.jpg
[thumb_272_325-width] => 366
[thumb_272_325-height] => 650
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-195x346.jpg
[thumb_271_346-width] => 195
[thumb_271_346-height] => 346
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-153x271.jpg
[thumb_271_271-width] => 153
[thumb_271_271-height] => 271
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-97x172.jpg
[thumb_272_172-width] => 97
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-260x461.jpg
[thumb_372_461-width] => 260
[thumb_372_461-height] => 461
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-282x500.jpg
[thumb_372_500-width] => 282
[thumb_372_500-height] => 500
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-152x270.jpg
[thumb_385_270-width] => 152
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-136x241.jpg
[thumb_416_241-width] => 136
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-231x410.jpg
[thumb_448_410-width] => 231
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-462x820.jpg
[thumb_448_410_retina-width] => 462
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-215x382.jpg
[thumb_574_382-width] => 215
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-223x395.jpg
[thumb_776_395-width] => 223
[thumb_776_395-height] => 395
) ) [1] => Array
(
[ID] => 16858
[id] => 16858
[title] => wConversation-9-scaled-1.jpg
[filename] => wConversation-9-scaled-1.jpg
[filesize] => 0
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1.jpg
[link] => https://www.nextafter.com/experiments/how-replacing-older-donation-page-copy-impacted-donor-conversion-rate-for-a-new-offer/attachment/wconversation-9-scaled-1-jpg/
[alt] =>
[author] => 16
[description] =>
[caption] =>
[name] => wconversation-9-scaled-1-jpg
[status] => inherit
[uploaded_to] => 16856
[date] => 2021-02-25 12:12:36
[modified] => 2021-02-25 12:12:36
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 1352
[height] => 2560
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-158x300.jpg
[medium-width] => 158
[medium-height] => 300
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-768x1454.jpg
[medium_large-width] => 640
[medium_large-height] => 1212
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-541x1024.jpg
[large-width] => 541
[large-height] => 1024
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-811x1536.jpg
[1536x1536-width] => 811
[1536x1536-height] => 1536
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-1082x2048.jpg
[2048x2048-width] => 1082
[2048x2048-height] => 2048
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-600x600.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1.jpg
[tp-image-grid-width] => 370
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-26x50.jpg
[admin-width] => 26
[admin-height] => 50
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1.jpg
[full-width] => 1352
[full-height] => 2560
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-372x704.jpg
[thumb_372-width] => 372
[thumb_372-height] => 704
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-330x625.jpg
[single_post_thumbnail-width] => 330
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-17x32.jpg
[thumb_32_32-width] => 17
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-25x48.jpg
[thumb_48_48-width] => 25
[thumb_48_48-height] => 48
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-34x64.jpg
[thumb_64_64-width] => 34
[thumb_64_64-height] => 64
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-68x128.jpg
[thumb_128_128-width] => 68
[thumb_128_128-height] => 128
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-35x67.jpg
[thumb_122_67-width] => 35
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-81x153.jpg
[thumb_153_153-width] => 81
[thumb_153_153-height] => 153
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-86x163.jpg
[thumb_130_163-width] => 86
[thumb_130_163-height] => 163
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-93x177.jpg
[thumb_232_177-width] => 93
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-343x650.jpg
[thumb_272_325-width] => 343
[thumb_272_325-height] => 650
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-183x346.jpg
[thumb_271_346-width] => 183
[thumb_271_346-height] => 346
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-143x271.jpg
[thumb_271_271-width] => 143
[thumb_271_271-height] => 271
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-91x172.jpg
[thumb_272_172-width] => 91
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-243x461.jpg
[thumb_372_461-width] => 243
[thumb_372_461-height] => 461
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-264x500.jpg
[thumb_372_500-width] => 264
[thumb_372_500-height] => 500
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-143x270.jpg
[thumb_385_270-width] => 143
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-127x241.jpg
[thumb_416_241-width] => 127
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-217x410.jpg
[thumb_448_410-width] => 217
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-433x820.jpg
[thumb_448_410_retina-width] => 433
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-202x382.jpg
[thumb_574_382-width] => 202
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-209x395.jpg
[thumb_776_395-width] => 209
[thumb_776_395-height] => 395
) ) )
T1: w/Conversation
Array
(
[0] => Array
(
[ID] => 16857
[id] => 16857
[title] => Control-26-2.jpg
[filename] => Control-26-2.jpg
[filesize] => 0
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2.jpg
[link] => https://www.nextafter.com/experiments/how-replacing-older-donation-page-copy-impacted-donor-conversion-rate-for-a-new-offer/attachment/control-26-2-jpg/
[alt] =>
[author] => 16
[description] =>
[caption] =>
[name] => control-26-2-jpg
[status] => inherit
[uploaded_to] => 16856
[date] => 2021-02-25 12:12:25
[modified] => 2021-02-25 12:12:25
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 1440
[height] => 2554
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-169x300.jpg
[medium-width] => 169
[medium-height] => 300
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-768x1362.jpg
[medium_large-width] => 640
[medium_large-height] => 1135
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-577x1024.jpg
[large-width] => 577
[large-height] => 1024
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-866x1536.jpg
[1536x1536-width] => 866
[1536x1536-height] => 1536
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-1155x2048.jpg
[2048x2048-width] => 1155
[2048x2048-height] => 2048
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-600x600.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2.jpg
[tp-image-grid-width] => 395
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-28x50.jpg
[admin-width] => 28
[admin-height] => 50
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2.jpg
[full-width] => 1440
[full-height] => 2554
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-372x660.jpg
[thumb_372-width] => 372
[thumb_372-height] => 660
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-352x625.jpg
[single_post_thumbnail-width] => 352
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-18x32.jpg
[thumb_32_32-width] => 18
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-27x48.jpg
[thumb_48_48-width] => 27
[thumb_48_48-height] => 48
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-36x64.jpg
[thumb_64_64-width] => 36
[thumb_64_64-height] => 64
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-72x128.jpg
[thumb_128_128-width] => 72
[thumb_128_128-height] => 128
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-38x67.jpg
[thumb_122_67-width] => 38
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-86x153.jpg
[thumb_153_153-width] => 86
[thumb_153_153-height] => 153
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-92x163.jpg
[thumb_130_163-width] => 92
[thumb_130_163-height] => 163
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-100x177.jpg
[thumb_232_177-width] => 100
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-366x650.jpg
[thumb_272_325-width] => 366
[thumb_272_325-height] => 650
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-195x346.jpg
[thumb_271_346-width] => 195
[thumb_271_346-height] => 346
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-153x271.jpg
[thumb_271_271-width] => 153
[thumb_271_271-height] => 271
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-97x172.jpg
[thumb_272_172-width] => 97
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-260x461.jpg
[thumb_372_461-width] => 260
[thumb_372_461-height] => 461
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-282x500.jpg
[thumb_372_500-width] => 282
[thumb_372_500-height] => 500
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-152x270.jpg
[thumb_385_270-width] => 152
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-136x241.jpg
[thumb_416_241-width] => 136
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-231x410.jpg
[thumb_448_410-width] => 231
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-462x820.jpg
[thumb_448_410_retina-width] => 462
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-215x382.jpg
[thumb_574_382-width] => 215
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-26-2-223x395.jpg
[thumb_776_395-width] => 223
[thumb_776_395-height] => 395
) ) [1] => Array
(
[ID] => 16858
[id] => 16858
[title] => wConversation-9-scaled-1.jpg
[filename] => wConversation-9-scaled-1.jpg
[filesize] => 0
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1.jpg
[link] => https://www.nextafter.com/experiments/how-replacing-older-donation-page-copy-impacted-donor-conversion-rate-for-a-new-offer/attachment/wconversation-9-scaled-1-jpg/
[alt] =>
[author] => 16
[description] =>
[caption] =>
[name] => wconversation-9-scaled-1-jpg
[status] => inherit
[uploaded_to] => 16856
[date] => 2021-02-25 12:12:36
[modified] => 2021-02-25 12:12:36
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 1352
[height] => 2560
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-158x300.jpg
[medium-width] => 158
[medium-height] => 300
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-768x1454.jpg
[medium_large-width] => 640
[medium_large-height] => 1212
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-541x1024.jpg
[large-width] => 541
[large-height] => 1024
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-811x1536.jpg
[1536x1536-width] => 811
[1536x1536-height] => 1536
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-1082x2048.jpg
[2048x2048-width] => 1082
[2048x2048-height] => 2048
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-600x600.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1.jpg
[tp-image-grid-width] => 370
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-26x50.jpg
[admin-width] => 26
[admin-height] => 50
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1.jpg
[full-width] => 1352
[full-height] => 2560
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-372x704.jpg
[thumb_372-width] => 372
[thumb_372-height] => 704
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-330x625.jpg
[single_post_thumbnail-width] => 330
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-17x32.jpg
[thumb_32_32-width] => 17
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-25x48.jpg
[thumb_48_48-width] => 25
[thumb_48_48-height] => 48
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-34x64.jpg
[thumb_64_64-width] => 34
[thumb_64_64-height] => 64
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-68x128.jpg
[thumb_128_128-width] => 68
[thumb_128_128-height] => 128
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-35x67.jpg
[thumb_122_67-width] => 35
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-81x153.jpg
[thumb_153_153-width] => 81
[thumb_153_153-height] => 153
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-86x163.jpg
[thumb_130_163-width] => 86
[thumb_130_163-height] => 163
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-93x177.jpg
[thumb_232_177-width] => 93
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-343x650.jpg
[thumb_272_325-width] => 343
[thumb_272_325-height] => 650
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-183x346.jpg
[thumb_271_346-width] => 183
[thumb_271_346-height] => 346
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-143x271.jpg
[thumb_271_271-width] => 143
[thumb_271_271-height] => 271
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-91x172.jpg
[thumb_272_172-width] => 91
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-243x461.jpg
[thumb_372_461-width] => 243
[thumb_372_461-height] => 461
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-264x500.jpg
[thumb_372_500-width] => 264
[thumb_372_500-height] => 500
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-143x270.jpg
[thumb_385_270-width] => 143
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-127x241.jpg
[thumb_416_241-width] => 127
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-217x410.jpg
[thumb_448_410-width] => 217
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-433x820.jpg
[thumb_448_410_retina-width] => 433
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-202x382.jpg
[thumb_574_382-width] => 202
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/wConversation-9-scaled-1-209x395.jpg
[thumb_776_395-width] => 209
[thumb_776_395-height] => 395
) ) )
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | |
|---|---|---|---|---|
| C: | Control | 11.2% | ||
| T1: | w/Conversation | 14.1% | 25.1% | 85.5% |
This experiment has a required sample size of 1,063 in order to be valid. Since the experiment had a total sample size of 1,181, and the level of confidence is not above 95% the experiment results are not valid.
Key Learnings
The treatment page (which was previously unseen by the housefile) showed an aggregate increase in donor conversion rate of 25.1%, but did not validate (LoC: 85.5%) because we turned it off early.
Why? Because we actually saw no difference between the treatments for new visitors, but saw a decline in donor conversion rate of 34% (LoC: 92%) for returning visitors to the control page.
Our hypothesis is that donors that had previously seen the control page through the earlier series of appeals felt like they had already given a gift in response to that ask. For this reason, they decided not to give another gift to the page, but for new visitors–the treatment performed slightly better (whereas the control message had no difference).
For that reason, we decided to roll out the treatment copy as the new control, as it showed no negatives for any audience type, which will remove the risks associated with returning visitors feeling like they have already given to “this initiative,” and presenting them with a new ask instead.