How prompting for a reply impacts email engagement
Experiment ID: #15960
Alliance Defending Freedom
Experiment Summary
Timeframe: 05/14/2019 - 05/21/2019
Alliance Defending Freedom was sending out their weekly email cultivation email to a select group of subscribers. The primary goal of these emails is to increase the overall engagement of this group, as a result we wanted to test out tactics that could improve this metric.
Every email sends them an article to read on the ADF blog. In order to give them a reason to read the blog post, we wanted to try prompting the reader to respond to the email. The belief was that if we gave them a reason to read the article (in this case, to tell us their opinion), they would be more likely to consume the content.
Research Question
Will prompting the reader for a reply increase the email click through rate?
Design
C: No Reply Prompt
Array
(
[0] => Array
(
[ID] => 16350
[id] => 16350
[title] => No_Reply_Prompt-2.jpg
[filename] => No_Reply_Prompt-2.jpg
[filesize] => 0
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[link] => https://www.nextafter.com/experiments/how-prompting-for-a-reply-impacts-email-engagement/attachment/no_reply_prompt-2-jpg/
[alt] =>
[author] => 1
[description] =>
[caption] =>
[name] => no_reply_prompt-2-jpg
[status] => inherit
[uploaded_to] => 16349
[date] => 2021-02-25 11:23:58
[modified] => 2021-02-25 11:23:58
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 744
[height] => 461
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-300x186.jpg
[medium-width] => 300
[medium-height] => 186
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[medium_large-width] => 640
[medium_large-height] => 397
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[large-width] => 640
[large-height] => 397
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[1536x1536-width] => 744
[1536x1536-height] => 461
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[2048x2048-width] => 744
[2048x2048-height] => 461
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-600x461.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 461
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[tp-image-grid-width] => 700
[tp-image-grid-height] => 434
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-50x31.jpg
[admin-width] => 50
[admin-height] => 31
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[full-width] => 744
[full-height] => 461
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-372x231.jpg
[thumb_372-width] => 372
[thumb_372-height] => 231
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[single_post_thumbnail-width] => 744
[single_post_thumbnail-height] => 461
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-32x20.jpg
[thumb_32_32-width] => 32
[thumb_32_32-height] => 20
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-48x30.jpg
[thumb_48_48-width] => 48
[thumb_48_48-height] => 30
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-64x40.jpg
[thumb_64_64-width] => 64
[thumb_64_64-height] => 40
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-128x79.jpg
[thumb_128_128-width] => 128
[thumb_128_128-height] => 79
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-108x67.jpg
[thumb_122_67-width] => 108
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-153x95.jpg
[thumb_153_153-width] => 153
[thumb_153_153-height] => 95
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-130x81.jpg
[thumb_130_163-width] => 130
[thumb_130_163-height] => 81
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-232x144.jpg
[thumb_232_177-width] => 232
[thumb_232_177-height] => 144
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-544x337.jpg
[thumb_272_325-width] => 544
[thumb_272_325-height] => 337
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-271x168.jpg
[thumb_271_346-width] => 271
[thumb_271_346-height] => 168
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-271x168.jpg
[thumb_271_271-width] => 271
[thumb_271_271-height] => 168
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-272x169.jpg
[thumb_272_172-width] => 272
[thumb_272_172-height] => 169
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-372x231.jpg
[thumb_372_461-width] => 372
[thumb_372_461-height] => 231
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-372x231.jpg
[thumb_372_500-width] => 372
[thumb_372_500-height] => 231
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-385x239.jpg
[thumb_385_270-width] => 385
[thumb_385_270-height] => 239
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-389x241.jpg
[thumb_416_241-width] => 389
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-448x278.jpg
[thumb_448_410-width] => 448
[thumb_448_410-height] => 278
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[thumb_448_410_retina-width] => 744
[thumb_448_410_retina-height] => 461
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-574x356.jpg
[thumb_574_382-width] => 574
[thumb_574_382-height] => 356
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-637x395.jpg
[thumb_776_395-width] => 637
[thumb_776_395-height] => 395
) ) [1] => Array
(
[ID] => 16351
[id] => 16351
[title] => Prompt_for_Reply-2.jpg
[filename] => Prompt_for_Reply-2.jpg
[filesize] => 0
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[link] => https://www.nextafter.com/experiments/how-prompting-for-a-reply-impacts-email-engagement/attachment/prompt_for_reply-2-jpg/
[alt] =>
[author] => 1
[description] =>
[caption] =>
[name] => prompt_for_reply-2-jpg
[status] => inherit
[uploaded_to] => 16349
[date] => 2021-02-25 11:24:02
[modified] => 2021-02-25 11:24:02
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 736
[height] => 464
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-300x189.jpg
[medium-width] => 300
[medium-height] => 189
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[medium_large-width] => 640
[medium_large-height] => 403
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[large-width] => 640
[large-height] => 403
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[1536x1536-width] => 736
[1536x1536-height] => 464
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[2048x2048-width] => 736
[2048x2048-height] => 464
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-600x464.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 464
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[tp-image-grid-width] => 700
[tp-image-grid-height] => 441
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-50x32.jpg
[admin-width] => 50
[admin-height] => 32
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[full-width] => 736
[full-height] => 464
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-372x235.jpg
[thumb_372-width] => 372
[thumb_372-height] => 235
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[single_post_thumbnail-width] => 736
[single_post_thumbnail-height] => 464
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-32x20.jpg
[thumb_32_32-width] => 32
[thumb_32_32-height] => 20
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-48x30.jpg
[thumb_48_48-width] => 48
[thumb_48_48-height] => 30
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-64x40.jpg
[thumb_64_64-width] => 64
[thumb_64_64-height] => 40
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-128x81.jpg
[thumb_128_128-width] => 128
[thumb_128_128-height] => 81
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-106x67.jpg
[thumb_122_67-width] => 106
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-153x96.jpg
[thumb_153_153-width] => 153
[thumb_153_153-height] => 96
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-130x82.jpg
[thumb_130_163-width] => 130
[thumb_130_163-height] => 82
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-232x146.jpg
[thumb_232_177-width] => 232
[thumb_232_177-height] => 146
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-544x343.jpg
[thumb_272_325-width] => 544
[thumb_272_325-height] => 343
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-271x171.jpg
[thumb_271_346-width] => 271
[thumb_271_346-height] => 171
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-271x171.jpg
[thumb_271_271-width] => 271
[thumb_271_271-height] => 171
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-272x172.jpg
[thumb_272_172-width] => 272
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-372x235.jpg
[thumb_372_461-width] => 372
[thumb_372_461-height] => 235
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-372x235.jpg
[thumb_372_500-width] => 372
[thumb_372_500-height] => 235
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-385x243.jpg
[thumb_385_270-width] => 385
[thumb_385_270-height] => 243
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-382x241.jpg
[thumb_416_241-width] => 382
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-448x282.jpg
[thumb_448_410-width] => 448
[thumb_448_410-height] => 282
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[thumb_448_410_retina-width] => 736
[thumb_448_410_retina-height] => 464
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-574x362.jpg
[thumb_574_382-width] => 574
[thumb_574_382-height] => 362
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-627x395.jpg
[thumb_776_395-width] => 627
[thumb_776_395-height] => 395
) ) )
T1: Prompt for Reply
Array
(
[0] => Array
(
[ID] => 16350
[id] => 16350
[title] => No_Reply_Prompt-2.jpg
[filename] => No_Reply_Prompt-2.jpg
[filesize] => 0
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[link] => https://www.nextafter.com/experiments/how-prompting-for-a-reply-impacts-email-engagement/attachment/no_reply_prompt-2-jpg/
[alt] =>
[author] => 1
[description] =>
[caption] =>
[name] => no_reply_prompt-2-jpg
[status] => inherit
[uploaded_to] => 16349
[date] => 2021-02-25 11:23:58
[modified] => 2021-02-25 11:23:58
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 744
[height] => 461
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-300x186.jpg
[medium-width] => 300
[medium-height] => 186
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[medium_large-width] => 640
[medium_large-height] => 397
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[large-width] => 640
[large-height] => 397
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[1536x1536-width] => 744
[1536x1536-height] => 461
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[2048x2048-width] => 744
[2048x2048-height] => 461
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-600x461.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 461
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[tp-image-grid-width] => 700
[tp-image-grid-height] => 434
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-50x31.jpg
[admin-width] => 50
[admin-height] => 31
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[full-width] => 744
[full-height] => 461
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-372x231.jpg
[thumb_372-width] => 372
[thumb_372-height] => 231
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[single_post_thumbnail-width] => 744
[single_post_thumbnail-height] => 461
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-32x20.jpg
[thumb_32_32-width] => 32
[thumb_32_32-height] => 20
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-48x30.jpg
[thumb_48_48-width] => 48
[thumb_48_48-height] => 30
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-64x40.jpg
[thumb_64_64-width] => 64
[thumb_64_64-height] => 40
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-128x79.jpg
[thumb_128_128-width] => 128
[thumb_128_128-height] => 79
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-108x67.jpg
[thumb_122_67-width] => 108
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-153x95.jpg
[thumb_153_153-width] => 153
[thumb_153_153-height] => 95
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-130x81.jpg
[thumb_130_163-width] => 130
[thumb_130_163-height] => 81
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-232x144.jpg
[thumb_232_177-width] => 232
[thumb_232_177-height] => 144
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-544x337.jpg
[thumb_272_325-width] => 544
[thumb_272_325-height] => 337
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-271x168.jpg
[thumb_271_346-width] => 271
[thumb_271_346-height] => 168
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-271x168.jpg
[thumb_271_271-width] => 271
[thumb_271_271-height] => 168
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-272x169.jpg
[thumb_272_172-width] => 272
[thumb_272_172-height] => 169
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-372x231.jpg
[thumb_372_461-width] => 372
[thumb_372_461-height] => 231
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-372x231.jpg
[thumb_372_500-width] => 372
[thumb_372_500-height] => 231
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-385x239.jpg
[thumb_385_270-width] => 385
[thumb_385_270-height] => 239
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-389x241.jpg
[thumb_416_241-width] => 389
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-448x278.jpg
[thumb_448_410-width] => 448
[thumb_448_410-height] => 278
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2.jpg
[thumb_448_410_retina-width] => 744
[thumb_448_410_retina-height] => 461
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-574x356.jpg
[thumb_574_382-width] => 574
[thumb_574_382-height] => 356
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/No_Reply_Prompt-2-637x395.jpg
[thumb_776_395-width] => 637
[thumb_776_395-height] => 395
) ) [1] => Array
(
[ID] => 16351
[id] => 16351
[title] => Prompt_for_Reply-2.jpg
[filename] => Prompt_for_Reply-2.jpg
[filesize] => 0
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[link] => https://www.nextafter.com/experiments/how-prompting-for-a-reply-impacts-email-engagement/attachment/prompt_for_reply-2-jpg/
[alt] =>
[author] => 1
[description] =>
[caption] =>
[name] => prompt_for_reply-2-jpg
[status] => inherit
[uploaded_to] => 16349
[date] => 2021-02-25 11:24:02
[modified] => 2021-02-25 11:24:02
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 736
[height] => 464
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-300x189.jpg
[medium-width] => 300
[medium-height] => 189
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[medium_large-width] => 640
[medium_large-height] => 403
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[large-width] => 640
[large-height] => 403
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[1536x1536-width] => 736
[1536x1536-height] => 464
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[2048x2048-width] => 736
[2048x2048-height] => 464
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-600x464.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 464
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[tp-image-grid-width] => 700
[tp-image-grid-height] => 441
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-50x32.jpg
[admin-width] => 50
[admin-height] => 32
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[full-width] => 736
[full-height] => 464
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-372x235.jpg
[thumb_372-width] => 372
[thumb_372-height] => 235
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[single_post_thumbnail-width] => 736
[single_post_thumbnail-height] => 464
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-32x20.jpg
[thumb_32_32-width] => 32
[thumb_32_32-height] => 20
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-48x30.jpg
[thumb_48_48-width] => 48
[thumb_48_48-height] => 30
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-64x40.jpg
[thumb_64_64-width] => 64
[thumb_64_64-height] => 40
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-128x81.jpg
[thumb_128_128-width] => 128
[thumb_128_128-height] => 81
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-106x67.jpg
[thumb_122_67-width] => 106
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-153x96.jpg
[thumb_153_153-width] => 153
[thumb_153_153-height] => 96
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-130x82.jpg
[thumb_130_163-width] => 130
[thumb_130_163-height] => 82
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-232x146.jpg
[thumb_232_177-width] => 232
[thumb_232_177-height] => 146
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-544x343.jpg
[thumb_272_325-width] => 544
[thumb_272_325-height] => 343
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-271x171.jpg
[thumb_271_346-width] => 271
[thumb_271_346-height] => 171
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-271x171.jpg
[thumb_271_271-width] => 271
[thumb_271_271-height] => 171
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-272x172.jpg
[thumb_272_172-width] => 272
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-372x235.jpg
[thumb_372_461-width] => 372
[thumb_372_461-height] => 235
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-372x235.jpg
[thumb_372_500-width] => 372
[thumb_372_500-height] => 235
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-385x243.jpg
[thumb_385_270-width] => 385
[thumb_385_270-height] => 243
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-382x241.jpg
[thumb_416_241-width] => 382
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-448x282.jpg
[thumb_448_410-width] => 448
[thumb_448_410-height] => 282
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2.jpg
[thumb_448_410_retina-width] => 736
[thumb_448_410_retina-height] => 464
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-574x362.jpg
[thumb_574_382-width] => 574
[thumb_574_382-height] => 362
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Prompt_for_Reply-2-627x395.jpg
[thumb_776_395-width] => 627
[thumb_776_395-height] => 395
) ) )
Results
| Treatment Name | Click Rate | Relative Difference | Confidence | |
|---|---|---|---|---|
| C: | No Reply Prompt | 11.5% | ||
| T1: | Prompt for Reply | 11.5% | -0.6% | 10.1% |
This experiment has a required sample size of 1,625,157 in order to be valid. Unfortunately, the required sample size was not met and a level of confidence above 95% was not met so the experiment results are not valid.
Key Learnings
There was no statistically significant measurable difference between the control and treatment version of this experiment. However, one of the more challenging metrics to measure is the actual replies to this email. This would be a higher form of engagement than a click through rate but it is not easily captured.
This will need to be updated once we receive anecdotal evidence from the ADF team on the number of responses.