Dallas Theological Seminary

How elaborating on specific organizational initiatives affects clickthrough rate

Experiment ID: #8095

Dallas Theological Seminary

Experiment Summary

Timeframe: 12/11/2017 - 12/13/2017

Dallas Theological Seminary recently began their calendar year end campaign, focused three pillars: The Call to Teach, The Will to Engage, and The Heart to Go. As they prepared to send an appeal on email focused on the second pillar–The Will to Engage– they wondered if an email that elaborated on the strategic initiatives they’ve created to engage culture would increase the clickthrough rate to the donation page. They created a treatment version and launched an A/B test to find out.

Research Question

Will an email that elaborates on specific organizational initiatives increase clickthrough rate?

Design

C: Control
Array ( [0] => Array ( [ID] => 14454 [id] => 14454 [title] => Email-6-control.png [filename] => Email-6-control.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control.png [link] => https://www.nextafter.com/experiments/how-elaborating-on-specific-organizational-initiatives-affects-clickthrough-rate/attachment/email-6-control-png/ [alt] => [author] => 1 [description] => [caption] => [name] => email-6-control-png [status] => inherit [uploaded_to] => 14453 [date] => 2021-02-25 08:23:08 [modified] => 2021-02-25 08:23:08 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 662 [height] => 894 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-222x300.png [medium-width] => 222 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control.png [medium_large-width] => 640 [medium_large-height] => 864 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control.png [large-width] => 640 [large-height] => 864 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control.png [1536x1536-width] => 662 [1536x1536-height] => 894 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control.png [2048x2048-width] => 662 [2048x2048-height] => 894 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control.png [tp-image-grid-width] => 518 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-37x50.png [admin-width] => 37 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control.png [full-width] => 662 [full-height] => 894 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-372x502.png [thumb_372-width] => 372 [thumb_372-height] => 502 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-463x625.png [single_post_thumbnail-width] => 463 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-24x32.png [thumb_32_32-width] => 24 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-36x48.png [thumb_48_48-width] => 36 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-47x64.png [thumb_64_64-width] => 47 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-95x128.png [thumb_128_128-width] => 95 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-50x67.png [thumb_122_67-width] => 50 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-113x153.png [thumb_153_153-width] => 113 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-121x163.png [thumb_130_163-width] => 121 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-131x177.png [thumb_232_177-width] => 131 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-481x650.png [thumb_272_325-width] => 481 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-256x346.png [thumb_271_346-width] => 256 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-201x271.png [thumb_271_271-width] => 201 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-127x172.png [thumb_272_172-width] => 127 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-341x461.png [thumb_372_461-width] => 341 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-370x500.png [thumb_372_500-width] => 370 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-200x270.png [thumb_385_270-width] => 200 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-178x241.png [thumb_416_241-width] => 178 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-304x410.png [thumb_448_410-width] => 304 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-607x820.png [thumb_448_410_retina-width] => 607 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-283x382.png [thumb_574_382-width] => 283 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-292x395.png [thumb_776_395-width] => 292 [thumb_776_395-height] => 395 ) ) [1] => Array ( [ID] => 14455 [id] => 14455 [title] => Email-6-treatment-1.png [filename] => Email-6-treatment-1.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1.png [link] => https://www.nextafter.com/experiments/how-elaborating-on-specific-organizational-initiatives-affects-clickthrough-rate/attachment/email-6-treatment-1-png/ [alt] => [author] => 1 [description] => [caption] => [name] => email-6-treatment-1-png [status] => inherit [uploaded_to] => 14453 [date] => 2021-02-25 08:23:15 [modified] => 2021-02-25 08:23:15 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 667 [height] => 1265 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-158x300.png [medium-width] => 158 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1.png [medium_large-width] => 640 [medium_large-height] => 1214 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-540x1024.png [large-width] => 540 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1.png [1536x1536-width] => 667 [1536x1536-height] => 1265 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1.png [2048x2048-width] => 667 [2048x2048-height] => 1265 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1.png [tp-image-grid-width] => 369 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-26x50.png [admin-width] => 26 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1.png [full-width] => 667 [full-height] => 1265 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-372x706.png [thumb_372-width] => 372 [thumb_372-height] => 706 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-330x625.png [single_post_thumbnail-width] => 330 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-17x32.png [thumb_32_32-width] => 17 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-25x48.png [thumb_48_48-width] => 25 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-34x64.png [thumb_64_64-width] => 34 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-67x128.png [thumb_128_128-width] => 67 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-35x67.png [thumb_122_67-width] => 35 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-81x153.png [thumb_153_153-width] => 81 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-86x163.png [thumb_130_163-width] => 86 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-93x177.png [thumb_232_177-width] => 93 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-343x650.png [thumb_272_325-width] => 343 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-182x346.png [thumb_271_346-width] => 182 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-143x271.png [thumb_271_271-width] => 143 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-91x172.png [thumb_272_172-width] => 91 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-243x461.png [thumb_372_461-width] => 243 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-264x500.png [thumb_372_500-width] => 264 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-142x270.png [thumb_385_270-width] => 142 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-127x241.png [thumb_416_241-width] => 127 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-216x410.png [thumb_448_410-width] => 216 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-432x820.png [thumb_448_410_retina-width] => 432 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-201x382.png [thumb_574_382-width] => 201 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-208x395.png [thumb_776_395-width] => 208 [thumb_776_395-height] => 395 ) ) )
T1: Treatment 1
Array ( [0] => Array ( [ID] => 14454 [id] => 14454 [title] => Email-6-control.png [filename] => Email-6-control.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control.png [link] => https://www.nextafter.com/experiments/how-elaborating-on-specific-organizational-initiatives-affects-clickthrough-rate/attachment/email-6-control-png/ [alt] => [author] => 1 [description] => [caption] => [name] => email-6-control-png [status] => inherit [uploaded_to] => 14453 [date] => 2021-02-25 08:23:08 [modified] => 2021-02-25 08:23:08 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 662 [height] => 894 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-222x300.png [medium-width] => 222 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control.png [medium_large-width] => 640 [medium_large-height] => 864 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control.png [large-width] => 640 [large-height] => 864 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control.png [1536x1536-width] => 662 [1536x1536-height] => 894 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control.png [2048x2048-width] => 662 [2048x2048-height] => 894 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control.png [tp-image-grid-width] => 518 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-37x50.png [admin-width] => 37 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control.png [full-width] => 662 [full-height] => 894 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-372x502.png [thumb_372-width] => 372 [thumb_372-height] => 502 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-463x625.png [single_post_thumbnail-width] => 463 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-24x32.png [thumb_32_32-width] => 24 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-36x48.png [thumb_48_48-width] => 36 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-47x64.png [thumb_64_64-width] => 47 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-95x128.png [thumb_128_128-width] => 95 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-50x67.png [thumb_122_67-width] => 50 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-113x153.png [thumb_153_153-width] => 113 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-121x163.png [thumb_130_163-width] => 121 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-131x177.png [thumb_232_177-width] => 131 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-481x650.png [thumb_272_325-width] => 481 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-256x346.png [thumb_271_346-width] => 256 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-201x271.png [thumb_271_271-width] => 201 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-127x172.png [thumb_272_172-width] => 127 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-341x461.png [thumb_372_461-width] => 341 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-370x500.png [thumb_372_500-width] => 370 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-200x270.png [thumb_385_270-width] => 200 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-178x241.png [thumb_416_241-width] => 178 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-304x410.png [thumb_448_410-width] => 304 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-607x820.png [thumb_448_410_retina-width] => 607 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-283x382.png [thumb_574_382-width] => 283 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-control-292x395.png [thumb_776_395-width] => 292 [thumb_776_395-height] => 395 ) ) [1] => Array ( [ID] => 14455 [id] => 14455 [title] => Email-6-treatment-1.png [filename] => Email-6-treatment-1.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1.png [link] => https://www.nextafter.com/experiments/how-elaborating-on-specific-organizational-initiatives-affects-clickthrough-rate/attachment/email-6-treatment-1-png/ [alt] => [author] => 1 [description] => [caption] => [name] => email-6-treatment-1-png [status] => inherit [uploaded_to] => 14453 [date] => 2021-02-25 08:23:15 [modified] => 2021-02-25 08:23:15 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 667 [height] => 1265 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-158x300.png [medium-width] => 158 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1.png [medium_large-width] => 640 [medium_large-height] => 1214 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-540x1024.png [large-width] => 540 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1.png [1536x1536-width] => 667 [1536x1536-height] => 1265 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1.png [2048x2048-width] => 667 [2048x2048-height] => 1265 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1.png [tp-image-grid-width] => 369 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-26x50.png [admin-width] => 26 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1.png [full-width] => 667 [full-height] => 1265 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-372x706.png [thumb_372-width] => 372 [thumb_372-height] => 706 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-330x625.png [single_post_thumbnail-width] => 330 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-17x32.png [thumb_32_32-width] => 17 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-25x48.png [thumb_48_48-width] => 25 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-34x64.png [thumb_64_64-width] => 34 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-67x128.png [thumb_128_128-width] => 67 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-35x67.png [thumb_122_67-width] => 35 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-81x153.png [thumb_153_153-width] => 81 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-86x163.png [thumb_130_163-width] => 86 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-93x177.png [thumb_232_177-width] => 93 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-343x650.png [thumb_272_325-width] => 343 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-182x346.png [thumb_271_346-width] => 182 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-143x271.png [thumb_271_271-width] => 143 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-91x172.png [thumb_272_172-width] => 91 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-243x461.png [thumb_372_461-width] => 243 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-264x500.png [thumb_372_500-width] => 264 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-142x270.png [thumb_385_270-width] => 142 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-127x241.png [thumb_416_241-width] => 127 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-216x410.png [thumb_448_410-width] => 216 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-432x820.png [thumb_448_410_retina-width] => 432 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-201x382.png [thumb_574_382-width] => 201 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Email-6-treatment-1-208x395.png [thumb_776_395-width] => 208 [thumb_776_395-height] => 395 ) ) )

Results

 Treatment NameClick RateRelative DifferenceConfidence
C: Control 0.29%
T1: Treatment 1 1.1%276.7% 100.0%

This experiment has a required sample size of 792 in order to be valid. Since the experiment had a total sample size of 21,066, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    276.7% increase in traffic
× 0% increase in conversion rate
× 0% increase in average gift

Key Learnings

They found that the treatment version did increase clickthrough rate by 276%. It’s clear the treatment version significantly increased recipient motivation, but why? There a few important elements worth analyzing in the second email. First, the introduction of the treatment version takes a more personal approach to the topic of cultural engagement. It highlights Dr. Bailey’s daily schedule of leaving his office and driving through the city of Dallas. This simple change immediately draws the reader into Dr. Bailey’s point of view and shows why this initiative is personal to him. Humans are storytellers. We love to have a concrete image to hold in our mind’s eye.

Second, the treatment version elaborates on three specific ways Dallas Theological Seminary is addressing culture and empowering individuals outside of the seminary walls. By describing at length these three initiatives–The Table Podcast, the Faith and Work Initiative, and a plethora of free online courses–DTS is reminding their audience where their financial support goes. It’s also important to note the subtle difference in the call-to-action. Instead of clicking to ‘make a secure donation’ this treatment email invites individuals to ‘invest in these initiatives.’ This is an approach that Dallas Theological Seminary will continue to work into the rest of their calendar year end campaign.


Experiment Documented by NextAfter

Question about experiment #8095

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.