Texas State Historical Association

How a change to the donation page headline affects conversion

Experiment ID: #2302

Texas State Historical Association

Experiment Summary

Timeframe: 10/12/2015 - 10/19/2015

As part of their latest email acquisition campaign, the Texas State Historical Association created an instant donor conversion page after a visitor’s email address had been acquired. This page began by thanking the visitor for giving their email address and then launched into a pitch for the visitor to become a member.

Sometimes the smallest changes to a page can have the biggest impact. The first element on the conversion page is the headline. If this headline does not arrest the visitor’s attention or does not address why they are there, many visitors will not make it past this element on the screen. In an attempt to increase the number of donors acquired, we decided to create a new treatment that would more closely align the headline with what we believed to be the ideal value proposition for the page.

Research Question

Which headline treatment will result in the greatest number of donors and revenue?

Design

C: "Join the TSHA" Headline
Array ( [0] => Array ( [ID] => 12157 [id] => 12157 [title] => C1-10.png [filename] => C1-10.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10.png [link] => https://www.nextafter.com/experiments/how-a-change-to-the-donation-page-headline-affects-conversion/attachment/c1-10-png/ [alt] => [author] => 7 [description] => [caption] => [name] => c1-10-png [status] => inherit [uploaded_to] => 12156 [date] => 2021-02-24 20:27:17 [modified] => 2021-02-24 20:27:17 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 1173 [height] => 3399 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-104x300.png [medium-width] => 104 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-768x2225.png [medium_large-width] => 640 [medium_large-height] => 1854 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-353x1024.png [large-width] => 353 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-530x1536.png [1536x1536-width] => 530 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-707x2048.png [2048x2048-width] => 707 [2048x2048-height] => 2048 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10.png [tp-image-grid-width] => 242 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-17x50.png [admin-width] => 17 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10.png [full-width] => 1173 [full-height] => 3399 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-372x1078.png [thumb_372-width] => 372 [thumb_372-height] => 1078 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-216x625.png [single_post_thumbnail-width] => 216 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-11x32.png [thumb_32_32-width] => 11 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-17x48.png [thumb_48_48-width] => 17 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-22x64.png [thumb_64_64-width] => 22 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-44x128.png [thumb_128_128-width] => 44 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-23x67.png [thumb_122_67-width] => 23 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-53x153.png [thumb_153_153-width] => 53 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-56x163.png [thumb_130_163-width] => 56 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-61x177.png [thumb_232_177-width] => 61 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-224x650.png [thumb_272_325-width] => 224 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-119x346.png [thumb_271_346-width] => 119 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-94x271.png [thumb_271_271-width] => 94 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-59x172.png [thumb_272_172-width] => 59 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-159x461.png [thumb_372_461-width] => 159 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-173x500.png [thumb_372_500-width] => 173 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-93x270.png [thumb_385_270-width] => 93 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-83x241.png [thumb_416_241-width] => 83 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-141x410.png [thumb_448_410-width] => 141 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-283x820.png [thumb_448_410_retina-width] => 283 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-132x382.png [thumb_574_382-width] => 132 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-136x395.png [thumb_776_395-width] => 136 [thumb_776_395-height] => 395 ) ) [1] => Array ( [ID] => 12158 [id] => 12158 [title] => T1-8.png [filename] => T1-8.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8.png [link] => https://www.nextafter.com/experiments/how-a-change-to-the-donation-page-headline-affects-conversion/attachment/t1-8-png/ [alt] => [author] => 7 [description] => [caption] => [name] => t1-8-png [status] => inherit [uploaded_to] => 12156 [date] => 2021-02-24 20:27:31 [modified] => 2021-02-24 20:27:31 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 1173 [height] => 3346 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-105x300.png [medium-width] => 105 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-768x2191.png [medium_large-width] => 640 [medium_large-height] => 1826 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-359x1024.png [large-width] => 359 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-538x1536.png [1536x1536-width] => 538 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-718x2048.png [2048x2048-width] => 718 [2048x2048-height] => 2048 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8.png [tp-image-grid-width] => 245 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-18x50.png [admin-width] => 18 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8.png [full-width] => 1173 [full-height] => 3346 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-372x1061.png [thumb_372-width] => 372 [thumb_372-height] => 1061 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-219x625.png [single_post_thumbnail-width] => 219 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-11x32.png [thumb_32_32-width] => 11 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-17x48.png [thumb_48_48-width] => 17 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-22x64.png [thumb_64_64-width] => 22 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-45x128.png [thumb_128_128-width] => 45 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-23x67.png [thumb_122_67-width] => 23 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-54x153.png [thumb_153_153-width] => 54 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-57x163.png [thumb_130_163-width] => 57 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-62x177.png [thumb_232_177-width] => 62 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-228x650.png [thumb_272_325-width] => 228 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-121x346.png [thumb_271_346-width] => 121 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-95x271.png [thumb_271_271-width] => 95 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-60x172.png [thumb_272_172-width] => 60 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-162x461.png [thumb_372_461-width] => 162 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-175x500.png [thumb_372_500-width] => 175 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-95x270.png [thumb_385_270-width] => 95 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-84x241.png [thumb_416_241-width] => 84 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-144x410.png [thumb_448_410-width] => 144 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-287x820.png [thumb_448_410_retina-width] => 287 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-134x382.png [thumb_574_382-width] => 134 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-138x395.png [thumb_776_395-width] => 138 [thumb_776_395-height] => 395 ) ) )
T1: "Get Insider Access" Headline
Array ( [0] => Array ( [ID] => 12157 [id] => 12157 [title] => C1-10.png [filename] => C1-10.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10.png [link] => https://www.nextafter.com/experiments/how-a-change-to-the-donation-page-headline-affects-conversion/attachment/c1-10-png/ [alt] => [author] => 7 [description] => [caption] => [name] => c1-10-png [status] => inherit [uploaded_to] => 12156 [date] => 2021-02-24 20:27:17 [modified] => 2021-02-24 20:27:17 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 1173 [height] => 3399 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-104x300.png [medium-width] => 104 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-768x2225.png [medium_large-width] => 640 [medium_large-height] => 1854 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-353x1024.png [large-width] => 353 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-530x1536.png [1536x1536-width] => 530 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-707x2048.png [2048x2048-width] => 707 [2048x2048-height] => 2048 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10.png [tp-image-grid-width] => 242 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-17x50.png [admin-width] => 17 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10.png [full-width] => 1173 [full-height] => 3399 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-372x1078.png [thumb_372-width] => 372 [thumb_372-height] => 1078 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-216x625.png [single_post_thumbnail-width] => 216 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-11x32.png [thumb_32_32-width] => 11 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-17x48.png [thumb_48_48-width] => 17 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-22x64.png [thumb_64_64-width] => 22 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-44x128.png [thumb_128_128-width] => 44 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-23x67.png [thumb_122_67-width] => 23 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-53x153.png [thumb_153_153-width] => 53 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-56x163.png [thumb_130_163-width] => 56 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-61x177.png [thumb_232_177-width] => 61 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-224x650.png [thumb_272_325-width] => 224 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-119x346.png [thumb_271_346-width] => 119 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-94x271.png [thumb_271_271-width] => 94 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-59x172.png [thumb_272_172-width] => 59 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-159x461.png [thumb_372_461-width] => 159 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-173x500.png [thumb_372_500-width] => 173 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-93x270.png [thumb_385_270-width] => 93 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-83x241.png [thumb_416_241-width] => 83 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-141x410.png [thumb_448_410-width] => 141 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-283x820.png [thumb_448_410_retina-width] => 283 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-132x382.png [thumb_574_382-width] => 132 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/C1-10-136x395.png [thumb_776_395-width] => 136 [thumb_776_395-height] => 395 ) ) [1] => Array ( [ID] => 12158 [id] => 12158 [title] => T1-8.png [filename] => T1-8.png [filesize] => 0 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8.png [link] => https://www.nextafter.com/experiments/how-a-change-to-the-donation-page-headline-affects-conversion/attachment/t1-8-png/ [alt] => [author] => 7 [description] => [caption] => [name] => t1-8-png [status] => inherit [uploaded_to] => 12156 [date] => 2021-02-24 20:27:31 [modified] => 2021-02-24 20:27:31 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 1173 [height] => 3346 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-105x300.png [medium-width] => 105 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-768x2191.png [medium_large-width] => 640 [medium_large-height] => 1826 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-359x1024.png [large-width] => 359 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-538x1536.png [1536x1536-width] => 538 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-718x2048.png [2048x2048-width] => 718 [2048x2048-height] => 2048 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8.png [tp-image-grid-width] => 245 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-18x50.png [admin-width] => 18 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8.png [full-width] => 1173 [full-height] => 3346 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-372x1061.png [thumb_372-width] => 372 [thumb_372-height] => 1061 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-219x625.png [single_post_thumbnail-width] => 219 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-11x32.png [thumb_32_32-width] => 11 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-17x48.png [thumb_48_48-width] => 17 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-22x64.png [thumb_64_64-width] => 22 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-45x128.png [thumb_128_128-width] => 45 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-23x67.png [thumb_122_67-width] => 23 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-54x153.png [thumb_153_153-width] => 54 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-57x163.png [thumb_130_163-width] => 57 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-62x177.png [thumb_232_177-width] => 62 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-228x650.png [thumb_272_325-width] => 228 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-121x346.png [thumb_271_346-width] => 121 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-95x271.png [thumb_271_271-width] => 95 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-60x172.png [thumb_272_172-width] => 60 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-162x461.png [thumb_372_461-width] => 162 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-175x500.png [thumb_372_500-width] => 175 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-95x270.png [thumb_385_270-width] => 95 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-84x241.png [thumb_416_241-width] => 84 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-144x410.png [thumb_448_410-width] => 144 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-287x820.png [thumb_448_410_retina-width] => 287 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-134x382.png [thumb_574_382-width] => 134 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1-8-138x395.png [thumb_776_395-width] => 138 [thumb_776_395-height] => 395 ) ) )

Results

 Treatment NameConv. RateRelative DifferenceConfidence
C: "Join the TSHA" Headline 2.5%
T1: "Get Insider Access" Headline 0.89%-65.0% 96.1%

This experiment has a required sample size of 463 in order to be valid. Since the experiment had a total sample size of 1,070, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 65.0% decrease in conversion rate
× 20.0% increase in average gift
58.0% decrease in revenue

Key Learnings

The resulting treatment resulted in a 62% decrease in the number of donors acquired. The new headline, “Get insider access to the most exclusive Texas History Club in the Nation,”  was framed around what the visitor would get when they join. However, what we added in value, we lost in clarity.

The original headline “Do you love Texas history? Join the Texas State Historical Association today!” more clearly stated the purpose of the page. The initial statement also allowed the visitors the self-select whether the page was right for them based upon their love for Texas history.  These factors created an experience that proved to be more successful at converting visitors to members.


Experiment Documented by Tim Kachuriak
Tim Kachuriak is Chief Innovation and Optimization Officer of NextAfter.

Question about experiment #2302

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.