Compassion International

How increasing the force of the value proposition and increasing relevancy affects donor conversion

Experiment ID: #11777

Compassion International

Experiment Summary

Timeframe: 12/05/2017 - 01/02/2018

Compassion International placed a large advertising buy with BibleGateway and received millions of impressions per month. They sought to boost conversion from this display buy. The advertisement (see it here) asked if the viewer shared a birthday with a child in poverty, and let them select their birthday. The user was then placed on a Compassion landing page with the headline “Sponsor a Child Today”. Below that headline was a small-font subheadline that showed that the results were children who matched the selected birthday. From then on, it followed their standard grid design showing many children who shared that day.

They had developed a page designed to do four things:

  1. Reduce page exits. The new page removed the top navigation.
  2. Increase the force of the value proposition. Rather than “sponsor a child today”, the new page asked the user to “Give a child the best birthday ever—a new sponsor!” with confetti and streamers.
  3. Increase relevancy between the ad and the landing page. The new page was birthday-relevant both in design and copy, clarifying the connection between the ad action (selecting a birthday) and the next step (selecting a child who shares that birthday).
  4. Reduce decision friction. Instead of row after row of equally-weighted children, the new page selected one child and featured them at the top, before offering other options below.

They launched an A/B test that sent an equal amount of traffic to each page to determine a winner.

Research Question

How will increasing the relevancy between advertisement and landing page, as well as increasing the force of the value proposition affect donor conversion?

Design

C: Control
Array ( [0] => Array ( [ID] => 45551 [id] => 45551 [title] => Control.jpg [filename] => Control-2203.jpg [filesize] => 309012 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203.jpg [link] => https://www.nextafter.com/experiments/how-increasing-the-force-of-the-value-proposition-and-increasing-relevancy-affects-donor-conversion/attachment/control-jpg-2608/ [alt] => [author] => 0 [description] => [caption] => [name] => control-jpg-2608 [status] => inherit [uploaded_to] => 14529 [date] => 2022-11-01 18:54:18 [modified] => 2022-11-01 18:54:18 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 864 [height] => 1400 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-185x300.jpg [medium-width] => 185 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-768x1244.jpg [medium_large-width] => 640 [medium_large-height] => 1037 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-632x1024.jpg [large-width] => 632 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203.jpg [1536x1536-width] => 864 [1536x1536-height] => 1400 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203.jpg [2048x2048-width] => 864 [2048x2048-height] => 1400 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-600x400.jpg [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-600x600.jpg [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203.jpg [tp-image-grid-width] => 432 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-31x50.jpg [admin-width] => 31 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203.jpg [full-width] => 864 [full-height] => 1400 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-372x603.jpg [thumb_372-width] => 372 [thumb_372-height] => 603 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-386x625.jpg [single_post_thumbnail-width] => 386 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-20x32.jpg [thumb_32_32-width] => 20 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-30x48.jpg [thumb_48_48-width] => 30 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-39x64.jpg [thumb_64_64-width] => 39 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-79x128.jpg [thumb_128_128-width] => 79 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-41x67.jpg [thumb_122_67-width] => 41 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-94x153.jpg [thumb_153_153-width] => 94 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-101x163.jpg [thumb_130_163-width] => 101 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-109x177.jpg [thumb_232_177-width] => 109 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-401x650.jpg [thumb_272_325-width] => 401 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-214x346.jpg [thumb_271_346-width] => 214 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-167x271.jpg [thumb_271_271-width] => 167 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-106x172.jpg [thumb_272_172-width] => 106 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-285x461.jpg [thumb_372_461-width] => 285 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-309x500.jpg [thumb_372_500-width] => 309 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-167x270.jpg [thumb_385_270-width] => 167 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-149x241.jpg [thumb_416_241-width] => 149 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-253x410.jpg [thumb_448_410-width] => 253 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-506x820.jpg [thumb_448_410_retina-width] => 506 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-236x382.jpg [thumb_574_382-width] => 236 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-244x395.jpg [thumb_776_395-width] => 244 [thumb_776_395-height] => 395 ) ) [1] => Array ( [ID] => 45552 [id] => 45552 [title] => Treatment_1.jpg [filename] => Treatment_1-968.jpg [filesize] => 242101 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968.jpg [link] => https://www.nextafter.com/experiments/how-increasing-the-force-of-the-value-proposition-and-increasing-relevancy-affects-donor-conversion/attachment/treatment_1-jpg-1153/ [alt] => [author] => 0 [description] => [caption] => [name] => treatment_1-jpg-1153 [status] => inherit [uploaded_to] => 14529 [date] => 2022-11-01 18:54:54 [modified] => 2022-11-01 18:54:54 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 650 [height] => 1400 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-139x300.jpg [medium-width] => 139 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968.jpg [medium_large-width] => 640 [medium_large-height] => 1378 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-475x1024.jpg [large-width] => 475 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968.jpg [1536x1536-width] => 650 [1536x1536-height] => 1400 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968.jpg [2048x2048-width] => 650 [2048x2048-height] => 1400 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-600x400.jpg [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-600x600.jpg [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968.jpg [tp-image-grid-width] => 325 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-23x50.jpg [admin-width] => 23 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968.jpg [full-width] => 650 [full-height] => 1400 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-372x801.jpg [thumb_372-width] => 372 [thumb_372-height] => 801 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-290x625.jpg [single_post_thumbnail-width] => 290 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-15x32.jpg [thumb_32_32-width] => 15 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-22x48.jpg [thumb_48_48-width] => 22 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-30x64.jpg [thumb_64_64-width] => 30 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-59x128.jpg [thumb_128_128-width] => 59 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-31x67.jpg [thumb_122_67-width] => 31 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-71x153.jpg [thumb_153_153-width] => 71 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-76x163.jpg [thumb_130_163-width] => 76 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-82x177.jpg [thumb_232_177-width] => 82 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-302x650.jpg [thumb_272_325-width] => 302 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-161x346.jpg [thumb_271_346-width] => 161 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-126x271.jpg [thumb_271_271-width] => 126 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-80x172.jpg [thumb_272_172-width] => 80 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-214x461.jpg [thumb_372_461-width] => 214 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-232x500.jpg [thumb_372_500-width] => 232 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-125x270.jpg [thumb_385_270-width] => 125 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-112x241.jpg [thumb_416_241-width] => 112 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-190x410.jpg [thumb_448_410-width] => 190 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-381x820.jpg [thumb_448_410_retina-width] => 381 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-177x382.jpg [thumb_574_382-width] => 177 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-183x395.jpg [thumb_776_395-width] => 183 [thumb_776_395-height] => 395 ) ) )
T1: Treatment 1
Array ( [0] => Array ( [ID] => 45551 [id] => 45551 [title] => Control.jpg [filename] => Control-2203.jpg [filesize] => 309012 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203.jpg [link] => https://www.nextafter.com/experiments/how-increasing-the-force-of-the-value-proposition-and-increasing-relevancy-affects-donor-conversion/attachment/control-jpg-2608/ [alt] => [author] => 0 [description] => [caption] => [name] => control-jpg-2608 [status] => inherit [uploaded_to] => 14529 [date] => 2022-11-01 18:54:18 [modified] => 2022-11-01 18:54:18 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 864 [height] => 1400 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-185x300.jpg [medium-width] => 185 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-768x1244.jpg [medium_large-width] => 640 [medium_large-height] => 1037 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-632x1024.jpg [large-width] => 632 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203.jpg [1536x1536-width] => 864 [1536x1536-height] => 1400 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203.jpg [2048x2048-width] => 864 [2048x2048-height] => 1400 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-600x400.jpg [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-600x600.jpg [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203.jpg [tp-image-grid-width] => 432 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-31x50.jpg [admin-width] => 31 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203.jpg [full-width] => 864 [full-height] => 1400 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-372x603.jpg [thumb_372-width] => 372 [thumb_372-height] => 603 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-386x625.jpg [single_post_thumbnail-width] => 386 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-20x32.jpg [thumb_32_32-width] => 20 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-30x48.jpg [thumb_48_48-width] => 30 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-39x64.jpg [thumb_64_64-width] => 39 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-79x128.jpg [thumb_128_128-width] => 79 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-41x67.jpg [thumb_122_67-width] => 41 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-94x153.jpg [thumb_153_153-width] => 94 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-101x163.jpg [thumb_130_163-width] => 101 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-109x177.jpg [thumb_232_177-width] => 109 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-401x650.jpg [thumb_272_325-width] => 401 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-214x346.jpg [thumb_271_346-width] => 214 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-167x271.jpg [thumb_271_271-width] => 167 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-106x172.jpg [thumb_272_172-width] => 106 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-285x461.jpg [thumb_372_461-width] => 285 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-309x500.jpg [thumb_372_500-width] => 309 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-167x270.jpg [thumb_385_270-width] => 167 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-149x241.jpg [thumb_416_241-width] => 149 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-253x410.jpg [thumb_448_410-width] => 253 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-506x820.jpg [thumb_448_410_retina-width] => 506 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-236x382.jpg [thumb_574_382-width] => 236 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2203-244x395.jpg [thumb_776_395-width] => 244 [thumb_776_395-height] => 395 ) ) [1] => Array ( [ID] => 45552 [id] => 45552 [title] => Treatment_1.jpg [filename] => Treatment_1-968.jpg [filesize] => 242101 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968.jpg [link] => https://www.nextafter.com/experiments/how-increasing-the-force-of-the-value-proposition-and-increasing-relevancy-affects-donor-conversion/attachment/treatment_1-jpg-1153/ [alt] => [author] => 0 [description] => [caption] => [name] => treatment_1-jpg-1153 [status] => inherit [uploaded_to] => 14529 [date] => 2022-11-01 18:54:54 [modified] => 2022-11-01 18:54:54 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 650 [height] => 1400 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-139x300.jpg [medium-width] => 139 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968.jpg [medium_large-width] => 640 [medium_large-height] => 1378 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-475x1024.jpg [large-width] => 475 [large-height] => 1024 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968.jpg [1536x1536-width] => 650 [1536x1536-height] => 1400 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968.jpg [2048x2048-width] => 650 [2048x2048-height] => 1400 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-600x400.jpg [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-600x600.jpg [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968.jpg [tp-image-grid-width] => 325 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-23x50.jpg [admin-width] => 23 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968.jpg [full-width] => 650 [full-height] => 1400 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-372x801.jpg [thumb_372-width] => 372 [thumb_372-height] => 801 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-290x625.jpg [single_post_thumbnail-width] => 290 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-15x32.jpg [thumb_32_32-width] => 15 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-22x48.jpg [thumb_48_48-width] => 22 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-30x64.jpg [thumb_64_64-width] => 30 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-59x128.jpg [thumb_128_128-width] => 59 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-31x67.jpg [thumb_122_67-width] => 31 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-71x153.jpg [thumb_153_153-width] => 71 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-76x163.jpg [thumb_130_163-width] => 76 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-82x177.jpg [thumb_232_177-width] => 82 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-302x650.jpg [thumb_272_325-width] => 302 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-161x346.jpg [thumb_271_346-width] => 161 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-126x271.jpg [thumb_271_271-width] => 126 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-80x172.jpg [thumb_272_172-width] => 80 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-214x461.jpg [thumb_372_461-width] => 214 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-232x500.jpg [thumb_372_500-width] => 232 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-125x270.jpg [thumb_385_270-width] => 125 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-112x241.jpg [thumb_416_241-width] => 112 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-190x410.jpg [thumb_448_410-width] => 190 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-381x820.jpg [thumb_448_410_retina-width] => 381 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-177x382.jpg [thumb_574_382-width] => 177 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-968-183x395.jpg [thumb_776_395-width] => 183 [thumb_776_395-height] => 395 ) ) )

Results

 Treatment NameConv. RateRelative DifferenceConfidence
C: Control 0.00%
T1: Treatment 1 0.00%214.4% 99.5%

This experiment has a required sample size of 2,323,157 in order to be valid. Since the experiment had a total sample size of 9,389,966, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 214.4% increase in conversion rate
× 0% increase in average gift

Key Learnings

The treatment page produced a 214% lift in conversion—showing that multiple factors (a radical redesign) were able to increase the connection between ad and landing page, keep more people on the page, convince more people to give, and simplify the decision process.

While we don’t know the specific contribution of each of these tested elements, we have a significant lift in conversion (and subsequent lift in revenue). This test immediately prompts a similar test on the in-site birthday selector to see if it produces similar results there (where there is much more traffic).


Experiment Documented by Jeff Giddens
Jeff Giddens is President of NextAfter.

Question about experiment #11777

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.