Hillsdale College

How personalization and brand reduction affect conversion on a post-survey donation page

Experiment ID: #35799

Hillsdale College

Experiment Summary

Timeframe: 09/14/2020 - 10/17/2020

Hillsdale College had run an experiment during the pre-launch of their Introduction to Western Philosophy course that tested two variables independently. First, they tested using personalization in the headline of the “instant” donation page to increase the buy-in of the registrant and get them reading the page. Secondly, they noticed that the donation page had many mentions of Hillsdale College, which seemed redundant and seemed to get the brand “in the way” of the relationship that the copy was attempting to develop with the donor. They tested a separate treatment that did NOT include the personalization but did reduce the mentions of the brand, substituting pronouns where appropriate. These two treatments both appeared to lift revenue, 19% and 13% respectively. They wanted to re-test this, and combine the elements into one treatment. They chose their Electoral College Survey, developed the treatment, and launched a test. 

Research Question

How will personalization and brand reduction affect conversion on a post-survey donation page?

Design

C: Control
Array ( [0] => Array ( [ID] => 44334 [id] => 44334 [title] => Control.jpg [filename] => Control-2068.jpg [filesize] => 439934 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068.jpg [link] => https://www.nextafter.com/experiments/how-personalization-and-brand-reduction-affect-conversion-on-a-post-survey-donation-page/attachment/control-jpg-2423/ [alt] => [author] => 0 [description] => [caption] => [name] => control-jpg-2423 [status] => inherit [uploaded_to] => 17415 [date] => 2022-10-31 20:35:03 [modified] => 2022-10-31 20:35:03 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 1124 [height] => 1600 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-211x300.jpg [medium-width] => 211 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-768x1093.jpg [medium_large-width] => 640 [medium_large-height] => 911 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-719x1024.jpg [large-width] => 640 [large-height] => 911 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-1079x1536.jpg [1536x1536-width] => 1079 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068.jpg [2048x2048-width] => 1124 [2048x2048-height] => 1600 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-600x400.jpg [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-600x600.jpg [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068.jpg [tp-image-grid-width] => 492 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-35x50.jpg [admin-width] => 35 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068.jpg [full-width] => 1124 [full-height] => 1600 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-372x530.jpg [thumb_372-width] => 372 [thumb_372-height] => 530 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-439x625.jpg [single_post_thumbnail-width] => 439 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-22x32.jpg [thumb_32_32-width] => 22 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-34x48.jpg [thumb_48_48-width] => 34 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-45x64.jpg [thumb_64_64-width] => 45 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-90x128.jpg [thumb_128_128-width] => 90 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-47x67.jpg [thumb_122_67-width] => 47 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-107x153.jpg [thumb_153_153-width] => 107 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-115x163.jpg [thumb_130_163-width] => 115 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-124x177.jpg [thumb_232_177-width] => 124 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-457x650.jpg [thumb_272_325-width] => 457 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-243x346.jpg [thumb_271_346-width] => 243 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-190x271.jpg [thumb_271_271-width] => 190 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-121x172.jpg [thumb_272_172-width] => 121 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-324x461.jpg [thumb_372_461-width] => 324 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-351x500.jpg [thumb_372_500-width] => 351 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-190x270.jpg [thumb_385_270-width] => 190 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-169x241.jpg [thumb_416_241-width] => 169 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-288x410.jpg [thumb_448_410-width] => 288 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-576x820.jpg [thumb_448_410_retina-width] => 576 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-268x382.jpg [thumb_574_382-width] => 268 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-277x395.jpg [thumb_776_395-width] => 277 [thumb_776_395-height] => 395 ) ) [1] => Array ( [ID] => 44340 [id] => 44340 [title] => T1_-_Reduced_Brand_with_Personalization.jpg [filename] => T1_-_Reduced_Brand_with_Personalization-7.jpg [filesize] => 411055 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7.jpg [link] => https://www.nextafter.com/experiments/how-personalization-and-brand-reduction-affect-conversion-on-a-post-survey-donation-page/attachment/t1_-_reduced_brand_with_personalization-jpg-11/ [alt] => [author] => 0 [description] => [caption] => [name] => t1_-_reduced_brand_with_personalization-jpg-11 [status] => inherit [uploaded_to] => 17415 [date] => 2022-10-31 20:35:30 [modified] => 2022-10-31 20:35:30 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 1114 [height] => 1598 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-209x300.jpg [medium-width] => 209 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-768x1102.jpg [medium_large-width] => 640 [medium_large-height] => 918 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-714x1024.jpg [large-width] => 640 [large-height] => 918 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-1071x1536.jpg [1536x1536-width] => 1071 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7.jpg [2048x2048-width] => 1114 [2048x2048-height] => 1598 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-600x400.jpg [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-600x600.jpg [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7.jpg [tp-image-grid-width] => 488 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-35x50.jpg [admin-width] => 35 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7.jpg [full-width] => 1114 [full-height] => 1598 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-372x534.jpg [thumb_372-width] => 372 [thumb_372-height] => 534 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-436x625.jpg [single_post_thumbnail-width] => 436 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-22x32.jpg [thumb_32_32-width] => 22 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-33x48.jpg [thumb_48_48-width] => 33 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-45x64.jpg [thumb_64_64-width] => 45 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-89x128.jpg [thumb_128_128-width] => 89 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-47x67.jpg [thumb_122_67-width] => 47 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-107x153.jpg [thumb_153_153-width] => 107 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-114x163.jpg [thumb_130_163-width] => 114 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-123x177.jpg [thumb_232_177-width] => 123 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-453x650.jpg [thumb_272_325-width] => 453 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-241x346.jpg [thumb_271_346-width] => 241 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-189x271.jpg [thumb_271_271-width] => 189 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-120x172.jpg [thumb_272_172-width] => 120 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-321x461.jpg [thumb_372_461-width] => 321 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-349x500.jpg [thumb_372_500-width] => 349 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-188x270.jpg [thumb_385_270-width] => 188 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-168x241.jpg [thumb_416_241-width] => 168 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-286x410.jpg [thumb_448_410-width] => 286 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-572x820.jpg [thumb_448_410_retina-width] => 572 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-266x382.jpg [thumb_574_382-width] => 266 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-275x395.jpg [thumb_776_395-width] => 275 [thumb_776_395-height] => 395 ) ) )
T1: T1 - Reduced Brand with Personalization
Array ( [0] => Array ( [ID] => 44334 [id] => 44334 [title] => Control.jpg [filename] => Control-2068.jpg [filesize] => 439934 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068.jpg [link] => https://www.nextafter.com/experiments/how-personalization-and-brand-reduction-affect-conversion-on-a-post-survey-donation-page/attachment/control-jpg-2423/ [alt] => [author] => 0 [description] => [caption] => [name] => control-jpg-2423 [status] => inherit [uploaded_to] => 17415 [date] => 2022-10-31 20:35:03 [modified] => 2022-10-31 20:35:03 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 1124 [height] => 1600 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-211x300.jpg [medium-width] => 211 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-768x1093.jpg [medium_large-width] => 640 [medium_large-height] => 911 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-719x1024.jpg [large-width] => 640 [large-height] => 911 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-1079x1536.jpg [1536x1536-width] => 1079 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068.jpg [2048x2048-width] => 1124 [2048x2048-height] => 1600 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-600x400.jpg [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-600x600.jpg [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068.jpg [tp-image-grid-width] => 492 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-35x50.jpg [admin-width] => 35 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068.jpg [full-width] => 1124 [full-height] => 1600 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-372x530.jpg [thumb_372-width] => 372 [thumb_372-height] => 530 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-439x625.jpg [single_post_thumbnail-width] => 439 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-22x32.jpg [thumb_32_32-width] => 22 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-34x48.jpg [thumb_48_48-width] => 34 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-45x64.jpg [thumb_64_64-width] => 45 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-90x128.jpg [thumb_128_128-width] => 90 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-47x67.jpg [thumb_122_67-width] => 47 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-107x153.jpg [thumb_153_153-width] => 107 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-115x163.jpg [thumb_130_163-width] => 115 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-124x177.jpg [thumb_232_177-width] => 124 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-457x650.jpg [thumb_272_325-width] => 457 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-243x346.jpg [thumb_271_346-width] => 243 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-190x271.jpg [thumb_271_271-width] => 190 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-121x172.jpg [thumb_272_172-width] => 121 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-324x461.jpg [thumb_372_461-width] => 324 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-351x500.jpg [thumb_372_500-width] => 351 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-190x270.jpg [thumb_385_270-width] => 190 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-169x241.jpg [thumb_416_241-width] => 169 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-288x410.jpg [thumb_448_410-width] => 288 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-576x820.jpg [thumb_448_410_retina-width] => 576 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-268x382.jpg [thumb_574_382-width] => 268 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-2068-277x395.jpg [thumb_776_395-width] => 277 [thumb_776_395-height] => 395 ) ) [1] => Array ( [ID] => 44340 [id] => 44340 [title] => T1_-_Reduced_Brand_with_Personalization.jpg [filename] => T1_-_Reduced_Brand_with_Personalization-7.jpg [filesize] => 411055 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7.jpg [link] => https://www.nextafter.com/experiments/how-personalization-and-brand-reduction-affect-conversion-on-a-post-survey-donation-page/attachment/t1_-_reduced_brand_with_personalization-jpg-11/ [alt] => [author] => 0 [description] => [caption] => [name] => t1_-_reduced_brand_with_personalization-jpg-11 [status] => inherit [uploaded_to] => 17415 [date] => 2022-10-31 20:35:30 [modified] => 2022-10-31 20:35:30 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 1114 [height] => 1598 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-209x300.jpg [medium-width] => 209 [medium-height] => 300 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-768x1102.jpg [medium_large-width] => 640 [medium_large-height] => 918 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-714x1024.jpg [large-width] => 640 [large-height] => 918 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-1071x1536.jpg [1536x1536-width] => 1071 [1536x1536-height] => 1536 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7.jpg [2048x2048-width] => 1114 [2048x2048-height] => 1598 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-600x400.jpg [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-600x600.jpg [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7.jpg [tp-image-grid-width] => 488 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-35x50.jpg [admin-width] => 35 [admin-height] => 50 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7.jpg [full-width] => 1114 [full-height] => 1598 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-372x534.jpg [thumb_372-width] => 372 [thumb_372-height] => 534 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-436x625.jpg [single_post_thumbnail-width] => 436 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-22x32.jpg [thumb_32_32-width] => 22 [thumb_32_32-height] => 32 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-33x48.jpg [thumb_48_48-width] => 33 [thumb_48_48-height] => 48 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-45x64.jpg [thumb_64_64-width] => 45 [thumb_64_64-height] => 64 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-89x128.jpg [thumb_128_128-width] => 89 [thumb_128_128-height] => 128 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-47x67.jpg [thumb_122_67-width] => 47 [thumb_122_67-height] => 67 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-107x153.jpg [thumb_153_153-width] => 107 [thumb_153_153-height] => 153 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-114x163.jpg [thumb_130_163-width] => 114 [thumb_130_163-height] => 163 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-123x177.jpg [thumb_232_177-width] => 123 [thumb_232_177-height] => 177 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-453x650.jpg [thumb_272_325-width] => 453 [thumb_272_325-height] => 650 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-241x346.jpg [thumb_271_346-width] => 241 [thumb_271_346-height] => 346 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-189x271.jpg [thumb_271_271-width] => 189 [thumb_271_271-height] => 271 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-120x172.jpg [thumb_272_172-width] => 120 [thumb_272_172-height] => 172 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-321x461.jpg [thumb_372_461-width] => 321 [thumb_372_461-height] => 461 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-349x500.jpg [thumb_372_500-width] => 349 [thumb_372_500-height] => 500 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-188x270.jpg [thumb_385_270-width] => 188 [thumb_385_270-height] => 270 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-168x241.jpg [thumb_416_241-width] => 168 [thumb_416_241-height] => 241 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-286x410.jpg [thumb_448_410-width] => 286 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-572x820.jpg [thumb_448_410_retina-width] => 572 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-266x382.jpg [thumb_574_382-width] => 266 [thumb_574_382-height] => 382 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/T1_-_Reduced_Brand_with_Personalization-7-275x395.jpg [thumb_776_395-width] => 275 [thumb_776_395-height] => 395 ) ) )

Results

 Treatment NameRevenue per VisitorRelative DifferenceConfidenceAverage Gift
C: Control $3.02$77.65
T1: T1 - Reduced Brand with Personalization $3.4313.4% 99.8%$79.58

This experiment was validated using 3rd party testing tools. Based upon those calculations, a significant level of confidence was met so these experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 10.7% increase in conversion rate
× 2.5% increase in average gift
13.4% increase in revenue

Key Learnings

The treatment, which combined the personalization and the reduced brand mention, increased revenue by 13.4%. This reinforces the learning from the initial experiment, and shows that a similar lift in revenue holds for a treatment on a different offer, especially when combining the treatments. 

This experiment results suggests that: 

  1. Personalization has a statistically significant impact on conversion. 
  2. Reducing the mentions of the brand on the donation page has a statistically significant impact on conversion. 
  3. Both elements combined contribute to a lift in average gift and revenue per visitor. 


Experiment Documented by Jeff Giddens
Jeff Giddens is President of NextAfter.

Question about experiment #35799

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.