How adding a flag icon to a donation form tab affects recurring donation rate
Experiment ID: #180240
The Heritage Foundation
Experiment Summary
Timeframe: 05/30/2024 - 06/11/2024
The Heritage Foundation had previously run a test on their membership renewal page where they added a small flag image to a tabbed donation form’s monthly gift tab in order to appeal to the patriotism of their donors, which led to an increase in donations.
Wondering whether this concept would appeal to donors on another direct appeal donation page, they also tested this flag image in the donation form’s $100 gift array button and in the form submit button, which led to a decrease in donations at a near-valid level of confidence.
As a follow-up experiment on the direct appeal donation page, they wanted to test whether the flag icon in the monthly gift tab and the form submit button would lead to an increase in donations, namely recurring donations.
They launched an A/B test where the control had no flag icon anywhere on the form, and the treatment had the flag icon in the monthly gift tab and the form submit button.
Research Question
We believe that using a small American flag in a donation form’s monthly gift tab and submit button to build affinity for direct appeal prospects will achieve an increase in conversion rate because the flag image will help align their motivation with the intended action.
Design
C: Control
Array
(
[0] => Array
(
[ID] => 60741
[id] => 60741
[title] => Screenshot
[filename] => 714257-222_1720193843231_image-2024-07-05T103658.501.jpg
[filesize] => 65034
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501.jpg
[link] => https://www.nextafter.com/experiments/how-adding-a-flag-icon-to-a-donation-form-tab-affects-recurring-donation-rate/attachment/screenshot-23/
[alt] =>
[author] => 52
[description] =>
[caption] => Screenshot
[name] => screenshot-23
[status] => inherit
[uploaded_to] => 60725
[date] => 2024-07-08 02:24:46
[modified] => 2024-07-08 02:24:46
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 964
[height] => 1342
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-215x300.jpg
[medium-width] => 215
[medium-height] => 300
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-768x1069.jpg
[medium_large-width] => 640
[medium_large-height] => 891
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-736x1024.jpg
[large-width] => 640
[large-height] => 890
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501.jpg
[1536x1536-width] => 964
[1536x1536-height] => 1342
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501.jpg
[2048x2048-width] => 964
[2048x2048-height] => 1342
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-600x600.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-700x700.jpg
[tp-image-grid-width] => 700
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-36x50.jpg
[admin-width] => 36
[admin-height] => 50
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501.jpg
[full-width] => 964
[full-height] => 1342
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-372x518.jpg
[thumb_372-width] => 372
[thumb_372-height] => 518
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-449x625.jpg
[single_post_thumbnail-width] => 449
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-23x32.jpg
[thumb_32_32-width] => 23
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-34x48.jpg
[thumb_48_48-width] => 34
[thumb_48_48-height] => 48
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-46x64.jpg
[thumb_64_64-width] => 46
[thumb_64_64-height] => 64
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-92x128.jpg
[thumb_128_128-width] => 92
[thumb_128_128-height] => 128
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-48x67.jpg
[thumb_122_67-width] => 48
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-110x153.jpg
[thumb_153_153-width] => 110
[thumb_153_153-height] => 153
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-117x163.jpg
[thumb_130_163-width] => 117
[thumb_130_163-height] => 163
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-127x177.jpg
[thumb_232_177-width] => 127
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-467x650.jpg
[thumb_272_325-width] => 467
[thumb_272_325-height] => 650
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-249x346.jpg
[thumb_271_346-width] => 249
[thumb_271_346-height] => 346
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-195x271.jpg
[thumb_271_271-width] => 195
[thumb_271_271-height] => 271
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-124x172.jpg
[thumb_272_172-width] => 124
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-331x461.jpg
[thumb_372_461-width] => 331
[thumb_372_461-height] => 461
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-359x500.jpg
[thumb_372_500-width] => 359
[thumb_372_500-height] => 500
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-194x270.jpg
[thumb_385_270-width] => 194
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-173x241.jpg
[thumb_416_241-width] => 173
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-295x410.jpg
[thumb_448_410-width] => 295
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-589x820.jpg
[thumb_448_410_retina-width] => 589
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-274x382.jpg
[thumb_574_382-width] => 274
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-284x395.jpg
[thumb_776_395-width] => 284
[thumb_776_395-height] => 395
) ) [1] => Array
(
[ID] => 60743
[id] => 60743
[title] => Screenshot
[filename] => 714257-222_1720193848001_image-2024-07-05T103701.883.jpg
[filesize] => 52410
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883.jpg
[link] => https://www.nextafter.com/experiments/how-adding-a-flag-icon-to-a-donation-form-tab-affects-recurring-donation-rate/attachment/screenshot-24/
[alt] =>
[author] => 52
[description] =>
[caption] => Screenshot
[name] => screenshot-24
[status] => inherit
[uploaded_to] => 60725
[date] => 2024-07-08 02:25:24
[modified] => 2024-07-08 02:25:24
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 958
[height] => 1344
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-214x300.jpg
[medium-width] => 214
[medium-height] => 300
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-768x1077.jpg
[medium_large-width] => 640
[medium_large-height] => 898
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-730x1024.jpg
[large-width] => 640
[large-height] => 898
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883.jpg
[1536x1536-width] => 958
[1536x1536-height] => 1344
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883.jpg
[2048x2048-width] => 958
[2048x2048-height] => 1344
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-600x600.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-700x700.jpg
[tp-image-grid-width] => 700
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-36x50.jpg
[admin-width] => 36
[admin-height] => 50
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883.jpg
[full-width] => 958
[full-height] => 1344
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-372x522.jpg
[thumb_372-width] => 372
[thumb_372-height] => 522
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-445x625.jpg
[single_post_thumbnail-width] => 445
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-23x32.jpg
[thumb_32_32-width] => 23
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-34x48.jpg
[thumb_48_48-width] => 34
[thumb_48_48-height] => 48
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-46x64.jpg
[thumb_64_64-width] => 46
[thumb_64_64-height] => 64
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-91x128.jpg
[thumb_128_128-width] => 91
[thumb_128_128-height] => 128
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-48x67.jpg
[thumb_122_67-width] => 48
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-109x153.jpg
[thumb_153_153-width] => 109
[thumb_153_153-height] => 153
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-116x163.jpg
[thumb_130_163-width] => 116
[thumb_130_163-height] => 163
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-126x177.jpg
[thumb_232_177-width] => 126
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-463x650.jpg
[thumb_272_325-width] => 463
[thumb_272_325-height] => 650
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-247x346.jpg
[thumb_271_346-width] => 247
[thumb_271_346-height] => 346
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-193x271.jpg
[thumb_271_271-width] => 193
[thumb_271_271-height] => 271
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-123x172.jpg
[thumb_272_172-width] => 123
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-329x461.jpg
[thumb_372_461-width] => 329
[thumb_372_461-height] => 461
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-356x500.jpg
[thumb_372_500-width] => 356
[thumb_372_500-height] => 500
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-192x270.jpg
[thumb_385_270-width] => 192
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-172x241.jpg
[thumb_416_241-width] => 172
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-292x410.jpg
[thumb_448_410-width] => 292
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-584x820.jpg
[thumb_448_410_retina-width] => 584
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-272x382.jpg
[thumb_574_382-width] => 272
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-282x395.jpg
[thumb_776_395-width] => 282
[thumb_776_395-height] => 395
) ) )
T1: Flag Icon
Array
(
[0] => Array
(
[ID] => 60741
[id] => 60741
[title] => Screenshot
[filename] => 714257-222_1720193843231_image-2024-07-05T103658.501.jpg
[filesize] => 65034
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501.jpg
[link] => https://www.nextafter.com/experiments/how-adding-a-flag-icon-to-a-donation-form-tab-affects-recurring-donation-rate/attachment/screenshot-23/
[alt] =>
[author] => 52
[description] =>
[caption] => Screenshot
[name] => screenshot-23
[status] => inherit
[uploaded_to] => 60725
[date] => 2024-07-08 02:24:46
[modified] => 2024-07-08 02:24:46
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 964
[height] => 1342
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-215x300.jpg
[medium-width] => 215
[medium-height] => 300
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-768x1069.jpg
[medium_large-width] => 640
[medium_large-height] => 891
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-736x1024.jpg
[large-width] => 640
[large-height] => 890
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501.jpg
[1536x1536-width] => 964
[1536x1536-height] => 1342
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501.jpg
[2048x2048-width] => 964
[2048x2048-height] => 1342
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-600x600.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-700x700.jpg
[tp-image-grid-width] => 700
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-36x50.jpg
[admin-width] => 36
[admin-height] => 50
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501.jpg
[full-width] => 964
[full-height] => 1342
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-372x518.jpg
[thumb_372-width] => 372
[thumb_372-height] => 518
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-449x625.jpg
[single_post_thumbnail-width] => 449
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-23x32.jpg
[thumb_32_32-width] => 23
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-34x48.jpg
[thumb_48_48-width] => 34
[thumb_48_48-height] => 48
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-46x64.jpg
[thumb_64_64-width] => 46
[thumb_64_64-height] => 64
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-92x128.jpg
[thumb_128_128-width] => 92
[thumb_128_128-height] => 128
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-48x67.jpg
[thumb_122_67-width] => 48
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-110x153.jpg
[thumb_153_153-width] => 110
[thumb_153_153-height] => 153
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-117x163.jpg
[thumb_130_163-width] => 117
[thumb_130_163-height] => 163
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-127x177.jpg
[thumb_232_177-width] => 127
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-467x650.jpg
[thumb_272_325-width] => 467
[thumb_272_325-height] => 650
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-249x346.jpg
[thumb_271_346-width] => 249
[thumb_271_346-height] => 346
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-195x271.jpg
[thumb_271_271-width] => 195
[thumb_271_271-height] => 271
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-124x172.jpg
[thumb_272_172-width] => 124
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-331x461.jpg
[thumb_372_461-width] => 331
[thumb_372_461-height] => 461
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-359x500.jpg
[thumb_372_500-width] => 359
[thumb_372_500-height] => 500
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-194x270.jpg
[thumb_385_270-width] => 194
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-173x241.jpg
[thumb_416_241-width] => 173
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-295x410.jpg
[thumb_448_410-width] => 295
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-589x820.jpg
[thumb_448_410_retina-width] => 589
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-274x382.jpg
[thumb_574_382-width] => 274
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193843231_image-2024-07-05T103658.501-284x395.jpg
[thumb_776_395-width] => 284
[thumb_776_395-height] => 395
) ) [1] => Array
(
[ID] => 60743
[id] => 60743
[title] => Screenshot
[filename] => 714257-222_1720193848001_image-2024-07-05T103701.883.jpg
[filesize] => 52410
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883.jpg
[link] => https://www.nextafter.com/experiments/how-adding-a-flag-icon-to-a-donation-form-tab-affects-recurring-donation-rate/attachment/screenshot-24/
[alt] =>
[author] => 52
[description] =>
[caption] => Screenshot
[name] => screenshot-24
[status] => inherit
[uploaded_to] => 60725
[date] => 2024-07-08 02:25:24
[modified] => 2024-07-08 02:25:24
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 958
[height] => 1344
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-214x300.jpg
[medium-width] => 214
[medium-height] => 300
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-768x1077.jpg
[medium_large-width] => 640
[medium_large-height] => 898
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-730x1024.jpg
[large-width] => 640
[large-height] => 898
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883.jpg
[1536x1536-width] => 958
[1536x1536-height] => 1344
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883.jpg
[2048x2048-width] => 958
[2048x2048-height] => 1344
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-600x400.jpg
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-600x600.jpg
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-700x700.jpg
[tp-image-grid-width] => 700
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-36x50.jpg
[admin-width] => 36
[admin-height] => 50
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883.jpg
[full-width] => 958
[full-height] => 1344
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-372x522.jpg
[thumb_372-width] => 372
[thumb_372-height] => 522
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-445x625.jpg
[single_post_thumbnail-width] => 445
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-23x32.jpg
[thumb_32_32-width] => 23
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-34x48.jpg
[thumb_48_48-width] => 34
[thumb_48_48-height] => 48
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-46x64.jpg
[thumb_64_64-width] => 46
[thumb_64_64-height] => 64
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-91x128.jpg
[thumb_128_128-width] => 91
[thumb_128_128-height] => 128
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-48x67.jpg
[thumb_122_67-width] => 48
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-109x153.jpg
[thumb_153_153-width] => 109
[thumb_153_153-height] => 153
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-116x163.jpg
[thumb_130_163-width] => 116
[thumb_130_163-height] => 163
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-126x177.jpg
[thumb_232_177-width] => 126
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-463x650.jpg
[thumb_272_325-width] => 463
[thumb_272_325-height] => 650
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-247x346.jpg
[thumb_271_346-width] => 247
[thumb_271_346-height] => 346
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-193x271.jpg
[thumb_271_271-width] => 193
[thumb_271_271-height] => 271
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-123x172.jpg
[thumb_272_172-width] => 123
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-329x461.jpg
[thumb_372_461-width] => 329
[thumb_372_461-height] => 461
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-356x500.jpg
[thumb_372_500-width] => 356
[thumb_372_500-height] => 500
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-192x270.jpg
[thumb_385_270-width] => 192
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-172x241.jpg
[thumb_416_241-width] => 172
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-292x410.jpg
[thumb_448_410-width] => 292
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-584x820.jpg
[thumb_448_410_retina-width] => 584
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-272x382.jpg
[thumb_574_382-width] => 272
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/714257-222_1720193848001_image-2024-07-05T103701.883-282x395.jpg
[thumb_776_395-width] => 282
[thumb_776_395-height] => 395
) ) )
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | Average Gift | |
|---|---|---|---|---|---|
| C: | Control | 0.00% | $0.00 | ||
| T1: | Flag Icon | 0.17% | 100.0% | 68.3% | $0.00 |
This experiment has a required sample size of 2,332 in order to be valid. Unfortunately, the required sample size was not met and a level of confidence above 95% was not met so the experiment results are not valid.
Key Learnings
The key learning from this experiment is that adding a small American flag image to a donation form’s monthly gift tab and submit button did not lead to a valid increase in donations, specifically recurring donations. In fact, the treatment group saw a 40.3% decrease in transactions for all traffic compared to the control group. However, it is important to note that the statistical confidence level of 78.8% is below the valid threshold of 95%, indicating that these results may not be reliable.
The treatment also resulted in just a 0.17% increase in recurring donations at a 68.3% level of confidence. With such a small sample size, these results cannot be relied upon to inform future action.
In future experimentation, it is crucial to ensure that the sample size is adequate to achieve a statistically valid result. Additionally, it is important to carefully consider the impact of visual elements such as flag icons on donor behavior. Other ideas for follow-up testing include testing a different icon than an American flag or testing this concept on a donation page following a content offer.