How a premium offer chat widget CTA on podcast pages impacts donor conversion
Experiment ID: #184651
FamilyLife
Experiment Summary
Timeframe: 07/02/2024 - 07/31/2024
FamilyLife helps families bridge the gap between their intentions and reality, fostering closer relationships with God, each other, and their communities. Their FamilyLife Podcast Network, including the FamilyLife Today® podcast, offers engaging conversations to help families grow together with Jesus and strengthen their most important relationships.
Traditionally, FamilyLife has relied on an end-of-article “dear listener” message to promote their campaigns and offer a premium item to donors. We hypothesized that adding a chat message widget to the podcast pages for listeners and visitors of FamilyLife Today® will increase donor conversion rates because the interactive and personal nature of the widget creates a more engaging and persuasive experience through social presence and personal connection.
For this test, we selected their most popular premium offer, the book “Seeing Beautiful Again.” The Control was the traditional “dear listener” message, while the Treatment was a chat message widget. Traffic was split evenly between the two versions, with identical language used in both. The Control message appeared at the end of the article, while the widget popped up in the bottom right corner and expanded when clicked. The Treatment also included images of the FamilyLife Today podcast hosts, Dave and Ann, to simulate a text messaging experience.
Research Question
We believe that adding a chat message widget to the podcast pages for visitors of FamilyLife Today® will create a more engaging and persuasive experience due to the interactive nature of the widget, therefore increasing donor conversion rates.
Design
C: Control: Dear Listener
Array
(
[0] => Array
(
[ID] => 65403
[id] => 65403
[title] => Control:_Dear_Listener.png
[filename] => Control_Dear_Listener-1.png
[filesize] => 160344
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1.png
[link] => https://www.nextafter.com/experiments/how-a-premium-offer-chat-widget-cta-on-podcast-pages-impacts-donor-conversion/attachment/control_dear_listener-png-14/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => control_dear_listener-png-14
[status] => inherit
[uploaded_to] => 61402
[date] => 2024-08-20 14:54:20
[modified] => 2024-08-20 14:54:20
[menu_order] => 0
[mime_type] => image/png
[type] => image
[subtype] => png
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 664
[height] => 766
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-150x150.png
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-260x300.png
[medium-width] => 260
[medium-height] => 300
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1.png
[medium_large-width] => 640
[medium_large-height] => 738
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1.png
[large-width] => 640
[large-height] => 738
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1.png
[1536x1536-width] => 664
[1536x1536-height] => 766
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1.png
[2048x2048-width] => 664
[2048x2048-height] => 766
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-600x400.png
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-600x600.png
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-700x700.png
[tp-image-grid-width] => 700
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-150x150.png
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-43x50.png
[admin-width] => 43
[admin-height] => 50
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1.png
[full-width] => 664
[full-height] => 766
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-372x429.png
[thumb_372-width] => 372
[thumb_372-height] => 429
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-542x625.png
[single_post_thumbnail-width] => 542
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-28x32.png
[thumb_32_32-width] => 28
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-42x48.png
[thumb_48_48-width] => 42
[thumb_48_48-height] => 48
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-55x64.png
[thumb_64_64-width] => 55
[thumb_64_64-height] => 64
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-111x128.png
[thumb_128_128-width] => 111
[thumb_128_128-height] => 128
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-58x67.png
[thumb_122_67-width] => 58
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-133x153.png
[thumb_153_153-width] => 133
[thumb_153_153-height] => 153
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-130x150.png
[thumb_130_163-width] => 130
[thumb_130_163-height] => 150
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-153x177.png
[thumb_232_177-width] => 153
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-544x628.png
[thumb_272_325-width] => 544
[thumb_272_325-height] => 628
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-271x313.png
[thumb_271_346-width] => 271
[thumb_271_346-height] => 313
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-235x271.png
[thumb_271_271-width] => 235
[thumb_271_271-height] => 271
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-149x172.png
[thumb_272_172-width] => 149
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-372x429.png
[thumb_372_461-width] => 372
[thumb_372_461-height] => 429
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-372x429.png
[thumb_372_500-width] => 372
[thumb_372_500-height] => 429
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-234x270.png
[thumb_385_270-width] => 234
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-209x241.png
[thumb_416_241-width] => 209
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-355x410.png
[thumb_448_410-width] => 355
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1.png
[thumb_448_410_retina-width] => 664
[thumb_448_410_retina-height] => 766
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-331x382.png
[thumb_574_382-width] => 331
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-342x395.png
[thumb_776_395-width] => 342
[thumb_776_395-height] => 395
) ) [1] => Array
(
[ID] => 65404
[id] => 65404
[title] => Treatment:_Message_Widget.png
[filename] => Treatment_Message_Widget-1.png
[filesize] => 226224
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1.png
[link] => https://www.nextafter.com/experiments/how-a-premium-offer-chat-widget-cta-on-podcast-pages-impacts-donor-conversion/attachment/treatment_message_widget-png-13/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => treatment_message_widget-png-13
[status] => inherit
[uploaded_to] => 61402
[date] => 2024-08-20 14:54:23
[modified] => 2024-08-20 14:54:23
[menu_order] => 0
[mime_type] => image/png
[type] => image
[subtype] => png
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 925
[height] => 891
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-150x150.png
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-300x289.png
[medium-width] => 300
[medium-height] => 289
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-768x740.png
[medium_large-width] => 640
[medium_large-height] => 617
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1.png
[large-width] => 640
[large-height] => 616
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1.png
[1536x1536-width] => 925
[1536x1536-height] => 891
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1.png
[2048x2048-width] => 925
[2048x2048-height] => 891
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-600x400.png
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-600x600.png
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-700x700.png
[tp-image-grid-width] => 700
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-150x150.png
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-50x48.png
[admin-width] => 50
[admin-height] => 48
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1.png
[full-width] => 925
[full-height] => 891
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-372x358.png
[thumb_372-width] => 372
[thumb_372-height] => 358
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-649x625.png
[single_post_thumbnail-width] => 649
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-32x32.png
[thumb_32_32-width] => 32
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-48x46.png
[thumb_48_48-width] => 48
[thumb_48_48-height] => 46
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-64x62.png
[thumb_64_64-width] => 64
[thumb_64_64-height] => 62
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-128x123.png
[thumb_128_128-width] => 128
[thumb_128_128-height] => 123
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-70x67.png
[thumb_122_67-width] => 70
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-153x147.png
[thumb_153_153-width] => 153
[thumb_153_153-height] => 147
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-130x125.png
[thumb_130_163-width] => 130
[thumb_130_163-height] => 125
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-184x177.png
[thumb_232_177-width] => 184
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-544x524.png
[thumb_272_325-width] => 544
[thumb_272_325-height] => 524
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-271x261.png
[thumb_271_346-width] => 271
[thumb_271_346-height] => 261
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-271x261.png
[thumb_271_271-width] => 271
[thumb_271_271-height] => 261
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-179x172.png
[thumb_272_172-width] => 179
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-372x358.png
[thumb_372_461-width] => 372
[thumb_372_461-height] => 358
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-372x358.png
[thumb_372_500-width] => 372
[thumb_372_500-height] => 358
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-280x270.png
[thumb_385_270-width] => 280
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-250x241.png
[thumb_416_241-width] => 250
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-426x410.png
[thumb_448_410-width] => 426
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-851x820.png
[thumb_448_410_retina-width] => 851
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-397x382.png
[thumb_574_382-width] => 397
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-410x395.png
[thumb_776_395-width] => 410
[thumb_776_395-height] => 395
) ) )
T1: Treatment: Message Widget
Array
(
[0] => Array
(
[ID] => 65403
[id] => 65403
[title] => Control:_Dear_Listener.png
[filename] => Control_Dear_Listener-1.png
[filesize] => 160344
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1.png
[link] => https://www.nextafter.com/experiments/how-a-premium-offer-chat-widget-cta-on-podcast-pages-impacts-donor-conversion/attachment/control_dear_listener-png-14/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => control_dear_listener-png-14
[status] => inherit
[uploaded_to] => 61402
[date] => 2024-08-20 14:54:20
[modified] => 2024-08-20 14:54:20
[menu_order] => 0
[mime_type] => image/png
[type] => image
[subtype] => png
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 664
[height] => 766
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-150x150.png
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-260x300.png
[medium-width] => 260
[medium-height] => 300
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1.png
[medium_large-width] => 640
[medium_large-height] => 738
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1.png
[large-width] => 640
[large-height] => 738
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1.png
[1536x1536-width] => 664
[1536x1536-height] => 766
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1.png
[2048x2048-width] => 664
[2048x2048-height] => 766
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-600x400.png
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-600x600.png
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-700x700.png
[tp-image-grid-width] => 700
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-150x150.png
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-43x50.png
[admin-width] => 43
[admin-height] => 50
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1.png
[full-width] => 664
[full-height] => 766
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-372x429.png
[thumb_372-width] => 372
[thumb_372-height] => 429
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-542x625.png
[single_post_thumbnail-width] => 542
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-28x32.png
[thumb_32_32-width] => 28
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-42x48.png
[thumb_48_48-width] => 42
[thumb_48_48-height] => 48
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-55x64.png
[thumb_64_64-width] => 55
[thumb_64_64-height] => 64
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-111x128.png
[thumb_128_128-width] => 111
[thumb_128_128-height] => 128
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-58x67.png
[thumb_122_67-width] => 58
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-133x153.png
[thumb_153_153-width] => 133
[thumb_153_153-height] => 153
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-130x150.png
[thumb_130_163-width] => 130
[thumb_130_163-height] => 150
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-153x177.png
[thumb_232_177-width] => 153
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-544x628.png
[thumb_272_325-width] => 544
[thumb_272_325-height] => 628
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-271x313.png
[thumb_271_346-width] => 271
[thumb_271_346-height] => 313
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-235x271.png
[thumb_271_271-width] => 235
[thumb_271_271-height] => 271
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-149x172.png
[thumb_272_172-width] => 149
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-372x429.png
[thumb_372_461-width] => 372
[thumb_372_461-height] => 429
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-372x429.png
[thumb_372_500-width] => 372
[thumb_372_500-height] => 429
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-234x270.png
[thumb_385_270-width] => 234
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-209x241.png
[thumb_416_241-width] => 209
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-355x410.png
[thumb_448_410-width] => 355
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1.png
[thumb_448_410_retina-width] => 664
[thumb_448_410_retina-height] => 766
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-331x382.png
[thumb_574_382-width] => 331
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control_Dear_Listener-1-342x395.png
[thumb_776_395-width] => 342
[thumb_776_395-height] => 395
) ) [1] => Array
(
[ID] => 65404
[id] => 65404
[title] => Treatment:_Message_Widget.png
[filename] => Treatment_Message_Widget-1.png
[filesize] => 226224
[url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1.png
[link] => https://www.nextafter.com/experiments/how-a-premium-offer-chat-widget-cta-on-podcast-pages-impacts-donor-conversion/attachment/treatment_message_widget-png-13/
[alt] =>
[author] => 0
[description] =>
[caption] =>
[name] => treatment_message_widget-png-13
[status] => inherit
[uploaded_to] => 61402
[date] => 2024-08-20 14:54:23
[modified] => 2024-08-20 14:54:23
[menu_order] => 0
[mime_type] => image/png
[type] => image
[subtype] => png
[icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png
[width] => 925
[height] => 891
[sizes] => Array
(
[thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-150x150.png
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-300x289.png
[medium-width] => 300
[medium-height] => 289
[medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-768x740.png
[medium_large-width] => 640
[medium_large-height] => 617
[large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1.png
[large-width] => 640
[large-height] => 616
[1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1.png
[1536x1536-width] => 925
[1536x1536-height] => 891
[2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1.png
[2048x2048-width] => 925
[2048x2048-height] => 891
[ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-600x400.png
[ab-block-post-grid-landscape-width] => 600
[ab-block-post-grid-landscape-height] => 400
[ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-600x600.png
[ab-block-post-grid-square-width] => 600
[ab-block-post-grid-square-height] => 600
[tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-700x700.png
[tp-image-grid-width] => 700
[tp-image-grid-height] => 700
[post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-150x150.png
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-50x48.png
[admin-width] => 50
[admin-height] => 48
[full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1.png
[full-width] => 925
[full-height] => 891
[thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-372x358.png
[thumb_372-width] => 372
[thumb_372-height] => 358
[single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-649x625.png
[single_post_thumbnail-width] => 649
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-32x32.png
[thumb_32_32-width] => 32
[thumb_32_32-height] => 32
[thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-48x46.png
[thumb_48_48-width] => 48
[thumb_48_48-height] => 46
[thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-64x62.png
[thumb_64_64-width] => 64
[thumb_64_64-height] => 62
[thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-128x123.png
[thumb_128_128-width] => 128
[thumb_128_128-height] => 123
[thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-70x67.png
[thumb_122_67-width] => 70
[thumb_122_67-height] => 67
[thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-153x147.png
[thumb_153_153-width] => 153
[thumb_153_153-height] => 147
[thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-130x125.png
[thumb_130_163-width] => 130
[thumb_130_163-height] => 125
[thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-184x177.png
[thumb_232_177-width] => 184
[thumb_232_177-height] => 177
[thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-544x524.png
[thumb_272_325-width] => 544
[thumb_272_325-height] => 524
[thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-271x261.png
[thumb_271_346-width] => 271
[thumb_271_346-height] => 261
[thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-271x261.png
[thumb_271_271-width] => 271
[thumb_271_271-height] => 261
[thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-179x172.png
[thumb_272_172-width] => 179
[thumb_272_172-height] => 172
[thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-372x358.png
[thumb_372_461-width] => 372
[thumb_372_461-height] => 358
[thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-372x358.png
[thumb_372_500-width] => 372
[thumb_372_500-height] => 358
[thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-280x270.png
[thumb_385_270-width] => 280
[thumb_385_270-height] => 270
[thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-250x241.png
[thumb_416_241-width] => 250
[thumb_416_241-height] => 241
[thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-426x410.png
[thumb_448_410-width] => 426
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-851x820.png
[thumb_448_410_retina-width] => 851
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-397x382.png
[thumb_574_382-width] => 397
[thumb_574_382-height] => 382
[thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_Message_Widget-1-410x395.png
[thumb_776_395-width] => 410
[thumb_776_395-height] => 395
) ) )
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | Average Gift | |
|---|---|---|---|---|---|
| C: | Control: Dear Listener | 0.13% | $80.00 | ||
| T1: | Treatment: Message Widget | 0.37% | 187.9% | 98.8% | $26.75 |
This experiment has a required sample size of 3,270 in order to be valid. Since the experiment had a total sample size of 10,851, and the level of confidence is above 95% the experiment results are valid.
Flux Metrics Affected
The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:
0% increase in traffic
× 187.9% increase in conversion rate
× 66.6% decrease in average gift
3.7% decrease in revenue
Key Learnings
After running this experiment for 29 days, we found that the chat message widget outperformed the traditional “dear listener” approach, achieving a conversion rate of 0.37% compared to 0.13% for the control. This represents a 187.9% increase in conversions with a high level of confidence at 98.8%.The results demonstrate that the interactive nature of the widget significantly enhanced donor engagement and conversion rates.
For future experimentation, we plan to test this approach during the Fiscal Year End (FYE) Campaign using a premium book offer, “Unoffendable” by Brant Hansen. We also aim to explore different design variations of the chat widget, evaluate other premium offers for their effectiveness with interactive features, and assess the widget’s performance across various sections of the website.
Overall, the key learnings from this experiment emphasize the importance of personalization, interactivity, and social presence in driving donor conversions. By leveraging these insights in future experimentation, FamilyLife can continue to optimize its donation strategies and create more impactful and engaging experiences for its audience.