First Baptist Dallas

How sending a follow up email impacted revenue from a text campaign

Experiment ID: #162558

First Baptist Dallas

Experiment Summary

Ended On: 10/26/2023

Pathway to Victory is a broadcast ministry of First Baptist Dallas.

In promoting a new book, we decided to test a follow-up email to half of the audience that received a text message.

For PTV, they rarely use text messages due to cost, and they never do it to the full file, they pick and choose select segments depending on offer, time of the year, and segment that needs extra activation. There are several reasons why we wanted to test this approach.

For one, following up with email, a known and regularly used channel, can help verify that the text wasn’t spam, as that is popular.

Second, if you have multiple channels that can be personalized and timed accurately, why not have those channels work together and support one another? And not in a just more than one is better. But the email called out the text. They are directly connected and not just random that someone received two different things from PTV.

In the case of PTV specifically, they typically suppress text recipients from receiving emails that week so as not to steal results from text. But we are able to show that that isn’t an effective strategy; it’s actually better for channels to play together than being so decisive and siloed

Research Question

We believe that by sending a following email for text message recipients will achieve a higher conversion rate because there is an additional touchpoint through another personal channel.

Design

C: Text Message Only

T1: Text Message & Email

Results

	Treatment Name	Revenue per Visitor	Relative Difference	Confidence	Average Gift
C:	Text Message Only	$0.24			$39.32
T1:	Text Message & Email	$0.43	80.1%	100.0%	$35.80

This experiment was validated using 3rd party testing tools. Based upon those calculations, a significant level of confidence was met so these experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

0% increase in traffic
× 97.9% increase in conversion rate
× 9.0% decrease in average gift
80.1% increase in revenue

Key Learnings

The key learning from this experiment is that sending a follow-up email to text message recipients can significantly increase the conversion rate and revenue generated. The treatment group, which received both a text message and a follow-up email, saw an 80.1% increase in revenue compared to the control group that only received a text message.

This outcome suggests that adding an additional touchpoint through another personal channel, such as email, can be highly effective in capturing the attention and engagement of recipients. It is likely that the email served as a reminder or reinforcement of the message conveyed in the initial text message, leading to a higher conversion rate.

In future experimentation, it would be beneficial to continue using the strategy of sending follow-up emails to text message recipients. This can be implemented as a standard practice, potentially leading to consistent improvements in conversion rates and revenue. Additionally, it may be worth exploring the specific content and timing of the follow-up emails to optimize their effectiveness.

Overall, the success of this experiment reinforces the importance of a multi-channel approach in engaging with audiences and increasing conversion rates. By utilizing multiple channels and touchpoints, organizations can enhance their messaging and communication strategies, leading to improved outcomes and revenue generation.

Experiment Documented by NextAfter

Question about experiment #162558

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.