When you create an email marketing campaign, there are many ways to present your content, but you may wonder which way is best. Use our Multivariate Testing feature to see how small changes to your email campaigns impact subscriber engagement.
In this article, you'll learn how to create and edit a Multivariate campaign.
Before you create a Multivariate campaign, familiarize yourself with the terminology and ways they can be used.
We recommend you send combinations to at least 5,000 subscribers to make sure you receive the most useful data from your test.
Wait at least four hours after you send a Multivariate campaign to send a winning campaign. Many subscribers won't engage with your email campaign sooner, which can misinform your test results. Shorter test times may cause a losing combination to go out to the rest of your recipients. You can see the campaign results at the time the winner was selected in the campaign report.
In Multivariate campaigns where content is a variable, choose the winner by best click rate, since opens occur before a subscriber views your content.
Create a multivariate campaign
Multivariate campaigns are built in a series of steps, just like other email campaign types. If you haven't started building a Multivariate campaign yet, start at the beginning of these instructions. If you already started and saved your progress, skip to the step you want to work on.
To create a new Multivariate campaign, follow these steps.
Navigate to the Campaigns page.
Click Create Campaign.
In the pop-up modal, click Email.
Enter a campaign name and click Begin.
On the first step of the campaign builder, choose the audience or segment you want to send your email campaign to. To send to a segment, configure a new segment on this screen, or choose a saved segment.
You'll configure the elements you want to test on the Variables step.
Click the Plus icon for each variable you want to test.
Click the Plus or Minus icons to add or remove additional variations of the variable.
You can test up to three of four variables, to create up to eight combinations. The number of variations of each variable multiplied together equals the number of combinations. This number is shown in the Summary.
For example, if you want to test 3 subject lines and 2 variations of content, we'll generate 6 combinations of your email campaign.
Under How should we split your recipients?, click and drag the slider to set the percentage your recipients you want to send your test combinations to.
Depending on which variables you test, the Setup step will present multiple Email subject, From email address and name, and Subject line fields.
Type in your variation content in the fields provided. Settings for Send time variations also appear on this step.
Check the boxes next to your preferred settings or tracking options.
The Content step is where you add content for your email campaign. What you see on this step will vary if you choose to test content.
Test Subject Line, From Name, or Send Time
Choose your layout on the Template step of the Content Builder.
On the Design step of the Content Builder, design and test your email campaign.
When everything is how you want, click Confirm Before Sending.
The Content setup page shows a preview for each variation of your email campaign content. To add content to each variation, follow these steps.
Click Add Content for any variation of your campaign.
Select your layout on the Template step of the Content Builder.
On the Design step of the Content Builder, design and test your email campaign. When everything is how you want, click Next.
On the Description step of the Content Builder, type in text to describe the variation of the content. Your subscribers won't see this description, but it will help you remember the differences between each variation.
Click Continue to Content to return to your content variations.
Repeat steps 1-5 for each content variation. On the Template step, use a different template or select a variation you already designed in the Previous Variations tab.
When everything is how you want, click Next.
The Confirm step is where you'll review the combinations that make up your Multivariate campaign.
Review the Pre-delivery Checklist. Click Resolve or Edit to make changes to any section.
Account users with a Manager user level or higher will receive an email when a winner has been automatically chosen, or after four hours if you haven't yet picked a winner manually.
If a subscriber opens the campaign page for a sent email campaign, they'll always see the campaign combination they received, even if the winning combination is different.
The winning combination of your Multivariate test will appear in the public campaign archive for your audience, unless you tested send time.
Manually choose winner
If you chose Manual Selection from the drop-down menu on the Variables step of the Campaign Builder, you'll be able to view the campaign report after the test combinations are sent, and choose the winner.
To manually choose a winner, follow these steps.
Navigate to the Reports page.
Click View Report for the Multivariate campaign you want to work with.
In the event that none of your recipients opens or clicks in any of your combinations, the final set of recipients will get the last combination by default. This could happen if your test sends to very few recipients.
If the same number of people click and open your combinations, the first combination will send to the remaining recipients.
Have another question? Paid users can log in for email or chat support.