Skip to main content

Split-testing & variant scheduling

Creating, duplicating, and scheduling split-tests using campaign variants

Written by Jonathan Denney

From a campaign's overview page, scroll to "Variants", where you can add more variants to your campaign to run split-tests:

Duplicating a variant

The easiest way to begin a split-test is to duplicate an existing variant, and then make the changes you want to test for that variant:

This is great for micro split-testing, such as testing headlines, buttons, colors, etc.

Adding a variant with a different template

You can also add a new variant using a different template by clicking the green "New Variant +" button:

You'll then be able to choose from templates of the same campaign type:

This is ideal for macro split-testing, such as testing entirely different content layouts, offers, and more.

Managing variant traffic percentage

Once you have multiple variants, you can set a traffic percentage by typing a number from 0-100 in the "Traffic" field.

To deactivate a variant entirely, set its traffic percentage to 0.

Scheduling a variant

To schedule an end date for your variant, click the "Schedule" button:

You'll then be able to choose the end date:

From the point of scheduling your variant until the end date, performance will be measured for your active variant being split-tested, and the winning variant will be promoted based on the metric you choose.

Metrics that can be used:

  • Conversion rate

  • Completion rate

  • Add to cart rate

  • Order rate

  • Revenue

  • AOV

  • Orders (total count)

Split-testing types

You can also control which type of split-test you'd like to run by clicking Options > Settings for the campaign, or when scheduling a variant.

Cookied – This split-test type is useful when you want to ensure visitors who see a campaign multiple times always see the same variant they had originally seen.

Round-robin – This split-test type is useful when you want to display different variants to visitors who see a campaign multiple times, based on the traffic percentage you've set:

Did this answer your question?