How Can I A/B Test Different Prompt Experiences in Recurly Engage?

Recurly Engage offers advanced traffic splitting functionality that empowers you to A/B test different prompt experiences, like modals and banners, to optimize performance and conversion rates. This feature allows you to distribute a segment's traffic across various prompts for direct comparison.

Key Benefits of Segment Traffic Splitting

• Direct Comparison: You can now compare fundamentally different experiences, such as a modal versus an inline banner, to see which performs better.
• Data-Driven Decisions: Move beyond guesswork by directly comparing how different prompt types engage your audience to make informed choices.
• Maximize Conversions: Collect performance data to maximize conversions. For example, you can show a modal to 30% of a segment and a banner to 70%, and then analyze which experience drives higher engagement.
• Control: You can set a control group by intentionally excluding a percentage of users who are never targeted within a segment.

Steps to Implement a Segment Traffic Split in Recurly Engage

1. Go to the Segments section in Pulse, the Recurly Engage management console.
2. Select the segment type you would like to split.
3. In the segment detail view, where you see all active Prompts for the selected segment, select the Assign Traffic button on the prompt.
4. Set the segmentation split amount for the selected prompt. Once a user is assigned to a group, they will always remain in that group based on a bucketing methodology.
5. Repeat this step for the second prompt you want to segment.

Example Split Configuration

• First group: Set the split to 0-50.
• Second group: Set the split to 51-100.