A/B Testing Configuration Components

To create a B2C Commerce A/B test, configure settings for participants, segments, related segment experiences, and key metrics.

These configuration components determine how an A/B test runs and how B2C Commerce measures its outcome.

• Participants: the customer groups and expiration policies that define who's included in a test.
• Segments: the variations of a promotion, sorting rule, or experience shown to participants, including the control group.
• Rank precedence: the priority a test's promotions take when multiple promotions could apply at the same time.
• Key metrics: the measurement, such as conversion rate or revenue, that determines which segment performs best.

• A/B Test Participants for B2C Commerce
  A/B tests always include participants who are defined by customer groups and expiration policies.
• A/B Test Segments for B2C Commerce
  Distribute test segments across a maximum of 12 simultaneous A/B tests, as long as the total segments for all active tests don’t exceed 12. Each A/B test can have up to five unique test segments, one of which is always the control group. Each test segment targets a portion of the total test participants. The control group receives the same storefront experience as if the A/B test didn’t exist.
• A/B Test Rank Precedence for B2C Commerce
  B2C Commerce uses rank to control precedence when you configure multiple promotions to apply at the same time. To determine A/B test promotion rank precedence, choose a number from 10 as set by B2C Commerce; you can configure these system objects without a rank (NONE) is considered the lowest rank and evaluated last. Test promotions apply in the order of lowest rank value to highest rank value.
• A/B Test Key Metrics for B2C Commerce
  An A/B test configuration requires you to specify the key metric, which is the most important measurement among the metrics collected from test participant activity.