a/b test had uneven delivery | Community
Skip to main content
Esena_Jackson
Esena_Jackson
New Participant
February 2, 2023
Question

a/b test had uneven delivery

  • February 2, 2023
  • 1 reply
  • 2763 views

I conducted an a/b test but I don't see how it could have been weighted to send 75% to one group and 25% to the other. Seems like that highly impacted by results toward the message that went to 75% of my group. Does anyone have insight into a/b setup and why my distribution is so uneven?

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

1 reply

Darshil_Shah1
Darshil_Shah1
Community Manager
February 2, 2023

Are you talking about the uneven deliveries of the test variants? If so, then this is quite unlikely as Marketo tries sending different variations to equal portions of the chosen Test Sample Size, but yes, if you have a small test audience, then you may see such numbers as Marketo would not be able to distribute evenly for the smaller test audience size. What are your test audience size (in terms of #) and the number of test variants?

Esena_Jackson
Esena_JacksonAuthor
New Participant
February 5, 2023

I'm pasting a screenshot of the dashboard below. I don't see a setting that would have influenced the delivery of a particular variant of the message.

Darshil_Shah1
Darshil_Shah1
Community Manager
February 6, 2023

Yes, you're correct, there isn't any setting that could be used to modify the send numbers for the test variants, if there were any such option present, then the test results would be skewed. Are you able to confirm if the number of deliveries for the AB test is accurate based on the sample size that you selected to receive the test emails?

Terms & ConditionsAccessibility statement

Loading footer...