A/B Test Day of Week | Community
Skip to main content
New Participant
March 1, 2022
Solved

A/B Test Day of Week

  • March 1, 2022
  • 1 reply
  • 4141 views

I just want to see if an email performs better on one day versus the next. Here is what I did: 

Will this send 50% on one day and 50% the next?

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by Katja_Keesom

Hi @darshil_shah1 , the DB size will not change, as the audience will be picked the moment the smart campaign is run and will not be evaluated again after the wait step. Your comment about the random samples being disconnected from eachother is totally true though, so this flow will indeed not work.

I would replace the third flow step with a remove from flow if the email was already sent and then send the email on day 2 to all people remaining in the flow.

1 reply

Darshil_Shah1
Community Manager
March 1, 2022

Random Sample will randomly pick 50% of the qualified leads and put them through the respective flow step (in your case Send email) - It is not guaranteed that the set of leads chosen randomly after a day's of wait step in flow step 3 would be mutually exclusive with the set of leads Marketo chose in the flow step -1 - you can remove people based on the email send activity prior to the next send the email send step from the campaign after a day's wait step.

If you're using Email Send program you may wanna use “Date/Time” A/B Testing

Katja_Keesom
Katja_KeesomAccepted solution
Community Manager
March 1, 2022

Hi @darshil_shah1 , the DB size will not change, as the audience will be picked the moment the smart campaign is run and will not be evaluated again after the wait step. Your comment about the random samples being disconnected from eachother is totally true though, so this flow will indeed not work.

I would replace the third flow step with a remove from flow if the email was already sent and then send the email on day 2 to all people remaining in the flow.

Darshil_Shah1
Community Manager
March 1, 2022

Ahh, yes that is true - smh missed that! Thanks, @katja_keesom!