Engagement Programs - A/B Testing | Community
Skip to main content
Andrea_Lechner
New Participant
July 1, 2013
Solved

Engagement Programs - A/B Testing

  • July 1, 2013
  • 12 replies
  • 3598 views
How is the best way to incorporate A/B email testing within the Engagement Module?

The best solution I can figure out is to direct that email to a program's smart campaign and let the smart campaign do the 50/50 email split testing.

Am I missing a better way?  Thx, Andrea
This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by
That is exactly how you will do it!

12 replies

March 1, 2016

I believe this information is well out of date and this discussion should redirect people to read - https://nation.marketo.com/message/117630#comment-117630 

September 16, 2013
Do you have the campaign in a program? It has to be in a program to be added to the stream, and only one per program. So if you need to make 9 different campaigns to do A/B testing on 18 different emails, you need to make 9 different programs.

Also, check and make sure that the smart campaign criteria (smart list) is something that will pull the leads in (ex: member of engagement program: prospects, stream: early).

Then be sure and activate the program in the stream.

Hope this helps!
September 16, 2013
Ok so I scheduled the AB test campaign to run once (because I have no clue how to properly set it so that I can add it to an engagement stream).

That did not work--I still cannot add it to the engagement stream.

Then I cloned the campaign and set it up to run a recurrent schedule of 'daily'--that did not work either--I cannot add it to the stream.

Can someone please tell me what I'm doing wrong here? I cannot find any clear documentation. My first email in a series of 9 that I'm trying to build this stream for is my AB test. If I can't get the first one in there, then I can't get the remaining 8, and I still have to test to see if this even works!! HELP!!
September 12, 2013
I've created a smart campaign as you described above and have a flow step to split test an email. 

How am I supposed to add this to the stream? I tried to drag it and add it through choosing the program but can do neither. I don't understand how to do this?
--do I schedule the campaign and then add it? If so, what schedule to do I set it to if I want it to run on the stream cadence I've set for the engagement program?
--do I activate all of the content on the stream in order to activate the program so that the unscheduled smart campaign will appear as a choice?
--does my smart campaign have to have a trigger instead of a filter in the smart list criteria? If so, what trigger should I use?

Thanks for your help.
September 9, 2013
Is there a way to test A/B programs with the "Test Stream" functionality?  It runs though emails just fine, but when it hits a program's A/B smart campaign I get the following in the results tab: 'Do Nothing' was set for this choice, 1 leads skipped
August 28, 2013
You cannot pull 2 campaigns from the same program into a stream.  To do the AB Test, you would need to use a single campaign, with random sample in Add Choice.
August 28, 2013
It looks like if you try to use two smart campaigns from the same program, it rejects it and says it's duplicate. Do we need a program for each smart campaign to go into the stream?
August 26, 2013
Hi Emily, I just drag the campaign over from the left-hand tree and, VOILA!  Everything is done from there... you'll see the program in the stream.  So, just activate and you're good.
August 26, 2013
What's the best way to reference the program name within the stream since the A/B testing smart camaign isn't activated? 
August 9, 2013
Yes, and this program is referenced on the stream.