Skip to main content
K
kpara3-2
New Participant
May 27, 2014
Solved

A/B Testing in Email Analysis

  • May 27, 2014
  • 6 replies
  • 2585 views
Good morning,

I am excited about all the new features in May! This is one I can't figure out where to find...

A/B Test Emails in Email Analysis

Report on each of your A/B test email variants in Email Analysis.

Has anyone tried this yet?
This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by

In the Smart List builder, if you add the "Opened Email" or "Clicked Link in Email" filters, you can then add a Constraint of "Test Variant".


In order to select a Variant, you must select the specific Email that you sent with an A/B test - it will not work if you say email sent, Is Any.

Email Performance reports still report the total number of Sends / Opens / Clicks of an Email, and do not break it down by the different test Variants.

6 replies

P
PhillipWi1
New Participant
June 17, 2015

Hi Sarah

That's exactly how you should be doing it. The only thing I can think of is that you've selected the wrong email.

Sorry, I know that's probably not super helpful!

Phil

P
PhillipWi1
New Participant
January 29, 2015
Agreed on all the above guys - but good to know it can be done, at least in a roundabout way.

How it really should work is that you can see analytics just like any other email, for both A and B variants - whether that's overall clicks and opens, or link performance, or whatever. If I'm running an A/B test on content, often I'm looking for particular link performance - not total clicks. Current functionality makes it very difficult to do this, unless I set a custom conversion target at setup, which is limiting.
    A
    Anonymous
    May 30, 2014
    That would be so helpful to get analytics for overall A/B testing rather than have to record it on an instance by instance basis.
    K
    kpara3-2Author
    New Participant
    May 27, 2014
    Awww I was hoping it was for email performance reports. Thanks, Kyle!
    A
    Anonymous
    Accepted solution
    May 27, 2014

    In the Smart List builder, if you add the "Opened Email" or "Clicked Link in Email" filters, you can then add a Constraint of "Test Variant".


    In order to select a Variant, you must select the specific Email that you sent with an A/B test - it will not work if you say email sent, Is Any.

    Email Performance reports still report the total number of Sends / Opens / Clicks of an Email, and do not break it down by the different test Variants.

      A
      Anonymous
      June 16, 2015

      Hi Kyle,

      I'm trying your approach to see the Sends, Opens and Clicks of my 3 test variants. However, in my Smart List when I choose "Was Sent Email" and select the email and then use the Test Variant constraint, it says "Email A, Email B, Email C, Email D" and I only have 3 variants...also, I tested just using Email A and it gave me the same results as the entire group of emails. Can you help clarify?

      Terms & ConditionsAccessibility statement

      Loading footer...