A/B test result and Email Performance report don't match | Community
Skip to main content
KanakoTone
KanakoTone
New Participant
January 14, 2016
Solved

A/B test result and Email Performance report don't match

  • January 14, 2016
  • 3 replies
  • 1981 views

Hi,

I ran the first Engagement Program today, and am very excited to see the result.

The first content is an email nested under the EP, and I set up A/B testing.

As I'm preparing the Email Performance report, I realized difference in # of open. (*Email Performance report is also nested under the EP. Smart List has a filter for members of this EP.)

This is what looks like on the dashboard on the local Email asset. The total number of open is 46.

While,the Email Performance report shows that the number of open is only 18.

Why are they different, and which one should I rely on?

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by KanakoTone

It seems like just a delay in Marketo. This morning, the numbers are matching correctly.

3 replies

KanakoTone
KanakoToneAuthorAccepted solution
New Participant
January 15, 2016

It seems like just a delay in Marketo. This morning, the numbers are matching correctly.

A
Anonymous
January 15, 2016

Do you have two campaigns for sending each email in the test? If yes, then you can set up a "campaign email performance"...

I was also struggling with different numbers depending on reports until I started using this report, I find it most useful.

Dory_Viscoglio
Dory_Viscoglio
New Participant
January 14, 2016

Hey Kanako, the email performance report likely isn't reporting on both the champion and challenger subject lines. I'd rely on the A/B test dashboard.

Terms & ConditionsAccessibility statement

Loading footer...