Where to find Standard Error in Adobe Target results? | Community
Skip to main content
emmak109
Level 3
August 10, 2023
Solved

Where to find Standard Error in Adobe Target results?

I am trying to locate the standard deviation calculated for an A/B test variants? Where can I find those in the reports?

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
    PratheepArunRaj
    PratheepArunRajAccepted solution
    New Participant
    August 14, 2023

    Dear @emmak109 ,

    Ignore the UI, calculations are still the same. Did you go through the link shared?

    The link had an option to perform the calculations offline (Attached here) and can be used. See whether it is useful to you.

    Thank You, Pratheep Arun Raj B (Arun) | NextRow Digital | Terryn Winter Analytics

    View reply

    9 replies

    PratheepArunRaj
    PratheepArunRaj
    New Participant
    August 14, 2023

    Dear Emma,

    Standard Deviation is not a direct metric in Target Activities for consumption.

    Deviations are used to calculate the Confidence Level. Calculations for A/B/n activities are here.

    Thank You, Pratheep Arun Raj B (Arun) | NextRow Digital | Terryn Winter Analytics

    Translate
      emmak109Author
      Level 3
      August 14, 2023

      Oh no! The link you shared looks so different from the current UI of Adobe Target. The only range I see in the current UI is 'range of Lift (Low, Middle, High)' - which is usually the difference in the KPI I am measuring. To be able to make correct interpretation of the test results (not just on the basis of Confidence - p values or Lift range), I need to see how much variation occurs in the normal distribution of KPI in both Control and Treatment groups. The reason I am asking this is data looks flaky to me - we have 97% confidence (0.03 pvalue) despite of extremely high range in lift (from negative: -78 to positive: 13). I need to find answer to this and that is why I wanted to look at the confidence interval range for the KPI I am using for this test. If it is not available in Adobe Target, then what workaround do you suggest?

      Translate
        PratheepArunRaj
        PratheepArunRajAccepted solution
        New Participant
        August 14, 2023

        Dear @emmak109 ,

        Ignore the UI, calculations are still the same. Did you go through the link shared?

        The link had an option to perform the calculations offline (Attached here) and can be used. See whether it is useful to you.

        Thank You, Pratheep Arun Raj B (Arun) | NextRow Digital | Terryn Winter Analytics

        Translate
          Terms & ConditionsAccessibility statement

          Loading footer...