A/B testing level of confidence | Community
Skip to main content
Anonymous
July 31, 2016
Solved

A/B testing level of confidence

Hi,

Does anyone know what is the level of confidence by default? is it 80%? 90% or less?

also, can I control it somehow?

 

I really need to know in order to know how trustable is my test.

Thanks!

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
    nicolasw7824172
    nicolasw7824172Accepted solution
    Employee
    August 17, 2016

    Hi Ido,

     

    The level of confidence is calculated, not controllable, and there is no default value. We will suggest you make the decision once the confidence level reaches 95% or above. Generally speaking, the longer period of your test will bring more traffic and have a higher possibility of reaching a confidence level of 95% above. For more information about confidence level, please refer to the link below

    https://marketing.adobe.com/resources/help/en_US/target/target/c_confidence_level_and_confidence_interval.html

     

    Hope that helps.

     

    Best,

    Nic

    View reply

    1 reply

    nicolasw7824172
    nicolasw7824172Accepted solution
    Employee
    August 17, 2016

    Hi Ido,

     

    The level of confidence is calculated, not controllable, and there is no default value. We will suggest you make the decision once the confidence level reaches 95% or above. Generally speaking, the longer period of your test will bring more traffic and have a higher possibility of reaching a confidence level of 95% above. For more information about confidence level, please refer to the link below

    https://marketing.adobe.com/resources/help/en_US/target/target/c_confidence_level_and_confidence_interval.html

     

    Hope that helps.

     

    Best,

    Nic

    Translate
      Terms & ConditionsAccessibility statement

      Loading footer...