Uploaded image for project: 'A/B Testing'
  1. A/B Testing
  2. ABTEST-451

Wording of Uplift description (Uplift vs. Minimum Detectable Effect)

XMLWordPrintable

    • Yes
    • Content Mngmt 04
    • 1

      • Label change from Uplift to MDE
      • Description replaces "Uplift is the improvement (in %) you would like to achieve relative to the base conversion." with "Minimum Detectable Effect is the improvement (in %) you would like to detect relative to the base conversion."
           

      Context

      Feedback from Sandra:

      • Our UI assumes an uplift, while MDE measures the relative change. If a variation performs worse than the original, there would be no uplift
      • In addition, I believe that the description is not accurate. This metric does not relate to the improvement a user would like to achieve. Using the word “achieve” implies wishful thinking. Instead, it relates to the relative change in conversion rate a user would like to be able to detect. It is known as “Minimum Detectable Effect”

      This is how Optimizely and AB Testy describe the Minimum Detectable Effect:

       Optimizely

      AB Tasty

      See that they call it “Minimum Detectable Effect” and use the word “detect” in their explanation.

        Acceptance criteria

              yen.lactue Yen Lac Tue
              ldelnevo Laura Delnevo
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved:

                  Task DoD

                    Estimated:
                    Original Estimate - Not Specified
                    Not Specified
                    Remaining:
                    Remaining Estimate - Not Specified
                    Not Specified
                    Logged:
                    Time Spent - 2.5h
                    2.5h