Uploaded image for project: 'A/B Testing'
  1. A/B Testing
  2. ABTEST-451

Wording of Uplift description (Uplift vs. Minimum Detectable Effect)

    XMLWordPrintable

Details

    • Yes
    • Content Mngmt 04
    • 1

    Description

      • Label change from Uplift to MDE
      • Description replaces "Uplift is the improvement (in %) you would like to achieve relative to the base conversion." with "Minimum Detectable Effect is the improvement (in %) you would like to detect relative to the base conversion."
           

      Context

      Feedback from Sandra:

      • Our UI assumes an uplift, while MDE measures the relative change. If a variation performs worse than the original, there would be no uplift
      • In addition, I believe that the description is not accurate. This metric does not relate to the improvement a user would like to achieve. Using the word “achieve” implies wishful thinking. Instead, it relates to the relative change in conversion rate a user would like to be able to detect. It is known as “Minimum Detectable Effect”

      This is how Optimizely and AB Testy describe the Minimum Detectable Effect:

       Optimizely

      AB Tasty

      See that they call it “Minimum Detectable Effect” and use the word “detect” in their explanation.

      Checklists

        Acceptance criteria

        Attachments

          Activity

            People

              yen.lactue Yen Lac Tue
              ldelnevo Laura Delnevo
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Checklists

                  Task DoD

                  Time Tracking

                    Estimated:
                    Original Estimate - Not Specified
                    Not Specified
                    Remaining:
                    Remaining Estimate - Not Specified
                    Not Specified
                    Logged:
                    Time Spent - 2.5h
                    2.5h