-
Improvement
-
Resolution: Fixed
-
Minor
-
None
-
-
Empty show more show less
-
Yes
-
Content Mngmt 04
-
1
- Label change from Uplift to MDE
- Description replaces "Uplift is the improvement (in %) you would like to achieve relative to the base conversion." with "Minimum Detectable Effect is the improvement (in %) you would like to detect relative to the base conversion."
Context
Feedback from Sandra:
- Our UI assumes an uplift, while MDE measures the relative change. If a variation performs worse than the original, there would be no uplift
- In addition, I believe that the description is not accurate. This metric does not relate to the improvement a user would like to achieve. Using the word “achieve” implies wishful thinking. Instead, it relates to the relative change in conversion rate a user would like to be able to detect. It is known as “Minimum Detectable Effect”
This is how Optimizely and AB Testy describe the Minimum Detectable Effect:
Optimizely
AB Tasty
See that they call it “Minimum Detectable Effect” and use the word “detect” in their explanation.
Acceptance criteria