Uploaded image for project: 'A/B Testing'
  1. A/B Testing
  2. ABTEST-277

Cannot complete test which has no winning variant

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Neutral
    • 1.0
    • None
    • None

    Description

      Steps to reproduce:

      1. Create and start a test
      2. Create a dummy test result in Dynamo (can duplicate an item with testId "6b48cf81-68f5-4244-b06a-35fb0c04cd94" in table "ab-testing-timeline", then change the testId and variantId to match with your test)
      3. May need to restart instance to clear the cache test result, or disable the caching in Resources "/ab-testing/decorations/addon-commons-cache/config.yaml" 
      4. Open the test and click on "Complete test" button

      Actual result:

      • Exception thrown and Complete test dialog couldn't open also (see screenshot and exception log)

      Expected result:

      • Complete test dialog appear and be able to complete the test

      Dev hint:

      • The exception is thrown when building the Complete test dialog and there are some state of the test result need to be render in the UI.
      • The test id "n/a" comes from StatsEngine#Result#NO_WINNING_VARIANT
        • public static final TestVariant NO_WINNING_VARIANT = new TestVariant("n/a", "No Winning Variant");

       

      Checklists

        Acceptance criteria

        Attachments

          Activity

            People

              nguyen.phung Nguyen Phung Chi
              nguyen.phung Nguyen Phung Chi
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Checklists

                  Bug DoR
                  Task DoD

                  Time Tracking

                    Estimated:
                    Original Estimate - Not Specified
                    Not Specified
                    Remaining:
                    Remaining Estimate - 0d
                    0d
                    Logged:
                    Time Spent - 2d 1h
                    2d 1h