[ABTEST-277] Cannot complete test which has no winning variant Created: 20/Aug/20  Updated: 17/Sep/20  Resolved: 27/Aug/20

Status: Closed
Project: A/B Testing
Component/s: None
Affects Version/s: None
Fix Version/s: 1.0

Type: Bug Priority: Neutral
Reporter: Nguyen Phung Chi Assignee: Nguyen Phung Chi
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: 0d
Time Spent: 2d 1h
Original Estimate: Not Specified

Attachments: PNG File Admincentral - Magnolia 2020-08-20 14-25-23.png     Text File Exception on complete test.log    
Template:
Acceptance criteria:
Empty
Task DoD:
[ ]* Doc/release notes changes? Comment present?
[ ]* Downstream builds green?
[ ]* Solution information and context easily available?
[ ]* Tests
[ ]* FixVersion filled and not yet released
[ ]  Architecture Decision Record (ADR)
Bug DoR:
[ ]* Steps to reproduce, expected, and actual results filled
[ ]* Affected version filled
Epic Link: ABTEST MVP
Sprint: Add-Ons 45
Story Points: 3

 Description   

Steps to reproduce:

  1. Create and start a test
  2. Create a dummy test result in Dynamo (can duplicate an item with testId "6b48cf81-68f5-4244-b06a-35fb0c04cd94" in table "ab-testing-timeline", then change the testId and variantId to match with your test)
  3. May need to restart instance to clear the cache test result, or disable the caching in Resources "/ab-testing/decorations/addon-commons-cache/config.yaml" 
  4. Open the test and click on "Complete test" button

Actual result:

  • Exception thrown and Complete test dialog couldn't open also (see screenshot and exception log)

Expected result:

  • Complete test dialog appear and be able to complete the test

Dev hint:

  • The exception is thrown when building the Complete test dialog and there are some state of the test result need to be render in the UI.
  • The test id "n/a" comes from StatsEngine#Result#NO_WINNING_VARIANT
    • public static final TestVariant NO_WINNING_VARIANT = new TestVariant("n/a", "No Winning Variant");

 


Generated at Sun Feb 11 22:54:39 CET 2024 using Jira 9.4.2#940002-sha1:46d1a51de284217efdcb32434eab47a99af2938b.