Uploaded image for project: 'A/B Testing'
  1. A/B Testing
  2. ABTEST-377

Create a running ABn Test on Travel

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Neutral Neutral
    • None
    • None
    • None
    • Add-Ons 54, Add-Ons 55, Add-Ons 56
    • 1

      Create running ABn Tests on Travel in order to accommodate the following scenarios:

       * scenario 1 (default): with the following settings: baseConversion: 10%, Uplift: 20%, confidenceRate: 85%, allocation: 100%, create a running test with 3 variants (A, B and C). Original page is travel/tour-type

          select one variant to be the winner and redirect traffic so that it has more than 11% of conversions

          select one variant to be the loser, and redirect less traffic than on the original variant (variant-A)

       * scenario 2:  keep the same settings/traffic as in the scenario A, but decrease the allocation to 50. Original page is  travel/destination

           this test should reach the significant results in double the time

       * scenario 3: keep the same settings/traffic as in the scenario A, but decrease the confidenceRate to 80%. Original page is 

      travel/tour

          this test should reach the significant results faster than the test in scenario A, observe the estimated running time

       * scenario 4: keep the same settings/traffic as in the scenario A, but restrict the test to only one segment. Original page is 

      travel/about

         in the traffic generator, find a way to signal that some traffic is coming from the segment group (e.g.: cookie, header_param), and see that the test is reaching significant results slower than in scenario-A

         

        Acceptance criteria

              chuong.doan Chuong Doan Huy
              ldelnevo Laura Delnevo
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved:

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - Not Specified
                  Not Specified
                  Logged:
                  Time Spent - 3d 2.5h
                  3d 2.5h