[ABTEST-502] Implement monitoring to understand usage of ABn tests Created: 24/Jun/21  Updated: 26/Aug/22

Status: Open
Project: A/B Testing
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Neutral
Reporter: Michael Duerig Assignee: Unassigned
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Template:
Acceptance criteria:
Empty
Task DoR:
Empty
Epic Link: ABn Later
Team: AuthorX

 Description   

We should implement monitoring to understand usage, dynamics and struggles of our customer with running ABn tests. Such monitoring could / should include:

  • Mean/median time for tests to conclude
  • Speed of convergence of running tests
  • Rate of abortion of tests by users
  • Statistics on conversions rates
  • ...?

The goal is to better understand what our users do with ABn testing, where they struggle and what could be improved in future versions.

See also this thread on Slack.


Generated at Sun Feb 11 22:56:52 CET 2024 using Jira 9.4.2#940002-sha1:46d1a51de284217efdcb32434eab47a99af2938b.