[MGNLTEST-461] Research: Consider improving DefinitionsProblemsFinder white-list-API Created: 14/Nov/23  Updated: 16/Jan/24

Status: Selected
Project: Magnolia Test Framework
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Neutral
Reporter: Christoph Meier Assignee: Unassigned
Resolution: Unresolved Votes: 0
Labels: UoE:TECH, UoE:Testing-Setup_Enabler, dx-core-6.3, extension-unification
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: PNG File DefinitionProblems-sameDetail-diffTitle.png     PNG File DefinitionProblems-sameDetails-diffPath-1.png    
Template:
Acceptance criteria:
Empty
Task DoR:
Empty
Date of First Response:
Epic Link: UoE - Enabler Tasks for Incubator Testing Setup
Work Started:

 Description   

Currently the white-list of DefinitionsProblemsFinder is a (synchronized) List storing the "detail" property of a problem.

Quite often I have seen "cases" like this:

GIVEN a test checking for problem fails with 4 new problems.
WHEN adding 1 new entry to the white-list
THEN more than 1 problem disappear.

When need to check whether white-listing by detail-info only is sufficient.
For this we need to compare also what we see on the UI.
And at some point deeply analyze the problems ... note that a problem also has a "location".

Or with other words:
Can it happen that "2 real problems" - which must be seen as 2 problems - share the exact same detail message?

developer notes

If you find 2 problems with same "details" info but different location ... that implies that we likely should improve the API.
Find the differences of probelms with same detail.
Then discuss with Magnolia-experts



 Comments   
Comment by Harshini Pola [ 23/Nov/23 ]

In above attached screenshot we can see that the

  • path of the problem is different, even if the detail is same.
  • Title of the problem is different, even if the detail and path are same.
Generated at Mon Feb 12 07:49:11 CET 2024 using Jira 9.4.2#940002-sha1:46d1a51de284217efdcb32434eab47a99af2938b.