[MAGNOLIA-5216] Provide Integration Test for comparing screenshots of pages Created: 02/Aug/13  Updated: 11/Jul/19  Resolved: 11/Jul/19

Status: Closed
Project: Magnolia
Component/s: integration tests
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Neutral
Reporter: Roman Kovařík Assignee: Roman Kovařík
Resolution: Won't Do Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: PNG File demo-project_author.png     PNG File demo-project_public.png    
Issue Links:
dependency
relation
is related to MAGNOLIA-5245 New location for sample screenshots Open
Template:
Acceptance criteria:
Empty
Task DoR:
Empty
Date of First Response:

 Description   

We often introduce bugs when the layout of pages was unintentionally changed (MAGNOLIA-5029 -> MAGNOLIA-5132) or the dialogs were broken due to changes in javascript (MAGNOLIA-4829 -> MAGNOLIA-4895). We should avoid this by comparing sample screenshot with current ones. This will also automate page rendering/layout QA.

  • If the layout will be changed intentionally (and this should be not so often), new samples will be uploaded.
  • To avoid fail due to changes in colors the screenshots will be compared as black&white images.
  • We should be able to set threshold (% of wrong pixels) which will be acceptable to avoid problems with minor changes in layout.


 Comments   
Comment by Roman Kovařík [ 13/Aug/13 ]

The screenshots from author and public instance are not same, see extra lines on demo-project page ( demo-project_author.png ), compare with public (demo-project_public.png). Download the images to view them in full resolution.
These images were taken on http://hudson.magnolia-cms.com/view/X/job/magnolia-bundle_5.0.x-with-selenium_profile/

Comment by Jan Haderka [ 21/Aug/13 ]

Please create the concept page describing exactly what and how will be done. This will also need to be done in a separate project so only those who need to execute such tests (hudson mainly and ppl fixing issues found) have to download all image data.
Thx.

Comment by Roman Kovařík [ 30/Aug/13 ]

Concept page: http://wiki.magnolia-cms.com/display/DEV/Comparing+screenshots+of+pages

Comment by Roman Kovařík [ 05/Dec/13 ]

All changes reverted until concept will be

  • approved
  • OR rejected (and this ticket can be closed as outdated)
Generated at Mon Feb 12 04:03:04 CET 2024 using Jira 9.4.2#940002-sha1:46d1a51de284217efdcb32434eab47a99af2938b.