Not able to publish huge amount of items in timely fashion (PUBLISHING-202)

[PUBLISHING-229] QA on 6.3 content app Created: 11/Apr/23  Updated: 13/Apr/23  Resolved: 13/Apr/23

Status: Completed
Project: Publishing
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Sub-task Priority: Neutral
Reporter: Roman Kovařík Assignee: Daniel Alonso
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Template:
Date of First Response:
Sprint: Nucleus 33, Nucleus 34
Team: Nucleus

 Description   
  1. Download https://magnolia-cms.slack.com/archives/C0508AK5U9W/p1679496703783599
  2. Use the light modules, e.g.magnolia.resources.dir=/Users/romankovarik/Downloads/pg-debug/volumes/mgnl-author/modules on both author and public instance
  3. Import /Users/romankovarik/Downloads/pg-debug/caring.com.20230315.xml into Locale app
  4. Use script from https://git.magnolia-cms.com/projects/DOCUMENTATION/repos/product-docs/pull-requests/1519/diff#modules/ROOT/partials/i/_Known-issues.adoc to convert flat to tree structure, use 95 for the folder size. The script might fail as the imported items might not be indexed yet (dalonso I believe this is the issue we ran into)
  5. Publish caring.com recursively
  6. You should get log statement only per folder instead of each item (about ~300 statements)
  7. Observe time
  8. Optionally:
  9. Compare with publishing from JCR browser (without itemPerRequest)
  10. You should get log statements per item (more then 30 000 statements)
  11. Compare time with publishing from the content app.

Generated at Mon Feb 12 10:36:34 CET 2024 using Jira 9.4.2#940002-sha1:46d1a51de284217efdcb32434eab47a99af2938b.