Uploaded image for project: 'Usage Metrics'
  1. Usage Metrics
  2. UMETRICS-30

Manage the lifecycle of the index

    XMLWordPrintable

Details

    • Task
    • Resolution: Done
    • Neutral
    • None
    • None
    • server
    • None

    Description

      Every day, usage metrics reports from Magnolia instances are sent to our AWS-managed ES server. This has been the case for months, and the problem is that at no point does the data come out. It is only a matter of time before this introduces larger problems (index health, Kibana responsiveness, disk space, billing).

      Kibana comes with a builtin tool to rotate the data. However, that feature is not available on the open-source version that AWS runs for us. This ticket is about researching and implementing:

      • having the data automatically split into monthly indexes such as: magnolia-2020-01, magnolia-2020-06, magnolia-2021-12, etc.
      • backing up older quarters, where? this might actually not bring any performance benefits once indexes are split
      • not losing any data

      Resources:

      Checklists

        Acceptance criteria

        Attachments

          Activity

            People

              mmichel Maxime Michel
              mmichel Maxime Michel
              Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Checklists

                  Task DoR