Uploaded image for project: 'External DAMs'
  1. External DAMs
  2. EXTDAM-46

S3: performance improvements

    XMLWordPrintable

Details

    • Story
    • Resolution: Fixed
    • Neutral
    • 1.0
    • None
    • None
    • None
    • Add-Ons 31, Add-Ons 32, Add-Ons 33
    • 5

    Description

      Currently, S3 provider does 1 API call per folder, ignoring the keys not belonging on that folder. So for each bucket there is N calls to display the tree. However, it is possible to load all the assets and folders in one single API call. We will do so adding a children collection to S3Folder to store all the descendants. It is also needed to update the caching strategy.

      One additional improvement consists on adding a map of bucket-region in AmazonS3Gateway. Regions are inmutable and so we avoid doing extra calls for obtaining the region of a bucket. Moreover, as S3 is eventually consistent, when a bucket is created, there is a race condition that could raise an error if the new bucket has not yet been created in the default region. 

      Checklists

        Acceptance criteria

        Attachments

          Issue Links

            Activity

              People

                jalonso Jesus Alonso
                ilgun Ilgun Ilgun
                Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  Checklists

                    Task DoD

                    Time Tracking

                      Estimated:
                      Original Estimate - Not Specified
                      Not Specified
                      Remaining:
                      Remaining Estimate - 0d
                      0d
                      Logged:
                      Time Spent - 1.25h
                      1.25h