Uploaded image for project: 'External DAMs'
  1. External DAMs
  2. EXTDAM-46

S3: performance improvements

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Fixed
    • Icon: Neutral Neutral
    • 1.0
    • None
    • None
    • None
    • Add-Ons 31, Add-Ons 32, Add-Ons 33
    • 5

      Currently, S3 provider does 1 API call per folder, ignoring the keys not belonging on that folder. So for each bucket there is N calls to display the tree. However, it is possible to load all the assets and folders in one single API call. We will do so adding a children collection to S3Folder to store all the descendants. It is also needed to update the caching strategy.

      One additional improvement consists on adding a map of bucket-region in AmazonS3Gateway. Regions are inmutable and so we avoid doing extra calls for obtaining the region of a bucket. Moreover, as S3 is eventually consistent, when a bucket is created, there is a race condition that could raise an error if the new bucket has not yet been created in the default region. 

        Acceptance criteria

              jalonso Jesus Alonso
              ilgun Ilgun Ilgun
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved:

                  Task DoD

                    Estimated:
                    Original Estimate - Not Specified
                    Not Specified
                    Remaining:
                    Remaining Estimate - 0d
                    0d
                    Logged:
                    Time Spent - 1.25h
                    1.25h