[EXTDAM-335] S3: Timeout error obtaining the region of the bucket Created: 18/Jan/22 Updated: 25/Jan/22 Resolved: 24/Jan/22 |
|
| Status: | Closed |
| Project: | External DAMs |
| Component/s: | s3 |
| Affects Version/s: | 1.2.0 |
| Fix Version/s: | 1.2.0 |
| Type: | Bug | Priority: | Neutral |
| Reporter: | Matt Rajkovic | Assignee: | Jesus Alonso |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Attachments: |
|
||||||||
| Issue Links: |
|
||||||||
| Template: |
|
||||||||
| Acceptance criteria: |
Empty
|
||||||||
| Task DoD: |
[ ]*
Doc/release notes changes? Comment present?
[ ]*
Downstream builds green?
[ ]*
Solution information and context easily available?
[ ]*
Tests
[ ]*
FixVersion filled and not yet released
[ ] 
Architecture Decision Record (ADR)
|
||||||||
| Bug DoR: |
[ ]*
Steps to reproduce, expected, and actual results filled
[ ]*
Affected version filled
|
||||||||
| Date of First Response: | |||||||||
| Epic Link: | Imaging and External DAM | ||||||||
| Sprint: | AuthorX 1 | ||||||||
| Story Points: | 3 | ||||||||
| Description |
Original title:Creating a folder inside a folder takes very long and throws an S3 exception HOW TO REPRODUCE:
EXPECTEDA child folder under the selected folder is created instantly. ACTUALAdmincentral hangs and an S3 exception is thrown in the logs. After a while, the action completes and a folder is created, but it takes very long to complete the action. Similar behaviour is seen with deleting parent folders: https://www.loom.com/share/863a2ea3d912462bbee9d48de9f5aef9 Likely related to: https://jira.magnolia-cms.com/browse/EXTDAM-336
|
| Comments |
| Comment by Matt Rajkovic [ 18/Jan/22 ] |
|
Issue has been discovered in a call with Domestic and General from 18.01.2022. Notes: https://wiki.magnolia-cms.com/pages/viewpage.action?pageId=254542375 Slack thread: https://magnolia-cms.slack.com/archives/CDGDQ4Y4E/p1642500147055700 |
| Comment by Jesus Alonso [ 21/Jan/22 ] |
|
After adding some logs, it turned out the issue error happened refreshing the context, not creating the folder.
Gecko/20100101 Firefox/96.0, environmentId=mgnlctl-e2e, requesturi=/.magnolia/admincentral/UIDL/}: Creating folder 110 in S3Folder{dam.pt7z1bygr5xf19gv.beta.de.magnolia-cloud.com/1/}
2022-01-20 15:30:34,312 INFO [http-nio-8080-exec-8] nolia.external.dam.s3.app.action.AddS3FolderAction {Referer=https://author-pt7z1bygr5xf19gv.beta.de.magnolia-cloud.com/.magnolia/admincentral, Remote-Host=47.62.0.8, SessionId=E7619B65EF3295B8E668DD56DE840A02, User-Agent=Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:96.0) Gecko/20100101 Firefox/96.0, environmentId=mgnlctl-e2e, requesturi=/.magnolia/admincentral/UIDL/}: Folder 110 created
2022-01-20 15:30:34,313 INFO [http-nio-8080-exec-8] nolia.external.dam.s3.app.action.AddS3FolderAction {Referer=https://author-pt7z1bygr5xf19gv.beta.de.magnolia-cloud.com/.magnolia/admincentral, Remote-Host=47.62.0.8, SessionId=E7619B65EF3295B8E668DD56DE840A02, User-Agent=Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:96.0) Gecko/20100101 Firefox/96.0, environmentId=mgnlctl-e2e, requesturi=/.magnolia/admincentral/UIDL/}: datasourceObservation triggered
2022-01-20 15:31:15,818 ERROR [http-nio-8080-exec-8] info.magnolia.ui.framework.ContextProperty$Impl {Referer=https://author-pt7z1bygr5xf19gv.beta.de.magnolia-cloud.com/.magnolia/admincentral, Remote-Host=47.62.0.8, SessionId=E7619B65EF3295B8E668DD56DE840A02, User-Agent=Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:96.0) Gecko/20100101 Firefox/96.0, environmentId=mgnlctl-e2e, requesturi=/.magnolia/admincentral/UIDL/}: Failed to update context property value
Notice there is a delay of almost 40s between datasourceObservation & the error. This error was being caused when trying to obtain the aws region of corresponding bucket. For some unknown reason, this API request stopped working since 17th January. We don't have a clear explanation for the error, but we have developed a solution to avoid the request adding the AWS Region, which is know when the server starts, into the region's cache. |
| Comment by Jesus Alonso [ 24/Jan/22 ] |
|
Code updated in s3-cloud to put in the new AwsRegionCache the region configured for the bucket in the micro profile |