1657121 - Objects uploaded to the S3 bucket http://gecko-docs.mozilla.org-l1.s3-website.us-west-2.amazonaws.com/<UUID> gets deleted everytime a new UUID is generated

Status: RESOLVED FIXED

(Developer Infrastructure :: Source Documentation, defect)

Description

[Emil Farisan]

User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:79.0) Gecko/20100101 Firefox/79.0

Comment 1

[Emil Farisan]

Everytime the Doc-upload task is ran, doc files are uploaded to S3 and the unique link to the s3 upload can be accessed in an artifact generated by the task. Everytime there is a new unique link generated, the uploaded object from the old link seems to get deleted eventhough it hasnt pass the expiry period for the object. This is noticed on task ran by reviewbot.

Comment 2

[Andrew Halberstadt [:ahal]]

There is a function that removes untracked files:
https://searchfox.org/mozilla-central/source/tools/moztreedocs/upload.py#107

Though it's only supposed to look in the current key_prefix. Is it possible the UUID's aren't part of the key_prefix being passed in here? If not, we should fix it so they are added.

Comment 3

[Sylvestre Ledru [:Sylvestre]]

Emil, could you please take care of that asap? thanks

Comment 4

[Emil Farisan]

okay, will take a look at it

Comment 5

[Emil Farisan]

Attachment: Bug 1657121 - exclude uuid from s3_delete_missing. r=sylvestre,ahal

Comment 6

[Emil Farisan]

Attachment: Bug 1657121 - exclude uuid from s3_delete_missing. r=sylvestre,ahal

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/fb502b2ec611
exclude uuid from s3_delete_missing. r=ahal

Comment 8

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/fb502b2ec611