1220641 - Push to mirrors prefix is too greedy

Status: RESOLVED FIXED

(Release Engineering :: Release Automation: Other, defect)

Description

[Rail Aliiev [:rail]]

Attachment: slash.diff

05:37:30     INFO - ##### Running push-to-releases step.
05:37:30     INFO - #####
05:37:30     INFO - Running main action method: push_to_releases
05:37:30     INFO - Connecting to S3
05:37:30     INFO - Getting bucket net-mozaws-prod-delivery-firefox
05:37:30     INFO - Checking destination pub/firefox/releases/42.0 is empty
05:37:41    FATAL - Destination already exists with 26331 keys, aborting
05:37:41    FATAL - Running post_fatal callback...
05:37:41    FATAL - Exiting -1
program finished with exit code 255

pub/firefox/releases/42.0 matches pub/firefox/releases/42.0b1, pub/firefox/releases/42.0b2, etc, etc

Adding a trailing slash resolves the issue.

The batch should also address a possible build2 vs build29 issue. :P

Comment 1

[Justin Wood (:Callek)]

Comment on attachment 8681947 [details] [diff] [review]
slash.diff

Review of attachment 8681947 [details] [diff] [review]:
-----------------------------------------------------------------

Please also patch antivirus: 
https://dxr.mozilla.org/mozilla-central/search?q=_get_candidates_prefix&redirect=false&case=true

(I'm stealing from nick to avoid the timezone delay in this patch)

Comment 2

[Rail Aliiev [:rail]]

I tested this patch by running it twice to push 42.0.

Comment 3

[Rail Aliiev [:rail]]

(In reply to Justin Wood (:Callek) from comment #1)
> Comment on attachment 8681947 [details] [diff] [review]
> slash.diff
> 
> Review of attachment 8681947 [details] [diff] [review]:
> -----------------------------------------------------------------
> 
> Please also patch antivirus: 
> https://dxr.mozilla.org/mozilla-central/
> search?q=_get_candidates_prefix&redirect=false&case=true
> 
> (I'm stealing from nick to avoid the timezone delay in this patch)

ooooh, good point. Let me combine the patches.

Comment 4

[Rail Aliiev [:rail]]

Attachment: slash2.diff

Comment 5

[Rail Aliiev [:rail]]

Comment on attachment 8681960 [details] [diff] [review]
slash2.diff

https://hg.mozilla.org/integration/mozilla-inbound/rev/f7c9752aeaf6

Comment 6

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/f7c9752aeaf6

Comment 7

[Rail Aliiev [:rail]]

Comment on attachment 8681960 [details] [diff] [review]
slash2.diff

This change is a part of release automation and doesn't affect the product.

Comment 8

[Rail Aliiev [:rail]]

reopening  to keep it on my radar

Comment 9

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/releases/mozilla-b2g44_v2_5/rev/f7c9752aeaf6

Comment 10

[Ritu Kothari (:ritu) (Inactive, please n-i to RyanVM, jcristau, or pascal)]

Comment on attachment 8681960 [details] [diff] [review]
slash2.diff

Since this is a releng fix, approving for uplift to all branches.

Comment 11

[Ritu Kothari (:ritu) (Inactive, please n-i to RyanVM, jcristau, or pascal)]

Tomcat, Wes: I wasn't sure if this one would show up in your to-uplift queries as status-ffXX is not set. N-I'ing you just in case it does not.

Comment 12

[Rail Aliiev [:rail]]

I was going to land the fixes myself.

Comment 13

[Carsten Book [:Tomcat]]

(In reply to Rail Aliiev [:rail] from comment #12)
> I was going to land the fixes myself.

Rail, feel free to ping us when we should land this, otherwise you can push this :)

Comment 14

[Rail Aliiev [:rail]]

https://hg.mozilla.org/releases/mozilla-aurora/rev/06971b5f1f6e
https://hg.mozilla.org/releases/mozilla-beta/rev/6a65996ee241
https://hg.mozilla.org/releases/mozilla-release/rev/e6da4b830557
https://hg.mozilla.org/releases/mozilla-esr38/rev/86c033f50d0f

Comment 15

[Nick Thomas [:nthomas] (UTC+12)]

rail, could you also land on the thunderbird verbranch in esr38. Unfortunately it's a kind of fork so we have to double land for automation fixes.

Comment 16

[Rail Aliiev [:rail]]

Sure, https://hg.mozilla.org/releases/mozilla-esr38/rev/bea414cb5af0

Comment 17

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/releases/mozilla-b2g44_v2_5/rev/06971b5f1f6e

Comment 18

[Nick Thomas [:nthomas] (UTC+12)]

Reopening for followup fix for antivirus, which broke for 43.0b2 build1 like so:

22:05:50     INFO - #####
22:05:50     INFO - ##### Running get-files step.
22:05:50     INFO - #####
22:05:50     INFO - Running main action method: get_files
22:05:50     INFO - Connecting to S3
22:05:50     INFO - Getting bucket net-mozaws-prod-delivery-firefox
22:05:51     INFO - Getting key names from candidates
22:05:52    FATAL - Uncaught exception: Traceback (most recent call last):
22:05:52    FATAL -   File "/builds/slave/rel-m-beta-av-0000000000000000/scripts/mozharness/base/script.py", line 1698, in run
22:05:52    FATAL -     self.run_action(action)
22:05:52    FATAL -   File "/builds/slave/rel-m-beta-av-0000000000000000/scripts/mozharness/base/script.py", line 1640, in run_action
22:05:52    FATAL -     self._possibly_run_method(method_name, error_if_missing=True)
22:05:52    FATAL -   File "/builds/slave/rel-m-beta-av-0000000000000000/scripts/mozharness/base/script.py", line 1581, in _possibly_run_method
22:05:52    FATAL -     return getattr(self, method_name)()
22:05:52    FATAL -   File "scripts/scripts/release/antivirus.py", line 177, in get_files
22:05:52    FATAL -     pool.map(worker, find_release_files())
22:05:52    FATAL -   File "/tools/python27/lib/python2.7/multiprocessing/pool.py", line 227, in map
22:05:52    FATAL -     return self.map_async(func, iterable, chunksize).get()
22:05:52    FATAL -   File "/tools/python27/lib/python2.7/multiprocessing/pool.py", line 280, in map_async
22:05:52    FATAL -     iterable = list(iterable)
22:05:52    FATAL -   File "scripts/scripts/release/antivirus.py", line 173, in find_release_files
22:05:52    FATAL -     os.makedirs(dest_dir)
22:05:52    FATAL -   File "/tools/python27/lib/python2.7/os.py", line 157, in makedirs
22:05:52    FATAL -     mkdir(name, mode)
22:05:52    FATAL - OSError: [Errno 2] No such file or directory: ''

Comment 19

[Nick Thomas [:nthomas] (UTC+12)]

Attachment: [gecko] Use os.path.join

Maybe this will teach me to use os.path.join() for everything (except urls).

Comment 20

[Rail Aliiev [:rail]]

Comment on attachment 8685305 [details] [diff] [review]
[gecko] Use os.path.join

Stealing this

Comment 21

[Pulsebot]

https://hg.mozilla.org/integration/mozilla-inbound/rev/fbaf2ce77cf4

Comment 22

[Rail Aliiev [:rail]]

Comment on attachment 8685305 [details] [diff] [review]
[gecko] Use os.path.join

https://hg.mozilla.org/integration/mozilla-inbound/rev/fbaf2ce77cf4

Comment 23

[Rail Aliiev [:rail]]

Comment on attachment 8685305 [details] [diff] [review]
[gecko] Use os.path.join

This change is a part of release automation and doesn't affect the product.

Comment 24

[Jordan Lund (:jlund)]

in addition to(In reply to Nick Thomas [:nthomas] from comment #18)
> Reopening for followup fix for antivirus, which broke for 43.0b2 build1 like

in addition to rail reviewing this, he also got a loaner and manually ran av.

Comment 25

[Liz Henry (:lizzard Please n-i to RyanVM, jcristau, or pascal)]

Comment on attachment 8685305 [details] [diff] [review]
[gecko] Use os.path.join

Doesn't affect the product, you can land without approval.

Comment 26

[Carsten Book [:Tomcat]]

(In reply to Liz Henry (:lizzard) (needinfo? me) from comment #25)
> Comment on attachment 8685305 [details] [diff] [review]
> [gecko] Use os.path.join
> 
> Doesn't affect the product, you can land without approval.

rail: do you want to push fix or do you need sheriff assistance ?

Comment 27

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/fbaf2ce77cf4

Comment 28

[Rail Aliiev [:rail]]

I'll land them, don't worry.

Comment 29

[Rail Aliiev [:rail]]

Comment on attachment 8685305 [details] [diff] [review]
[gecko] Use os.path.join

https://hg.mozilla.org/releases/mozilla-aurora/rev/d5b408ced8ce
https://hg.mozilla.org/releases/mozilla-beta/rev/9669bc030ba7
https://hg.mozilla.org/releases/mozilla-esr38/rev/4f43f0626dd8

Comment 30

[Rail Aliiev [:rail]]

and release:
https://hg.mozilla.org/releases/mozilla-release/rev/fa829a9c6898

Comment 31

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/releases/mozilla-b2g44_v2_5/rev/d5b408ced8ce

Comment 32

[Nick Thomas [:nthomas] (UTC+12)]

Landed on THUNDERBIRD_38_VERBRANCH because Thunderbird 38.4.0 build3 a/v failed:
https://hg.mozilla.org/releases/mozilla-esr38/rev/c19844a38295

Comment 33

[Firefox Bug Husbandry Bot]

Removing leave-open keyword from resolved bugs, per :sylvestre.