1543033 - Update verify config for win64-aarch64 errors due to file name mismatch

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Simon Fraser [:sfraser] ⌚️GMT]

From https://taskcluster-artifacts.net/Cg4M1XefTIWrN9u1F9ZmXg/0/public/logs/live_backing.log

[task 2019-04-08T14:24:25.797Z] 14:24:25 INFO - retry: Calling _urlopen with args: (), kwargs: {'url': 'https://archive.mozilla.org/pub/firefox/candidates/67.0b8-candidates/build2/win64_aarch64_info.txt'}, attempt #5
[task 2019-04-08T14:24:26.122Z] 14:24:26 INFO - retry: attempt #5 caught HTTPError exception: HTTP Error 404: Not Found
[task 2019-04-08T14:24:26.122Z] 14:24:26 INFO - [mozharness: 2019-04-08 14:24:26.122236Z] Finished gather-info step (failed)
[task 2019-04-08T14:24:26.122Z] 14:24:26 FATAL - Uncaught exception: Traceback (most recent call last):
[task 2019-04-08T14:24:26.122Z] 14:24:26 FATAL - File "/builds/worker/checkouts/gecko/testing/mozharness/mozharness/base/script.py", line 2089, in run
[task 2019-04-08T14:24:26.122Z] 14:24:26 FATAL - self.run_action(action)
[task 2019-04-08T14:24:26.122Z] 14:24:26 FATAL - File "/builds/worker/checkouts/gecko/testing/mozharness/mozharness/base/script.py", line 2028, in run_action
[task 2019-04-08T14:24:26.122Z] 14:24:26 FATAL - self._possibly_run_method(method_name, error_if_missing=True)
[task 2019-04-08T14:24:26.122Z] 14:24:26 FATAL - File "/builds/worker/checkouts/gecko/testing/mozharness/mozharness/base/script.py", line 1983, in _possibly_run_method
[task 2019-04-08T14:24:26.122Z] 14:24:26 FATAL - return getattr(self, method_name)()
[task 2019-04-08T14:24:26.122Z] 14:24:26 FATAL - File "testing/mozharness/scripts/release/update-verify-config-creator.py", line 340, in gather_info
[task 2019-04-08T14:24:26.122Z] 14:24:26 FATAL - self._get_update_paths()
[task 2019-04-08T14:24:26.122Z] 14:24:26 FATAL - File "testing/mozharness/scripts/release/update-verify-config-creator.py", line 304, in _get_update_paths
[task 2019-04-08T14:24:26.123Z] 14:24:26 FATAL - buildID = ret.read().split("=")[1].strip()
[task 2019-04-08T14:24:26.123Z] 14:24:26 FATAL - AttributeError: 'NoneType' object has no attribute 'read'
[task 2019-04-08T14:24:26.123Z] 14:24:26 FATAL - Running post_fatal callback...
[task 2019-04-08T14:24:26.123Z] 14:24:26 FATAL - Exiting -1

It appears as though the declarative artifacts manifest is using the stage_platform, win64-aarch64:
https://searchfox.org/mozilla-central/source/taskcluster/taskgraph/manifests/firefox_candidates.yml#162-169

but the previous manifest was explicitly setting it so that it used underscores in https://github.com/mozilla-releng/beetmoverscript/blob/master/beetmoverscript/templates/firefox_candidates.yml#L263-L267

Comment 1

[Simon Fraser [:sfraser] ⌚️GMT]

Changing https://searchfox.org/mozilla-central/source/python/mozrelease/mozrelease/platforms.py#41 would probably be simplest, and it keeps the format in line with other platform names, which use hyphens. What would be the follow-on effects of doing that?

Comment 2

[Simon Fraser [:sfraser] ⌚️GMT]

Have copied over 67.0b8 and b9 win64-aarch64_info.txt to win64_aarch64_info.txt so that both exist for the moment.

Comment 3

[Simon Fraser [:sfraser] ⌚️GMT]

For recording, I used the scriptworker credentials and a tiny bit of python (to avoid installing awscli)

import boto3
client = boto3.client('s3')
client.copy_object(Bucket='net-mozaws-prod-delivery-firefox', Key='pub/firefox/candidates/67.0b8-candidates/build1/win64_aarch64_info.txt', CopySource={'Bucket':'net-mozaws-prod-delivery-firefox','Key':'pub/firefox/candidates/67.0b8-candidates/build1/win64-aarch64_info.txt'})
... Repeat as needed

Comment 4

[Simon Fraser [:sfraser] ⌚️GMT]

Attachment: Bug 1543033 Fix pathing for win64_aarch64_info.txt r=mtabara

I've refactored the artifact map generation slightly to make the list
of platforms more flexible, and also to let us have the previous name for
win64_aarch64_info.txt.

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/c91bf0806ef7
Fix pathing for win64_aarch64_info.txt r=mtabara

Comment 6

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/c91bf0806ef7

Comment 7

[Simon Fraser [:sfraser] ⌚️GMT]

https://hg.mozilla.org/releases/mozilla-beta/rev/5d7fb687b031ae245635f5001f66ac5b5eb85429