1624369 - Port bug 1609174 - switch Thunderbird bouncer configs to nazgul

Status: RESOLVED FIXED

(Thunderbird :: Build Config, task, P1)

Description

[Rob Lemley [:rjl]]

Old bouncer is going away, Thunderbird is still using it.

• Create new Taskcluster configs and test in parallel with current configs
• Beta testing on Thunderbird 76
• Uplift to ESR68

Comment 1

[Rob Lemley [:rjl]]

Attachment: Port bug 1609174: Add nazgul bouncer configs

Port of D42171, D67887, and D67889.

Comment 2

[Rob Lemley [:rjl]]

Once bug 1609174 lands, this can proceed.

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/comm-central/rev/3c16add31ebc
Port bug 1609174: Add nazgul bouncer configs. r=darktrojan

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/comm-central/rev/7b54036ce7d6
Follow-up: Fix Treeherder symbol and set tier. rs=bustage-fix

Comment 5

[Rail Aliiev [:rail]]

https://firefoxci.taskcluster-artifacts.net/ORkABFkwTn2GHduLdCwwkQ/0/public/logs/live_backing.log

2020-04-01 09:07:25,895 - asyncio - DEBUG - Using selector: EpollSelector
2020-04-01 09:07:25,897 - bouncerscript.task - INFO - Action types: ['locations']
2020-04-01 09:07:25,898 - scriptworker.client - DEBUG - Task is validated against this schema: {'title': 'Taskcluster Bouncer locations task minimal schema', 'type': 'object', 'properties': {'dependencies': {'type': 'array', 'minItems': 1, 'uniqueItems': True, 'items': {'type': 'string'}}, 'scopes': {'type': 'array', 'minItems': 1, 'uniqueItems': True, 'items': {'type': 'string'}}, 'payload': {'type': 'object', 'properties': {'bouncer_products': {'type': 'array', 'minItems': 1, 'uniqueItems': True, 'items': {'type': 'string'}}, 'version': {'type': 'string', 'minItems': 1}, 'product': {'type': 'string', 'minItems': 1}}, 'required': ['bouncer_products', 'version', 'product'], 'additionalProperties': False}}, 'required': ['dependencies', 'scopes', 'payload']}
2020-04-01 09:07:25,899 - bouncerscript.task - INFO - Servers scopes: ['project:releng:bouncer:server:production-nazgul']
2020-04-01 09:07:25,900 - bouncerscript.task - INFO - Action types: ['locations']
2020-04-01 09:07:25,901 - bouncerscript.script - INFO - Preparing to update locations information in bouncer
2020-04-01 09:07:25,901 - bouncerscript.script - INFO - Sanity check bouncer products before updating ...
2020-04-01 09:07:25,901 - bouncerscript.script - INFO - All bouncer products look good before updating them!
2020-04-01 09:07:25,902 - bouncerscript.script - INFO - Sanity checking the version math makes sense ...
2020-04-01 09:07:25,902 - bouncerscript.script - INFO - In-tree version from payload looks good!
2020-04-01 09:07:25,902 - bouncerscript.script - INFO - Sanity check to ensure product exists...
2020-04-01 09:07:25,903 - bouncerscript.utils - INFO - Calling product_show?product=firefox-nightly-latest with data: {}
2020-04-01 09:07:25,903 - bouncerscript.utils - INFO - Performing a GET request to https://bounceradmin-default.prod.mozaws.net/api/product_show?product=firefox-nightly-latest with kwargs {'timeout': 60}
2020-04-01 09:07:26,060 - bouncerscript.utils - INFO - Server response: <?xml version="1.0" encoding="utf-8"?><products><product id="2005" name="firefox-nightly-latest"/></products>
2020-04-01 09:07:26,070 - bouncerscript.utils - INFO - Products found: 1
2020-04-01 09:07:26,071 - bouncerscript.utils - INFO - Calling location_show?product=firefox-nightly-latest with data: {}
2020-04-01 09:07:26,072 - bouncerscript.utils - INFO - Performing a GET request to https://bounceradmin-default.prod.mozaws.net/api/location_show?product=firefox-nightly-latest with kwargs {'timeout': 60}
2020-04-01 09:07:26,148 - bouncerscript.utils - INFO - Server response: <?xml version="1.0" encoding="utf-8"?><locations><product id="2005" name="firefox-nightly-latest"><location id="9379" os="win">/firefox/nightly/latest-mozilla-central-l10n/firefox-70.0a1.:lang.win32.installer.exe</location><location id="23647" os="linux">/firefox/nightly/latest-mozilla-central-l10n/firefox-70.0a1.:lang.linux-i686.tar.bz2</location><location id="23645" os="osx">/firefox/nightly/latest-mozilla-central-l10n/firefox-70.0a1.:lang.mac.dmg</location><location id="23646" os="linux64">/firefox/nightly/latest-mozilla-central-l10n/firefox-70.0a1.:lang.linux-x86_64.tar.bz2</location><location id="20140" os="win64">/firefox/nightly/latest-mozilla-central-l10n/firefox-70.0a1.:lang.win64.installer.exe</location><location id="51281" os="win64-aarch64">/firefox/nightly/latest-mozilla-central-l10n/firefox-70.0a1.:lang.win64-aarch64.installer.exe</location></product></locations>
2020-04-01 09:07:26,149 - bouncerscript.utils - DEBUG - Locations info: [{'os': 'win', 'id': '9379', 'path': '/firefox/nightly/latest-mozilla-central-l10n/firefox-70.0a1.:lang.win32.installer.exe'}, {'os': 'linux', 'id': '23647', 'path': '/firefox/nightly/latest-mozilla-central-l10n/firefox-70.0a1.:lang.linux-i686.tar.bz2'}, {'os': 'osx', 'id': '23645', 'path': '/firefox/nightly/latest-mozilla-central-l10n/firefox-70.0a1.:lang.mac.dmg'}, {'os': 'linux64', 'id': '23646', 'path': '/firefox/nightly/latest-mozilla-central-l10n/firefox-70.0a1.:lang.linux-x86_64.tar.bz2'}, {'os': 'win64', 'id': '20140', 'path': '/firefox/nightly/latest-mozilla-central-l10n/firefox-70.0a1.:lang.win64.installer.exe'}, {'os': 'win64-aarch64', 'id': '51281', 'path': '/firefox/nightly/latest-mozilla-central-l10n/firefox-70.0a1.:lang.win64-aarch64.installer.exe'}]
2020-04-01 09:07:26,149 - bouncerscript.script - INFO - Sanity check product firefox-nightly-latest platform win, path /firefox/nightly/latest-mozilla-central-l10n/firefox-70.0a1.:lang.win32.installer.exe before bumping its version ...
2020-04-01 09:07:26,151 - scriptworker.client - ERROR - Failed to run async_main
Traceback (most recent call last):
  File "/app/lib/python3.8/site-packages/scriptworker/client.py", line 204, in _handle_asyncio_loop
    await async_main(context)
  File "/app/lib/python3.8/site-packages/bouncerscript/script.py", line 160, in async_main
    await action_map[context.action](context)
  File "/app/lib/python3.8/site-packages/bouncerscript/script.py", line 125, in bouncer_locations
    check_versions_are_successive(current_version, payload_version, product)
  File "/app/lib/python3.8/site-packages/bouncerscript/task.py", line 160, in check_versions_are_successive
    _successive_sanity(current_bouncer_version.major_number, candidate_version.major_number)
  File "/app/lib/python3.8/site-packages/bouncerscript/task.py", line 152, in _successive_sanity
    raise ScriptWorkerTaskException(err_msg)
scriptworker.exceptions.ScriptWorkerTaskException: In-tree version 76.0a1 can't be greater than current bouncer by more than 1 digit
exit code: 1

Comment 6

[Rail Aliiev [:rail]]

I like this check! :)

Comment 7

[Rail Aliiev [:rail]]

For the record. The automation code looks good, we just need to bump the version manually somehow in order to make the automation work next time.

Comment 8

[Rail Aliiev [:rail]]

Oopps, commented in the wrong tab :)

Comment 9

[Rob Lemley [:rjl]]

Comment on attachment 9135574 [details] [diff] [review]
Port bug 1609174: Add nazgul bouncer configs

[Approval Request Comment]
There are plans to uplift the relevant code to mozilla-esr68 (Bug 1609174). Assuming that gets approved, the same needs to be done for Thunderbird.

Note to uplifter: There are two commits on this bug to uplift, the second being the followup.

Comment 10

[Wayne Mery (:wsmwk)]

Comment on attachment 9135574 [details] [diff] [review]
Port bug 1609174: Add nazgul bouncer configs

Approved for ESR

Comment 11

[Rob Lemley [:rjl]]

Thunderbird 68.9.0:
https://hg.mozilla.org/releases/comm-esr68/rev/09bdd38aa241
https://hg.mozilla.org/releases/comm-esr68/rev/daeb6f6b69b0

Comment 12

[Mihai Tabara [:mtabara]⌚️GMT]

(In reply to Rob Lemley [:rjl] from comment #11)

Thunderbird 68.9.0:
https://hg.mozilla.org/releases/comm-esr68/rev/09bdd38aa241
https://hg.mozilla.org/releases/comm-esr68/rev/daeb6f6b69b0

Thanks for porting this over!