1538096 - BMR COT ERROR - Hit ScriptWorkerException: 'path public/build/target.langpack.xpi not in beetmover:build eTHQdaMYQMyjIsrnmVncxA chain of trust artifacts!'

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, task)

Description

[Andreea Pavel [:apavel]]

Treeherder link: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&resultStatus=testfailed%2Cbusted%2Cexception%2Cusercancel%2Crunning%2Cpending%2Crunnable&searchStr=windows%2C2012%2Caarch64%2Copt%2Cbeetmover%2Crepackages%2Cbeetmover-repackage-win64-aarch64-nightly%2Fopt%2Cbmr%28n%29&tochange=2c49e736571bdcf4d8897eab3c3ad6d4a079f664&fromchange=4f6d8ed9e94809f911907725a708627e3faaed01&selectedJob=235354151

Failure log: https://tools.taskcluster.net/groups/SPmSTdYTT2udPMXsetxccg/tasks/fyTsb2nBSgy-eblC8q0fnQ/runs/1/logs/public%2Flogs%2Fchain_of_trust.log#L413

2019-03-22T04:24:13 CRITICAL - Chain of Trust verification error!
Traceback (most recent call last):
File "/builds/scriptworker/lib/python3.6/site-packages/scriptworker/cot/verify.py", line 2212, in verify_chain_of_trust
await download_cot_artifacts(chain)
File "/builds/scriptworker/lib/python3.6/site-packages/scriptworker/cot/verify.py", line 739, in download_cot_artifacts
mandatory_artifacts_paths = await raise_future_exceptions(mandatory_artifact_tasks)
File "/builds/scriptworker/lib/python3.6/site-packages/scriptworker/utils.py", line 327, in raise_future_exceptions
succeeded_results, _ = await _process_future_exceptions(tasks, raise_at_first_error=True)
File "/builds/scriptworker/lib/python3.6/site-packages/scriptworker/utils.py", line 361, in _process_future_exceptions
raise exc
File "/builds/scriptworker/lib/python3.6/site-packages/scriptworker/cot/verify.py", line 687, in download_cot_artifact
raise CoTError("path {} not in {} {} chain of trust artifacts!".format(path, link.name, link.task_id))
scriptworker.exceptions.CoTError: 'path public/build/target.langpack.xpi not in beetmover:build eTHQdaMYQMyjIsrnmVncxA chain of trust artifacts!'
2019-03-22T04:24:13 ERROR - Hit ScriptWorkerException: 'path public/build/target.langpack.xpi not in beetmover:build eTHQdaMYQMyjIsrnmVncxA chain of trust artifacts!'
2019-03-22T04:24:13 DEBUG - "/builds/scriptworker/artifacts/public/logs/chain_of_trust.log" is encoded with "None" and has mime/type "text/plain"
2019-03-22T04:24:13 INFO - "/builds/scriptworker/artifacts/public/logs/chain_of_trust.log" can be gzip'd. Compressing...

Mike, please take a look.

Comment 1

[Julien Cristau [:jcristau]]

from #releaseduty:

09:21 < jcristau> https://tools.taskcluster.net/groups/SPmSTdYTT2udPMXsetxccg/tasks/fyTsb2nBSgy-eblC8q0fnQ/details explains the missing en-US i guess
09:21 < jcristau> CoT failure
09:30 <@nthomas> looks like eTHQdaMYQMyjIsrnmVncxA didn’t produce the langpack
09:34 <@nthomas> previous nightly failed in the same way
09:35 <@nthomas> something between 25398e555020 and b2f1edb41241
09:39 <@nthomas> I would hazard a guess it’s fallout from https://hg.mozilla.org/mozilla-central/rev/74b3bf36f5e8
09:40 <@nthomas> yielding no target.langpack.xpi on the Windows 2012 AArch64 opt N (eg https://taskcluster-web.netlify.com/tasks/GhXHjG9zReuz1dMy6p096A)
09:40 <@nthomas> when there was on PCfl3sP8THezkVImAvgehA

Comment 2

[Andreea Pavel [:apavel]]

Bug 1527463 got backed out https://hg.mozilla.org/mozilla-central/rev/cc2984b1f9f28bc2ab198efd1378db80db36f4d6

Comment 3

[Intermittent Failures Robot]

4 failures in 2561 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4

Platform breakdown:

• windows2012-aarch64: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1538096&startday=2019-03-18&endday=2019-03-24&tree=all