1846890 - Perma system-symbols KeyError: "task 'system-symbols-ubuntu-reprocess-symbols' has no dependency named 'build'"

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=424717336&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PRAnuHhbSd-4zDqK78UhNQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2023-08-03T00:08:45.824Z] Traceback (most recent call last):
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/util/parameterization.py", line 74, in repl
[task 2023-08-03T00:08:45.824Z]     task_id = dependencies[dependency]
[task 2023-08-03T00:08:45.824Z] KeyError: 'build'
[task 2023-08-03T00:08:45.824Z] 
[task 2023-08-03T00:08:45.824Z] During handling of the above exception, another exception occurred:
[task 2023-08-03T00:08:45.824Z] 
[task 2023-08-03T00:08:45.824Z] Traceback (most recent call last):
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/taskcluster/mach_commands.py", line 237, in taskgraph_decision
[task 2023-08-03T00:08:45.824Z]     ret = taskgraph_commands["decision"].func(options)
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/taskcluster/gecko_taskgraph/main.py", line 656, in decision
[task 2023-08-03T00:08:45.824Z]     taskgraph_decision(options)
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/taskcluster/gecko_taskgraph/decision.py", line 269, in taskgraph_decision
[task 2023-08-03T00:08:45.824Z]     write_artifact("task-graph.json", tgg.morphed_task_graph.to_json())
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/generator.py", line 220, in morphed_task_graph
[task 2023-08-03T00:08:45.824Z]     return self._run_until("morphed_task_graph")
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/generator.py", line 424, in _run_until
[task 2023-08-03T00:08:45.824Z]     k, v = next(self._run)
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/generator.py", line 398, in _run
[task 2023-08-03T00:08:45.824Z]     optimized_task_graph, label_to_taskid = optimize_task_graph(
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/optimize/base.py", line 84, in optimize_task_graph
[task 2023-08-03T00:08:45.824Z]     get_subgraph(
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/optimize/base.py", line 380, in get_subgraph
[task 2023-08-03T00:08:45.824Z]     task.task = resolve_task_references(
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/util/parameterization.py", line 91, in resolve_task_references
[task 2023-08-03T00:08:45.824Z]     return _recurse(
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/util/parameterization.py", line 28, in _recurse
[task 2023-08-03T00:08:45.824Z]     return recurse(val)
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/util/parameterization.py", line 24, in recurse
[task 2023-08-03T00:08:45.824Z]     return {k: recurse(v) for k, v in val.items()}
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/util/parameterization.py", line 24, in <dictcomp>
[task 2023-08-03T00:08:45.824Z]     return {k: recurse(v) for k, v in val.items()}
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/util/parameterization.py", line 24, in recurse
[task 2023-08-03T00:08:45.824Z]     return {k: recurse(v) for k, v in val.items()}
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/util/parameterization.py", line 24, in <dictcomp>
[task 2023-08-03T00:08:45.824Z]     return {k: recurse(v) for k, v in val.items()}
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/util/parameterization.py", line 18, in recurse
[task 2023-08-03T00:08:45.824Z]     return [recurse(v) for v in val]
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/util/parameterization.py", line 18, in <listcomp>
[task 2023-08-03T00:08:45.824Z]     return [recurse(v) for v in val]
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/util/parameterization.py", line 23, in recurse
[task 2023-08-03T00:08:45.824Z]     return param_fn(val[param_key])
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/util/parameterization.py", line 89, in artifact_reference
[task 2023-08-03T00:08:45.824Z]     return ARTIFACT_REFERENCE_PATTERN.sub(repl, val)
[task 2023-08-03T00:08:45.824Z]   File "/builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/util/parameterization.py", line 76, in repl
[task 2023-08-03T00:08:45.824Z]     raise KeyError(
[task 2023-08-03T00:08:45.824Z] KeyError: "task 'system-symbols-ubuntu-reprocess-symbols' has no dependency named 'build'"
[task 2023-08-03T00:08:45.824Z] Creating default state directory: /builds/worker/.mozbuild
[task 2023-08-03T00:08:45.825Z] Creating local state directory: /builds/worker/.mozbuild/srcdirs/gecko-8a5b87fe5d69
[task 2023-08-03T00:08:45.825Z] Site not up-to-date reason: "/builds/worker/.mozbuild/srcdirs/gecko-8a5b87fe5d69/_virtualenvs/common" does not exist
[taskcluster 2023-08-03 00:08:47.967Z] === Task Finished ===
[taskcluster 2023-08-03 00:09:03.469Z] Unsuccessful task run with exit code: 1 completed in 426.4 seconds

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

:ahal, since you are the author of the regressor, bug 1839891, could you take a look?

For more information, please visit BugBot documentation.

Comment 2

[Andrew Halberstadt [:ahal]]

Attachment: Bug 1846890 - Fix busted cron-system-symbols Decision tasks, r?#taskgraph-reviewers!

The move to from-deps changed the dependency edge name from build to
system-symbols. Apparently this is what the first path segment in an
artifact-reference is.

We should probably change the separator to a : or something here.

Comment 3

[Andrew Halberstadt [:ahal]]

Attachment: Bug 1846890 - Add test parameters for 'cron-system-symbols', r?#taskgraph-reviewers!

We don't have any test parameters for cron tasks and a regression was missed as
a result.

Depends on D185297

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/1eba462ec815
Fix busted cron-system-symbols Decision tasks, r=jlorenzo
https://hg.mozilla.org/integration/autoland/rev/fffad9c225c7
Add test parameters for 'cron-system-symbols', r=jlorenzo

Comment 5

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/1eba462ec815
https://hg.mozilla.org/mozilla-central/rev/fffad9c225c7

Comment 6

[Intermittent Failures Robot]

3 failures in 3276 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform and build breakdown:

• gecko-decision: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1846890&startday=2023-07-31&endday=2023-08-06&tree=all