Closed Bug 1775097 Opened 4 years ago Closed 4 years ago

esr102 [tier 2] tgdiff ModuleNotFoundError: No module named 'taskgraph.parameters'

Categories

(Firefox Build System :: Task Configuration, defect, P5)

Product:
Firefox Build System
Component:
Task Configuration
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED WONTFIX

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure)

Filed by: imoraru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=381889238&repo=mozilla-esr102
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TH2rKR5PT8Ca9IBv663u5g/runs/0/artifacts/public/logs/live_backing.log

[vcs 2022-06-20T11:57:27.819Z] added 5 changesets with 5 changes to 3 files (-1 heads)
[vcs 2022-06-20T11:57:27.820Z] new changesets c8b1ae8196f8:c9416b2e62f6
[vcs 2022-06-20T11:57:27.821Z] (purging working directory)
[vcs 2022-06-20T11:57:34.171Z] 
[vcs 2022-06-20T11:57:35.175Z] updating [                                                        ]   100/10577
[vcs 2022-06-20T11:57:36.514Z] updating [=============>                                      ]  2914/10577 03s
[vcs 2022-06-20T11:57:37.716Z] updating [================>                                   ]  3614/10577 05s
[vcs 2022-06-20T11:57:39.083Z] updating [====================>                               ]  4414/10577 06s
[vcs 2022-06-20T11:57:40.205Z] updating [==========================>                         ]  5614/10577 05s
[vcs 2022-06-20T11:57:41.209Z] updating [==============================>                     ]  6314/10577 05s
[vcs 2022-06-20T11:57:42.288Z] updating [=========================================>          ]  8714/10577 02s
[vcs 2022-06-20T11:57:42.465Z]                                                                                 
[vcs 2022-06-20T11:57:42.465Z] 8263 files updated, 0 files merged, 2314 files removed, 0 files unresolved
[vcs 2022-06-20T11:57:42.556Z] updated to c9416b2e62f690af60aced613db73aaddf1333b6
[vcs 2022-06-20T11:57:42.557Z] PERFHERDER_DATA: {"framework": {"name": "vcs"}, "suites": [{"extraOptions": ["m5a.xlarge"], "hgVersion": "5.8.1", "lowerIsBetter": true, "name": "pull", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 5.403473138809204}, {"extraOptions": ["m5a.xlarge"], "hgVersion": "5.8.1", "lowerIsBetter": true, "name": "purge", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 3.721224784851074}, {"extraOptions": ["m5a.xlarge"], "hgVersion": "5.8.1", "lowerIsBetter": true, "name": "update", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 11.013461351394653}, {"extraOptions": ["m5a.xlarge"], "hgVersion": "5.8.1", "lowerIsBetter": true, "name": "overall", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 21.905177354812622}, {"extraOptions": ["m5a.xlarge"], "hgVersion": "5.8.1", "lowerIsBetter": true, "name": "overall_pull", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 21.905177354812622}, {"extraOptions": ["m5a.xlarge"], "hgVersion": "5.8.1", "lowerIsBetter": true, "name": "overall_pull_fullcheckout", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 21.905177354812622}, {"extraOptions": ["m5a.xlarge"], "hgVersion": "5.8.1", "lowerIsBetter": true, "name": "overall_pull_populatedwdir", "serverUrl": "hg.mozilla.org", "shouldAlert": false, "subtests": [], "value": 21.905177354812622}]}
[vcs 2022-06-20T11:57:42.819Z] TinderboxPrint:<a href=https://hg.mozilla.org/releases/mozilla-esr102/rev/c9416b2e62f690af60aced613db73aaddf1333b6 title='Built from mozilla-esr102 revision c9416b2e62f690af60aced613db73aaddf1333b6'>c9416b2e62f690af60aced613db73aaddf1333b6</a>
[setup 2022-06-20T11:57:42.819Z] GECKO_PATH is /builds/worker/checkouts/gecko
[task 2022-06-20T11:57:42.819Z] executing ['bash', '-cx', 'mkdir -p /builds/worker/artifacts/diffs && ./mach taskgraph target --fast -p "taskcluster/test/params" -o "/builds/worker/artifacts/diffs/diff.txt" --diff 85229fbaf01713caa9ad26c7d3afec271494113c']in /builds/worker/checkouts/gecko
[task 2022-06-20T11:57:42.821Z] + mkdir -p /builds/worker/artifacts/diffs
[task 2022-06-20T11:57:42.826Z] + ./mach taskgraph target --fast -p taskcluster/test/params -o /builds/worker/artifacts/diffs/diff.txt --diff 85229fbaf01713caa9ad26c7d3afec271494113c
[task 2022-06-20T11:57:47.382Z] Creating default state directory: /builds/worker/.mozbuild
[task 2022-06-20T11:57:47.382Z] Generating target_task_set @ c9416b2e62f6
[task 2022-06-20T12:08:36.009Z] Looking for existing index gecko.v2.mozilla-central.revision.9e8d5431c4121a4bd70d440c98b50444aee60dd9.taskgraph.decision-ship-geckoview to avoid triggering multiple nightlies off the same revision...
[task 2022-06-20T12:08:36.009Z] Index gecko.v2.mozilla-central.revision.9e8d5431c4121a4bd70d440c98b50444aee60dd9.taskgraph.decision-ship-geckoview doesn't exist.
[task 2022-06-20T12:08:36.009Z] Looking for existing index gecko.v2.mozilla-release.revision.14d9cd421424a2f3e38b9c8489900c3bb769846.taskgraph.decision-ship-geckoview to avoid triggering multiple nightlies off the same revision...
[task 2022-06-20T12:08:36.009Z] Index gecko.v2.mozilla-release.revision.14d9cd421424a2f3e38b9c8489900c3bb769846.taskgraph.decision-ship-geckoview doesn't exist.
[task 2022-06-20T12:08:36.009Z] Looking for existing index gecko.v2.mozilla-beta.revision.196059cada7070ab1e35db83a22b60389bd0c794.taskgraph.decision-ship-geckoview to avoid triggering multiple nightlies off the same revision...
[task 2022-06-20T12:08:36.009Z] Index gecko.v2.mozilla-beta.revision.196059cada7070ab1e35db83a22b60389bd0c794.taskgraph.decision-ship-geckoview doesn't exist.
[task 2022-06-20T12:08:36.009Z] Looking for existing index gecko.v2.mozilla-central.revision.66f9b72b87297adf712b14be58df13c2333bb3a9.taskgraph.decision-nightly-desktop to avoid triggering multiple nightlies off the same revision...
[task 2022-06-20T12:08:36.009Z] Index gecko.v2.mozilla-central.revision.66f9b72b87297adf712b14be58df13c2333bb3a9.taskgraph.decision-nightly-desktop doesn't exist.
[task 2022-06-20T12:14:49.998Z] Generating target_task_set @ 85229fbaf017
[task 2022-06-20T12:14:49.998Z] Error running mach:
[task 2022-06-20T12:14:49.998Z] 
[task 2022-06-20T12:14:49.998Z]     ['taskgraph', 'target', '--fast', '-p', 'taskcluster/test/params', '-o', '/builds/worker/artifacts/diffs/diff.txt', '--diff', '85229fbaf01713caa9ad26c7d3afec271494113c']
[task 2022-06-20T12:14:49.998Z] 
[task 2022-06-20T12:14:49.998Z] The error occurred in code that was called by the mach command. This is either
[task 2022-06-20T12:14:49.998Z] a bug in the called code itself or in the way that mach is calling it.
[task 2022-06-20T12:14:49.998Z] You can invoke |./mach busted| to check if this issue is already on file. If it
[task 2022-06-20T12:14:49.998Z] isn't, please use |./mach busted file taskgraph| to report it. If |./mach busted| is
[task 2022-06-20T12:14:49.998Z] misbehaving, you can also inspect the dependencies of bug 1543241.
[task 2022-06-20T12:14:49.998Z] 
[task 2022-06-20T12:14:49.998Z] If filing a bug, please include the full output of mach, including this error
[task 2022-06-20T12:14:49.998Z] message.
[task 2022-06-20T12:14:49.998Z] 
[task 2022-06-20T12:14:49.998Z] The details of the failure are as follows:
[task 2022-06-20T12:14:49.998Z] 
[task 2022-06-20T12:14:49.998Z] ModuleNotFoundError: No module named 'taskgraph.parameters'
[task 2022-06-20T12:14:49.998Z] 
[task 2022-06-20T12:14:49.998Z]   File "/builds/worker/checkouts/gecko/taskcluster/mach_commands.py", line 186, in taskgraph_target
[task 2022-06-20T12:14:49.998Z]     return run_show_taskgraph(command_context, **options)
[task 2022-06-20T12:14:49.998Z]   File "/builds/worker/checkouts/gecko/taskcluster/mach_commands.py", line 231, in run_show_taskgraph
[task 2022-06-20T12:14:49.998Z]     return show_taskgraph(options)
[task 2022-06-20T12:14:49.998Z]   File "/builds/worker/checkouts/gecko/taskcluster/gecko_taskgraph/main.py", line 410, in show_taskgraph
[task 2022-06-20T12:14:49.998Z]     generate_taskgraph(options, parameters, logdir)
[task 2022-06-20T12:14:49.998Z]   File "/builds/worker/checkouts/gecko/taskcluster/gecko_taskgraph/main.py", line 160, in generate_taskgraph
[task 2022-06-20T12:14:49.998Z]     from taskgraph.parameters import Parameters
[taskcluster 2022-06-20 12:14:51.407Z] === Task Finished ===
[taskcluster 2022-06-20 12:14:51.518Z] Unsuccessful task run with exit code: 1 completed in 1052.421 seconds

Hi Andrew! Can you please take a look at this? Is this the same issue as Bug 1734302?
Thank you!

Flags: needinfo?(ahal)
Blocks: esr102

Looks like tgdiff is picking a silly base revision (FIREFOX_BETA_38_END) for some reason.

Not a perma failure, it's just that one push.

Summary: Perma esr102 [tier 2] tgdiff ModuleNotFoundError: No module named 'taskgraph.parameters' → esr102 [tier 2] tgdiff ModuleNotFoundError: No module named 'taskgraph.parameters'

If this is happening frequently I'd be inclined to simply disable the task on non-trunk branches. I'm not sure how much value it provides there.

Though picking FIREFOX_BETA_38_END as the base revision could indicate a bug in mozversioncontrol..

Flags: needinfo?(ahal)

FIREFOX_BETA_38_END was the last revision which got merged from mozilla-release to esr. esr102 got branched beta. It's like a merge of release back to beta. Firefox 38 predates the newer taskgraph generation (bug 1258497). This should work for newer pushes which take the previous push as base.

Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.