1863666 - Perma searchfox idx Automation Error: mozharness timed out after 2400 seconds running ['/builds/worker/.mozbuild/srcdirs/gecko-8a5b87fe5d69/_virtualenvs/common/bin/python', 'mach', '--log-no-times', 'build', '-v']

Status: RESOLVED FIXED

(Firefox Build System :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: csabou [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=435341904&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/QzK5e8ShRvKIpj2wpEIXCQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2023-11-08T01:46:53.113Z] 01:46:53     INFO -  package> gmake[4]: Nothing to be done for 'pre-export'.
[task 2023-11-08T01:46:53.116Z] 01:46:53     INFO -  package> gmake[4]: Nothing to be done for 'export'.
[task 2023-11-08T01:46:53.119Z] 01:46:53     INFO -  package> gmake[4]: Nothing to be done for 'compile'.
[task 2023-11-08T01:46:53.121Z] 01:46:53     INFO -  package> gmake[4]: Nothing to be done for 'misc'.
[task 2023-11-08T01:46:53.124Z] 01:46:53     INFO -  package> /bin/gmake make-package-internal
[task 2023-11-08T01:46:53.129Z] 01:46:53     INFO -  package> gmake[5]: Entering directory '/builds/worker/workspace/obj-build/browser/installer'
[task 2023-11-08T01:46:53.129Z] 01:46:53     INFO -  package> printf '\n[multilocale]\n' > locale-manifest.in
[task 2023-11-08T01:46:53.130Z] 01:46:53     INFO -  package> printf '@RESPATH@/res/multilocale.txt\n' >> locale-manifest.in
[task 2023-11-08T01:46:53.130Z] 01:46:53     INFO -  package> for LOCALE in  en-US ;\
[task 2023-11-08T01:46:53.130Z] 01:46:53     INFO -  package> do \
[task 2023-11-08T01:46:53.130Z] 01:46:53     INFO -  package>   for ENTRY in @RESPATH@/browser/chrome/ @RESPATH@/chrome/ ;\
[task 2023-11-08T01:46:53.130Z] 01:46:53     INFO -  package> 	do \
[task 2023-11-08T01:46:53.130Z] 01:46:53     INFO -  package> 	  printf "$ENTRY""$LOCALE"'@JAREXT@\n' >> locale-manifest.in; \
[task 2023-11-08T01:46:53.130Z] 01:46:53     INFO -  package> 	  printf "$ENTRY""$LOCALE"'.manifest\n' >> locale-manifest.in; \
[task 2023-11-08T01:46:53.130Z] 01:46:53     INFO -  package>   done \
[task 2023-11-08T01:46:53.130Z] 01:46:53     INFO -  package> done
[task 2023-11-08T01:46:53.130Z] 01:46:53     INFO -  package> gmake[5]: Leaving directory '/builds/worker/workspace/obj-build/browser/installer'
[task 2023-11-08T01:46:53.130Z] 01:46:53     INFO -  package> gmake[5]: Entering directory '/builds/worker/workspace/obj-build/browser/installer'
[task 2023-11-08T01:46:53.130Z] 01:46:53     INFO -  package> ../../config/nsinstall -D ../../dist/
[task 2023-11-08T01:46:53.131Z] 01:46:53     INFO -  package> gmake[5]: Leaving directory '/builds/worker/workspace/obj-build/browser/installer'
[task 2023-11-08T01:46:53.246Z] 01:46:53     INFO -  package> gmake[5]: Entering directory '/builds/worker/workspace/obj-build/browser/installer'
[task 2023-11-08T01:46:53.246Z] 01:46:53     INFO -  package> BUILDSTATUS@browser/installer START_file_generate multilocale.txt
[task 2023-11-08T01:46:53.247Z] 01:46:53     INFO -  package> /builds/worker/.mozbuild/srcdirs/gecko-8a5b87fe5d69/_virtualenvs/build/bin/python -m mozbuild.action.file_generate /builds/worker/checkouts/gecko/toolkit/locales/gen_multilocale.py main '../../dist/bin/res/multilocale.txt' .deps/multilocale.txt.pp '../../dist/bin/res/multilocale.txt'  en-US
[task 2023-11-08T01:46:53.247Z] 01:46:53     INFO -  package> BUILDSTATUS@browser/installer END_file_generate multilocale.txt
[task 2023-11-08T01:46:53.247Z] 01:46:53     INFO -  package> gmake[5]: Leaving directory '/builds/worker/workspace/obj-build/browser/installer'
[task 2023-11-08T01:46:56.077Z] 01:46:56     INFO -  package-generated-sources> gmake[2]: Entering directory '/builds/worker/workspace/obj-build'
[task 2023-11-08T01:46:56.077Z] 01:46:56     INFO -  package-generated-sources> BUILDSTATUS@. START_package_generated_sources dist/target.generated-files.tar.gz
[task 2023-11-08T01:46:56.077Z] 01:46:56     INFO -  package-generated-sources> /builds/worker/.mozbuild/srcdirs/gecko-8a5b87fe5d69/_virtualenvs/build/bin/python -m mozbuild.action.package_generated_sources 'dist/target.generated-files.tar.gz'
[task 2023-11-08T01:46:56.077Z] 01:46:56     INFO -  package-generated-sources> BUILDSTATUS@. END_package_generated_sources dist/target.generated-files.tar.gz
[task 2023-11-08T01:46:56.078Z] 01:46:56     INFO -  package-generated-sources> gmake[2]: Leaving directory '/builds/worker/workspace/obj-build'
[task 2023-11-08T02:26:56.079Z] 02:26:56     INFO - Automation Error: mozharness timed out after 2400 seconds running ['/builds/worker/.mozbuild/srcdirs/gecko-8a5b87fe5d69/_virtualenvs/common/bin/python', 'mach', '--log-no-times', 'build', '-v']
[taskcluster:error] Task timeout after 10800 seconds. Force killing container.
[taskcluster 2023-11-08 04:02:11.890Z] === Task Finished ===
[taskcluster 2023-11-08 04:02:11.890Z] Unsuccessful task run with exit code: -1 completed in 10801.036 seconds

Comment 1

[Cosmin Sabou [:CosminS]]

Backfills here.

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1843981

Comment 3

[Mike Hommey [:glandium]]

There is something going wrong with rust-analyzer 1.73 :( (and also cargo metadata)

Comment 4

[Mike Hommey [:glandium]]

The good news is that rust-analyzer 1.74 (beta) is fixed. For cargo metadata, it's a different story, but it's also not a regression, it was only an observation that it takes forever because it's downloading stuff from crates.io while it shouldn't.
Anyways, for now, we can go down in version. Emilio, do you if it matters what version we use for rust-analyzer scip? It would simplify things if we could use 1.70.

Comment 5

[Mike Hommey [:glandium]]

Actually, it's not simpler... let's just go with 1.72.

Comment 6

[Mike Hommey [:glandium]]

Attachment: Bug 1863666 - Downgrade searchfox builds to rustc 1.72.

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/7215f3a22bd8
Downgrade searchfox builds to rustc 1.72. r=firefox-build-system-reviewers,emilio,sergesanspaille

Comment 8

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/7215f3a22bd8

Comment 9

[Intermittent Failures Robot]

14 failures in 3288 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 14

Platform and build breakdown:

• osx-cross: 4
  • debug: 4
• windows2012-64: 3
  • debug: 3
• android-4-1-armv7: 3
  • debug: 3
• linux64: 4
  • debug: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1863666&startday=2023-11-06&endday=2023-11-12&tree=all