1798587 - Perma condprof [tier 2] python3.7: can't open file 'virtualenv/virtualenv.py': [Errno 2] No such file or directory

Status: RESOLVED FIXED

(Firefox Build System :: General, defect)

Description

[Cristian Tuns]

Push with failures: https://treeherder.mozilla.org/jobs?repo=mozilla-central&group_state=expanded&selectedTaskRun=fm003nBrSdG9_XNQw5A3VQ.0&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel&revision=f8dff2edfe1b19e56775fb4106c1688b719fd12e&searchStr=condprof
Failure log: https://treeherder.mozilla.org/logviewer?job_id=395167358&repo=mozilla-central

[setup 2022-11-01T23:14:49.538Z] run-task started in /builds/worker
[cache 2022-11-01T23:14:49.540Z] cache /builds/worker/tooltool-cache exists; requirements: gid=1000 uid=1000 version=1
[volume 2022-11-01T23:14:49.540Z] changing ownership of volume /builds/worker/.cache to 1000:1000
[volume 2022-11-01T23:14:49.540Z] changing ownership of volume /builds/worker/checkouts to 1000:1000
[volume 2022-11-01T23:14:49.540Z] volume /builds/worker/tooltool-cache is a cache
[volume 2022-11-01T23:14:49.541Z] changing ownership of volume /builds/worker/workspace to 1000:1000
[setup 2022-11-01T23:14:49.541Z] running as worker:worker
[setup 2022-11-01T23:14:49.541Z] MOZ_FETCHES_DIR is /builds/worker/fetches
[fetches 2022-11-01T23:14:49.541Z] fetching artifacts
[fetches 2022-11-01T23:14:49.541Z] executing ['/usr/bin/python3', '-u', '/builds/worker/bin/fetch-content', 'task-artifacts']
[fetches 2022-11-01T23:14:49.639Z] attempt 1/5
[fetches 2022-11-01T23:14:49.639Z] attempt 1/5
[fetches 2022-11-01T23:14:49.639Z] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/USh9-phGQEKtt1MvGnpGYQ/artifacts/public/build/target.condprof.tests.tar.gz to /builds/worker/fetches/target.condprof.tests.tar.gz
[fetches 2022-11-01T23:14:49.639Z] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KYg26I7wR9W4Qaog1c7DzA/artifacts/public/build/geckodriver.tar.gz to /builds/worker/fetches/geckodriver.tar.gz
[fetches 2022-11-01T23:14:49.640Z] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KYg26I7wR9W4Qaog1c7DzA/artifacts/public/build/geckodriver.tar.gz
[fetches 2022-11-01T23:14:49.640Z] attempt 1/5
[fetches 2022-11-01T23:14:49.640Z] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/USh9-phGQEKtt1MvGnpGYQ/artifacts/public/build/target.tar.bz2 to /builds/worker/fetches/target.tar.bz2
[fetches 2022-11-01T23:14:49.640Z] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/USh9-phGQEKtt1MvGnpGYQ/artifacts/public/build/target.tar.bz2
[fetches 2022-11-01T23:14:49.640Z] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/USh9-phGQEKtt1MvGnpGYQ/artifacts/public/build/target.condprof.tests.tar.gz
[fetches 2022-11-01T23:14:49.805Z] https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/USh9-phGQEKtt1MvGnpGYQ/artifacts/public/build/target.condprof.tests.tar.gz resolved to 210848 bytes with sha256 290384bda52006e6a5f1521f8b3ecc89a4190ea134b8d74c63a20bd9b8391afc in 0.165s
[fetches 2022-11-01T23:14:49.805Z] Extracting /builds/worker/fetches/target.condprof.tests.tar.gz to /builds/worker/fetches
[fetches 2022-11-01T23:14:49.817Z] /builds/worker/fetches/target.condprof.tests.tar.gz extracted in 0.012s
[fetches 2022-11-01T23:14:49.817Z] Removing /builds/worker/fetches/target.condprof.tests.tar.gz
[fetches 2022-11-01T23:14:49.853Z] https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KYg26I7wR9W4Qaog1c7DzA/artifacts/public/build/geckodriver.tar.gz resolved to 2991132 bytes with sha256 583294fa67d2ccc6a36ac0a22e7c9809d750805ac877c85c457284ccceda8708 in 0.213s
[fetches 2022-11-01T23:14:49.853Z] Extracting /builds/worker/fetches/geckodriver.tar.gz to /builds/worker/fetches
[fetches 2022-11-01T23:14:49.922Z] /builds/worker/fetches/geckodriver.tar.gz extracted in 0.069s
[fetches 2022-11-01T23:14:49.922Z] Removing /builds/worker/fetches/geckodriver.tar.gz
[fetches 2022-11-01T23:14:50.406Z] https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/USh9-phGQEKtt1MvGnpGYQ/artifacts/public/build/target.tar.bz2 resolved to 89033762 bytes with sha256 b6e8e4d4b981d8d1dd8fe9116e5cebcebd70e95cb316555e155bbb8f754baf0e in 0.766s
[fetches 2022-11-01T23:14:50.407Z] Extracting /builds/worker/fetches/target.tar.bz2 to /builds/worker/fetches
[fetches 2022-11-01T23:15:05.076Z] /builds/worker/fetches/target.tar.bz2 extracted in 14.669s
[fetches 2022-11-01T23:15:05.076Z] Removing /builds/worker/fetches/target.tar.bz2
[fetches 2022-11-01T23:15:05.089Z] PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 15.450688375000027, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2022-11-01T23:15:05.108Z] finished fetching artifacts
[task 2022-11-01T23:15:05.108Z] executing ['bash', '-cx', 'python3.7 virtualenv/virtualenv.py . && bin/python3.7 condprof/main.py  --geckodriver ${MOZ_FETCHES_DIR}/geckodriver --firefox ${MOZ_FETCHES_DIR}/firefox/firefox-bin --scenario full ../../archive']in fetches/condprofile
[task 2022-11-01T23:15:05.110Z] + python3.7 virtualenv/virtualenv.py .
[task 2022-11-01T23:15:05.125Z] python3.7: can't open file 'virtualenv/virtualenv.py': [Errno 2] No such file or directory
[taskcluster 2022-11-01 23:15:06.084Z] === Task Finished ===
[taskcluster 2022-11-01 23:15:06.106Z] Artifact "public/condprof" not found at "/builds/worker/archive": (HTTP code 404) no such container - Could not find the file /builds/worker/archive in container 069d281b9859a4d879d4ff7f3b3c00b84df82f6ea4d0570fb376e021690fdfe8 
[taskcluster 2022-11-01 23:15:06.178Z] Unsuccessful task run with exit code: 2 completed in 99.12 seconds

Hi Alex, can you please take a look at this? I think this might be caused by Bug 1766497.

Comment 1

[BugBot [:suhaib / :marco]]

Set release status flags based on info from the regressing bug 1766497

Comment 2

[Alex Hochheiden [:ahochheiden] [he/him]]

Ah, sorry. I had a change for this in D145787 but it got lost when I abandoned the stack with that change in it to revert something else by pulling it fresh from Phabricator.

I'll have the change up shortly and do a try push.

Comment 3

[Alex Hochheiden [:ahochheiden] [he/him]]

Attachment: Bug 1798587 - Make condprof `linux64-firefox` command use `venv` instead of `virtualenv` (just like the `macosx64-firefox` command) r?#build

Comment 4

[Alex Hochheiden [:ahochheiden] [he/him]]

https://treeherder.mozilla.org/jobs?repo=try&revision=4cec0dc611eedccf21a465bda15d23cb4c4cf6b5

Comment 5

[Donal Meehan [:dmeehan]]

Setting 106 and 107 to unaffected. Regressor patches on Bug 1766497 only landed in 108.

Comment 6

[Alex Hochheiden [:ahochheiden] [he/him]]

https://treeherder.mozilla.org/jobs?repo=try&revision=412e85c104d66881531d53b06709c942a6b9e8b0&selectedTaskRun=CQI2HJBQRLKXFt3aOdLB4A.0

Comment 7

[Alex Hochheiden [:ahochheiden] [he/him]]

https://treeherder.mozilla.org/jobs?repo=try&revision=8dca8c27118a9a06fca49872158ec1e9af874a46&selectedTaskRun=RkS_dkmjSsSPJI7_L324Mg.0

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/03ec6749b5a9
Make condprof `linux64-firefox` command use `venv` instead of `virtualenv` (just like the `macosx64-firefox` command) r=firefox-build-system-reviewers,glandium

Comment 9

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/03ec6749b5a9

Comment 10

[Intermittent Failures Robot]

10 failures in 3626 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 10

Platform and build breakdown:

• linux64: 10
  • opt: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1798587&startday=2022-10-31&endday=2022-11-06&tree=all