1494187 - Perma IOError: [Errno 2] No such file or directory: u'/builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_tests/web-platform/wptrunner.local.ini'

Status: RESOLVED FIXED

(Testing :: web-platform-tests, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: aciure [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=201532775&repo=mozilla-central

https://queue.taskcluster.net/v1/task/XHe4Yiu8ROOhyOSh6qQ21w/runs/0/artifacts/public/logs/live_backing.log

[task 2018-09-25T21:57:51.855Z] x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wl,-Bsymbolic-functions -Wl,-z,relro -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/psutil/_psutil_common.o build/temp.linux-x86_64-2.7/psutil/_psutil_posix.o build/temp.linux-x86_64-2.7/psutil/_psutil_linux.o -o build/lib.linux-x86_64-2.7/psutil/_psutil_linux.so
[task 2018-09-25T21:57:51.855Z] building 'psutil._psutil_posix' extension
[task 2018-09-25T21:57:51.855Z] x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fno-strict-aliasing -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_VERSION=543 -DPSUTIL_LINUX=1 -I/usr/include/python2.7 -c psutil/_psutil_common.c -o build/temp.linux-x86_64-2.7/psutil/_psutil_common.o
[task 2018-09-25T21:57:51.855Z] x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fno-strict-aliasing -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_VERSION=543 -DPSUTIL_LINUX=1 -I/usr/include/python2.7 -c psutil/_psutil_posix.c -o build/temp.linux-x86_64-2.7/psutil/_psutil_posix.o
[task 2018-09-25T21:57:51.855Z] x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wl,-Bsymbolic-functions -Wl,-z,relro -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/psutil/_psutil_common.o build/temp.linux-x86_64-2.7/psutil/_psutil_posix.o -o build/lib.linux-x86_64-2.7/psutil/_psutil_posix.so
[task 2018-09-25T21:57:51.855Z] copying build/lib.linux-x86_64-2.7/psutil/_psutil_linux.so -> psutil
[task 2018-09-25T21:57:51.855Z] copying build/lib.linux-x86_64-2.7/psutil/_psutil_posix.so -> psutil
[task 2018-09-25T21:57:51.855Z] 
[task 2018-09-25T21:57:51.855Z] Error processing command. Ignoring because optional. (optional:packages.txt:comm/build/virtualenv_packages.txt)
[task 2018-09-25T21:57:51.959Z] Error running mach:
[task 2018-09-25T21:57:51.959Z] 
[task 2018-09-25T21:57:51.959Z]     ['wpt-manifest-update']
[task 2018-09-25T21:57:51.959Z] 
[task 2018-09-25T21:57:51.959Z] The error occurred in code that was called by the mach command. This is either
[task 2018-09-25T21:57:51.959Z] a bug in the called code itself or in the way that mach is calling it.
[task 2018-09-25T21:57:51.959Z] 
[task 2018-09-25T21:57:51.959Z] You should consider filing a bug for this issue.
[task 2018-09-25T21:57:51.959Z] 
[task 2018-09-25T21:57:51.959Z] If filing a bug, please include the full output of mach, including this error
[task 2018-09-25T21:57:51.959Z] message.
[task 2018-09-25T21:57:51.959Z] 
[task 2018-09-25T21:57:51.959Z] The details of the failure are as follows:
[task 2018-09-25T21:57:51.959Z] 
[task 2018-09-25T21:57:51.959Z] IOError: [Errno 2] No such file or directory: u'/builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_tests/web-platform/wptrunner.local.ini'
[task 2018-09-25T21:57:51.959Z] 
[task 2018-09-25T21:57:51.959Z]   File "/builds/worker/checkouts/gecko/testing/web-platform/mach_commands.py", line 436, in wpt_manifest_update
[task 2018-09-25T21:57:51.959Z]     return wpt_manifest_updater.run_update(**params)
[task 2018-09-25T21:57:51.959Z]   File "/builds/worker/checkouts/gecko/testing/web-platform/mach_commands.py", line 297, in run_update
[task 2018-09-25T21:57:51.959Z]     manifestupdate.update(logger, wpt_dir, rebuild, config_dir)
[task 2018-09-25T21:57:51.959Z]   File "/builds/worker/checkouts/gecko/testing/web-platform/manifestupdate.py", line 39, in update
[task 2018-09-25T21:57:51.960Z]     generate_config(config_dir)
[task 2018-09-25T21:57:51.960Z]   File "/builds/worker/checkouts/gecko/testing/web-platform/manifestdownload.py", line 192, in generate_config
[task 2018-09-25T21:57:51.960Z]     with open(path, 'wb') as config_file:
[taskcluster 2018-09-25 21:57:52.451Z] === Task Finished ===
[taskcluster 2018-09-25 21:57:52.540Z] Artifact "public/manifests.tar.gz" not found at "/builds/worker/checkouts/gecko/manifests.tar.gz"
[taskcluster 2018-09-25 21:57:52.896Z] Unsuccessful task run with exit code: 1 completed in 280.44 seconds

Comment 1

[Eliza Balazs [:ebalazs_]]

The retrigger and backfill result is:

- the failure started after https://bugzilla.mozilla.org/show_bug.cgi?id=1493674 landed on autoland

https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=linux,x64,opt,source-test-wpt-manifest-upload,(wm)&tochange=9bde1b9b0810e1c3eb170fbace15eb6aa250b637&fromchange=950ce58bfb243aa18223151e390685d88ccd7370&selectedJob=201456185

jgraham: Can you have a look at this?

Comment 2

[James Graham [:jgraham]]

Attachment: Bug 1494187 - Ensure wpt metadata directory exists in objdir before trying to write there

Usually this directory is created by the build system. However if we
run ./mach wpt-manifest-update before trying to do a build it can
error out. Just creating the directory should be enough to fix this.

Comment 3

[James Graham [:jgraham]]

Attachment: Bug 1494187 - Run the manifest download steps before trying to update the manifest

This ensures that we always start from a partial manifest where possible and also ensures that the
configuration files are correctly created (a refactor to create these irrespective of whether we
do a download would make sense, but this fixes the immediate problem)

Depends on D7088

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/b96612d7ee88
Ensure wpt metadata directory exists in objdir before trying to write there, r=ato
https://hg.mozilla.org/integration/mozilla-inbound/rev/daf8260b674d
Run the manifest download steps before trying to update the manifest, r=ato

Comment 5

[Tiberius Oros[:tiberius_oros]]

https://hg.mozilla.org/mozilla-central/rev/b96612d7ee88
https://hg.mozilla.org/mozilla-central/rev/daf8260b674d

Comment 6

[Intermittent Failures Robot]

29 failures in 2773 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 9
* mozilla-inbound: 7
* try: 4
* mozilla-central: 9

Platform breakdown:
* linux64: 29

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1494187&startday=2018-09-24&endday=2018-09-30&tree=all