776503 - Build failures on Windows, with "OSError: [Errno 2] No such file or directory: '../dist/bin/webapprt/chrome.manifest.lck'"

Status: RESOLVED FIXED

(Firefox Build System :: General, defect)

Description

[Ed Morley [:emorley]]

Filing this to have something to point at whilst waiting for retriggers.

Starting on:
https://tbpl.mozilla.org/?tree=Mozilla-Inbound&rev=7295d036a37b

Win32 PGO is permared:

https://tbpl.mozilla.org/php/getParsedLog.php?id=13766170&tree=Mozilla-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=13766774&tree=Mozilla-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=13769745&tree=Mozilla-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=13770240&tree=Mozilla-Inbound

{
make -C content libs
make[8]: Entering directory `/e/builds/moz2_slave/m-in-w32-pgo/build/obj-firefox/webapprt/test/content'
e:/builds/moz2_slave/m-in-w32-pgo/build/obj-firefox/_virtualenv/Scripts/python.exe /e/builds/moz2_slave/m-in-w32-pgo/build/config/nsinstall.py -t "/e/builds/moz2_slave/m-in-w32-pgo/build/webapprt/test/content/helpers.js" "/e/builds/moz2_slave/m-in-w32-pgo/build/webapprt/test/content/webapprt_sample.html" "/e/builds/moz2_slave/m-in-w32-pgo/build/webapprt/test/content/sample.webapp" "/e/builds/moz2_slave/m-in-w32-pgo/build/webapprt/test/content/sample.html" ../../../_tests/testing/mochitest/tests/webapprt/test/content
make[8]: Leaving directory `/e/builds/moz2_slave/m-in-w32-pgo/build/obj-firefox/webapprt/test/content'
make[7]: Leaving directory `/e/builds/moz2_slave/m-in-w32-pgo/build/obj-firefox/webapprt/test'
e:/builds/moz2_slave/m-in-w32-pgo/build/obj-firefox/_virtualenv/Scripts/python.exe /e/builds/moz2_slave/m-in-w32-pgo/build/config/buildlist.py ../dist/bin/webapprt/chrome.manifest "manifest components/components.manifest"
make[6]: Leaving directory `/e/builds/moz2_slave/m-in-w32-pgo/build/obj-firefox/webapprt'
make[5]: Leaving directory `/e/builds/moz2_slave/m-in-w32-pgo/build/obj-firefox'
make[4]: Leaving directory `/e/builds/moz2_slave/m-in-w32-pgo/build/obj-firefox'
make[3]: Leaving directory `/e/builds/moz2_slave/m-in-w32-pgo/build/obj-firefox'
make[2]: Leaving directory `/e/builds/moz2_slave/m-in-w32-pgo/build'
make[1]: Leaving directory `/e/builds/moz2_slave/m-in-w32-pgo/build'
Traceback (most recent call last):
  File "e:/builds/moz2_slave/m-in-w32-pgo/build/config/buildlist.py", line 40, in <module>
    addEntriesToListFile(sys.argv[1], sys.argv[2:])
  File "e:/builds/moz2_slave/m-in-w32-pgo/build/config/buildlist.py", line 19, in addEntriesToListFile
    lock = lockFile(listFile + ".lck")
  File "e:\builds\moz2_slave\m-in-w32-pgo\build\config\utils.py", line 44, in lockFile
    fd = os.open(lockfile, os.O_EXCL | os.O_RDWR | os.O_CREAT)
OSError: [Errno 2] No such file or directory: '../dist/bin/webapprt/chrome.manifest.lck'
make[6]: *** [libs] Error 1
}

The failures have happened on multiple slaves & at least several have been clobbers.

The last green Windows x86 PGO build was on:
https://tbpl.mozilla.org/?tree=Mozilla-Inbound&rev=058d3e6887cd
(wasn't a clobber)

Regression range:
https://hg.mozilla.org/integration/mozilla-inbound/pushloghtml?fromchange=058d3e6887cd&tochange=7295d036a37b

However this presumes this isn't a failure that only occurs after a clobber, otherwise the range would be much more like:
https://hg.mozilla.org/integration/mozilla-inbound/pushloghtml?fromchange=6cfd941c49a6&tochange=7295d036a37b

I have clobbered all inbound Windows builders and retriggered another PGO on:
https://tbpl.mozilla.org/?tree=Mozilla-Inbound&rev=afd216efe522

In addition, jfkthame is seeing this on Try, on Windows non-PGO builds (both opt and debug):
https://tbpl.mozilla.org/?tree=Try&rev=dd2dba88c9fb
https://tbpl.mozilla.org/php/getParsedLog.php?id=13769867&tree=Try
https://tbpl.mozilla.org/php/getParsedLog.php?id=13769976&tree=Try
(The push was based on inbound 9d8425b8e1cd)

Comment 1

[Mike Hommey [:glandium]]

Let's say it's fixed by the backout.
https://hg.mozilla.org/integration/mozilla-inbound/rev/5d09c7fdc997

I attached a fixup in bug 770426.