Closed Bug 1495538 Opened 6 years ago Closed 5 years ago

Intermittent mozbuild.preprocessor.Error: ('z:\\build\\build\\src\\build\\application.ini.in', 16, 'FILE_NOT_FOUND', 'z:/build/build/src/obj-firefox/buildid.h') for artifact pgo builds

Categories

(Firefox Build System :: Task Configuration, task, P5)

Product:
Firefox Build System
Component:
Task Configuration
Type:
task

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 1517532

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure) 

Filed by: hskupin [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=202689552&repo=try

https://queue.taskcluster.net/v1/task/D3rp_Of1S1CKhGzOmmeyDg/runs/0/artifacts/public/logs/live_backing.log

This fails to build the application.ini.stub:

> 19:31:43     INFO -  build/application.ini.stub
> 19:31:43     INFO -  z:/build/build/src/obj-firefox/_virtualenvs/init/Scripts/python.exe -m mozbuild.action.file_generate z:/build/build/src/python/mozbuild/mozbuild/action/preprocessor.py generate application.ini .deps/application.ini.pp .deps/application.ini.stub z:/build/build/src/build/application.ini.in -DMOZ_APP_VERSION=64.0a1 '-DMOZ_APP_ID={ec8030f7-c20a-464f-9b0e-13a3a9e97384}' -DMOZ_APP_DISPLAYNAME=Nightly -DTOPOBJDIR=z:/build/build/src/obj-firefox -DMOZ_APP_VENDOR=Mozilla -DGRE_MILESTONE=64.0a1 -DMOZ_APP_BASENAME=Firefox -DMOZ_PROFILE_MIGRATOR=1 -DMOZ_BUILD_APP_IS_BROWSER=1 -DMOZ_APP_REMOTINGNAME=firefox -DMAR_CHANNEL_ID=firefox-mozilla-central -DMOZ_CRASHREPORTER=1
> 19:31:43     INFO -  Traceback (most recent call last):
> 19:31:43     INFO -    File "c:\mozilla-build\python\Lib\runpy.py", line 174, in _run_module_as_main
> 19:31:43     INFO -      "__main__", fname, loader, pkg_name)
> 19:31:43     INFO -    File "c:\mozilla-build\python\Lib\runpy.py", line 72, in _run_code
> 19:31:43     INFO -      exec code in run_globals
> 19:31:43     INFO -    File "z:\build\build\src\python\mozbuild\mozbuild\action\file_generate.py", line 110, in <module>
> 19:31:43     INFO -      sys.exit(main(sys.argv[1:]))
> 19:31:43     INFO -    File "z:\build\build\src\python\mozbuild\mozbuild\action\file_generate.py", line 70, in main
> 19:31:43     INFO -      ret = module.__dict__[method](output, *args.additional_arguments, **kwargs)
> 19:31:43     INFO -    File "z:/build/build/src/python/mozbuild/mozbuild/action/preprocessor.py", line 15, in generate
> 19:31:43     INFO -      pp.handleCommandLine(list(args), True)
> 19:31:43     INFO -    File "z:\build\build\src\python\mozbuild\mozbuild\preprocessor.py", line 480, in handleCommandLine
> 19:31:43     INFO -      self.processFile(input=input, output=out)
> 19:31:43     INFO -    File "z:\build\build\src\python\mozbuild\mozbuild\preprocessor.py", line 386, in processFile
> 19:31:43     INFO -      self.do_include(input, False)
> 19:31:43     INFO -    File "z:\build\build\src\python\mozbuild\mozbuild\preprocessor.py", line 775, in do_include
> 19:31:43     INFO -      self.handleLine(l)
> 19:31:43     INFO -    File "z:\build\build\src\python\mozbuild\mozbuild\preprocessor.py", line 549, in handleLine
> 19:31:43     INFO -      cmd(args)
> 19:31:43     INFO -    File "z:\build\build\src\python\mozbuild\mozbuild\preprocessor.py", line 755, in do_include
> 19:31:43     INFO -      raise Preprocessor.Error(self, 'FILE_NOT_FOUND', str(args))
> 19:31:43     INFO -  mozbuild.preprocessor.Error: ('z:\\build\\build\\src\\build\\application.ini.in', 16, 'FILE_NOT_FOUND', 'z:/build/build/src/obj-firefox/buildid.h')
> 19:31:43     INFO -  backend.mk:11: recipe for target '.deps/application.ini.stub' failed
> 19:31:43     INFO -  mozmake.EXE[5]: *** [.deps/application.ini.stub] Error 1
> 19:31:43     INFO -  mozmake.EXE[5]: Leaving directory 'z:/build/build/src/obj-firefox/build'
> 19:31:43     INFO -  mozmake.EXE[5]: *** Waiting for unfinished jobs....
> 19:31:43     INFO -  mozmake.EXE[5]: Entering directory 'z:/build/build/src/obj-firefox/toolkit/locales'
> 19:31:43     INFO -  toolkit/locales/multilocale.txt.stub
> 19:31:43     INFO -  z:/build/build/src/obj-firefox/_virtualenvs/init/Scripts/python.exe -m mozbuild.action.file_generate z:/build/build/src/toolkit/locales/gen_multilocale.py main multilocale.txt .deps/multilocale.txt.pp .deps/multilocale.txt.stub
> 19:31:43     INFO -  mozmake.EXE[5]: Leaving directory 'z:/build/build/src/obj-firefox/toolkit/locales'
> 19:31:43     INFO -  mozmake.EXE[5]: Entering directory 'z:/build/build/src/obj-firefox/security/manager/ssl/tests/unit/pkcs11testmodule'
> 19:31:43     INFO -  security/manager/ssl/tests/unit/pkcs11testmodule/pkcs11testmodule.dll.def.stub
> 19:31:43     INFO -  z:/build/build/src/obj-firefox/_virtualenvs/init/Scripts/python.exe -m mozbuild.action.file_generate z:/build/build/src/python/mozbuild/mozbuild/action/generate_symbols_file.py generate_symbols_file pkcs11testmodule.dll.def .deps/pkcs11testmodule.dll.def.pp .deps/pkcs11testmodule.dll.def.stub z:/build/build/src/security/manager/ssl/tests/unit/pkcs11testmodule/pkcs11testmodule.symbols -DNDEBUG=1 -DTRIMMED=1
> 19:31:43     INFO -  mozmake.EXE[5]: Leaving directory 'z:/build/build/src/obj-firefox/security/manager/ssl/tests/unit/pkcs11testmodule'
> 19:31:43     INFO -  mozmake.EXE[5]: Entering directory 'z:/build/build/src/obj-firefox/build'
> 19:31:43     INFO -  build/automation.py.stub
> 19:31:43     INFO -  z:/build/build/src/obj-firefox/_virtualenvs/init/Scripts/python.exe -m mozbuild.action.file_generate z:/build/build/src/build/gen_automation.py main automation.py .deps/automation.py.pp .deps/automation.py.stub z:/build/build/src/build/automation.py.in
> 19:31:43     INFO -  mozmake.EXE[5]: Leaving directory 'z:/build/build/src/obj-firefox/build'
> 19:31:43     INFO -  z:/build/build/src/config/recurse.mk:101: recipe for target 'build/misc' failed
> 19:31:43     INFO -  mozmake.EXE[4]: *** [build/misc] Error 2
> 19:31:43     INFO -  mozmake.EXE[4]: *** Waiting for unfinished jobs....
This seems to be only happening for pgo builds.
Summary: Intermittent mozbuild.preprocessor.Error: ('z:\\build\\build\\src\\build\\application.ini.in', 16, 'FILE_NOT_FOUND', 'z:/build/build/src/obj-firefox/buildid.h') for artifact builds → Intermittent mozbuild.preprocessor.Error: ('z:\\build\\build\\src\\build\\application.ini.in', 16, 'FILE_NOT_FOUND', 'z:/build/build/src/obj-firefox/buildid.h') for artifact pgo builds
We should not run artifact PGO builds.
Component: General → Task Configuration
(In reply to Ted Mielczarek [:ted] [:ted.mielczarek] from comment #2)
> We should not run artifact PGO builds.

Is it only broken on Windows pgo artifact builds? I have try runs that included the linux64 artifact pgo build, and it seems to be working: https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&group_state=expanded&searchStr=pgo&revision=daef68f0835f4989dc98f92f98fe290445a059dd&selectedJob=211057884

And would turning off the Windows artifact PGO builds just be a matter of adding `keep-artifacts: false` to the "run" section of https://searchfox.org/mozilla-central/source/taskcluster/ci/build/windows.yml#69 and https://searchfox.org/mozilla-central/source/taskcluster/ci/build/windows.yml#327 (a la https://searchfox.org/mozilla-central/source/taskcluster/ci/build/linux.yml#871 )?
Flags: needinfo?(ted)
I don't know enough about how the artifact task configuration works to say, but we should not run artifact PGO builds on any platform. The concept doesn't make sense.
Flags: needinfo?(ted)
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → INCOMPLETE

Chris, I assume this failure will go away with your fix on bug 1517532?

Status: RESOLVED → REOPENED
Flags: needinfo?(cmanchester)
Resolution: INCOMPLETE → ---

Yes that should fix it. Unfortunately I missed this bug somehow along the way, but I think where we ended up here makes sense.

Status: REOPENED → RESOLVED
Closed: 5 years ago → 5 years ago
Flags: needinfo?(cmanchester)
Resolution: --- → DUPLICATE
You need to log in before you can comment on or make changes to this bug.