711549 - PyMake build failure during IDL generation: Unable to create 'ipdl_yacctab.py'

Status: RESOLVED WONTFIX

(Firefox Build System :: General, defect)

Description

[Gregory Szorc [:gps]]

PyMake builds on Windows have been busted for about a day. http://jenkins.gregoryszorc.com:9000/job/mozilla-central/202/ was the first failing job. I can reproduce this failure on multiple Windows 7 build machines.

I am trying to identify the root cause now.

The log output looks something like:

c:\dev\jenkins\mozilla-central\obj-ff-debug\ipc\ipdl\Makefile:122:0$ c:/dev/mozilla-build/python/python2.7.exe c:/dev/jenkins/mozilla-central/config/pythonpath.py	\
  -Ic:/dev/jenkins/mozilla-central/other-licenses/ply		\
  c:/dev/jenkins/mozilla-central/ipc/ipdl/ipdl.py				\
  --outheaders-dir=_ipdlheaders			\
  --outcpp-dir=.				\
  --dependencies				\
  -Ic:/dev/jenkins/mozilla-central/uriloader/exthandler -Ic:/dev/jenkins/mozilla-central/dom/plugins/ipc -Ic:/dev/jenkins/mozilla-central/dom/ipc -Ic:/dev/jenkins/mozilla-central/dom/sms/src/ipc -Ic:/dev/jenkins/mozilla-central/dom/src/storage -Ic:/dev/jenkins/mozilla-central/gfx/layers/ipc -Ic:/dev/jenkins/mozilla-central/hal/sandbox -Ic:/dev/jenkins/mozilla-central/ipc/testshell -Ic:/dev/jenkins/mozilla-central/js/ipc -Ic:/dev/jenkins/mozilla-central/js/jetpack -Ic:/dev/jenkins/mozilla-central/layout/ipc -Ic:/dev/jenkins/mozilla-central/netwerk/ipc -Ic:/dev/jenkins/mozilla-central/netwerk/protocol/ftp -Ic:/dev/jenkins/mozilla-central/netwerk/protocol/http -Ic:/dev/jenkins/mozilla-central/netwerk/protocol/wyciwyg -Ic:/dev/jenkins/mozilla-central/netwerk/protocol/websocket -Ic:/dev/jenkins/mozilla-central/netwerk/cookie -Ic:/dev/jenkins/mozilla-central/uriloader/prefetch		\
  c:/dev/jenkins/mozilla-central/uriloader/exthandler/PExternalHelperApp.ipdl c:/dev/jenkins/mozilla-central/dom/plugins/ipc/PPluginBackgroundDestroyer.ipdl c:/dev/jenkins/mozilla-central/dom/plugins/ipc/PPluginModule.ipdl c:/dev/jenkins/mozilla-central/dom/plugins/ipc/PPluginIdentifier.ipdl c:/dev/jenkins/mozilla-central/dom/plugins/ipc/PPluginInstance.ipdl c:/dev/jenkins/mozilla-central/dom/plugins/ipc/PPluginScriptableObject.ipdl c:/dev/jenkins/mozilla-central/dom/plugins/ipc/PBrowserStream.ipdl c:/dev/jenkins/mozilla-central/dom/plugins/ipc/PPluginStream.ipdl c:/dev/jenkins/mozilla-central/dom/plugins/ipc/PStreamNotify.ipdl c:/dev/jenkins/mozilla-central/dom/plugins/ipc/PPluginSurface.ipdl c:/dev/jenkins/mozilla-central/dom/ipc/PAudio.ipdl c:/dev/jenkins/mozilla-central/dom/ipc/PBrowser.ipdl c:/dev/jenkins/mozilla-central/dom/ipc/PContent.ipdl c:/dev/jenkins/mozilla-central/dom/ipc/PContentDialog.ipdl c:/dev/jenkins/mozilla-central/dom/ipc/PCrashReporter.ipdl c:/dev/jenkins/mozilla-central/dom/ipc/PDocumentRenderer.ipdl c:/dev/jenkins/mozilla-central/dom/ipc/PContentPermissionRequest.ipdl c:/dev/jenkins/mozilla-central/dom/ipc/PMemoryReportRequest.ipdl c:/dev/jenkins/mozilla-central/dom/sms/src/ipc/PSms.ipdl c:/dev/jenkins/mozilla-central/dom/src/storage/PStorage.ipdl c:/dev/jenkins/mozilla-central/gfx/layers/ipc/PLayer.ipdl c:/dev/jenkins/mozilla-central/gfx/layers/ipc/PLayers.ipdl c:/dev/jenkins/mozilla-central/hal/sandbox/PHal.ipdl c:/dev/jenkins/mozilla-central/ipc/testshell/PTestShell.ipdl c:/dev/jenkins/mozilla-central/ipc/testshell/PTestShellCommand.ipdl c:/dev/jenkins/mozilla-central/js/ipc/PContextWrapper.ipdl c:/dev/jenkins/mozilla-central/js/ipc/PObjectWrapper.ipdl c:/dev/jenkins/mozilla-central/js/jetpack/PJetpack.ipdl c:/dev/jenkins/mozilla-central/js/jetpack/PHandle.ipdl c:/dev/jenkins/mozilla-central/layout/ipc/PRenderFrame.ipdl c:/dev/jenkins/mozilla-central/netwerk/ipc/PNecko.ipdl c:/dev/jenkins/mozilla-central/netwerk/protocol/ftp/PFTPChannel.ipdl c:/dev/jenkins/mozilla-central/netwerk/protocol/http/PHttpChannel.ipdl c:/dev/jenkins/mozilla-central/netwerk/protocol/wyciwyg/PWyciwygChannel.ipdl c:/dev/jenkins/mozilla-central/netwerk/protoUnable to create 'ipdl_yacctab.py'
[Errno 22] invalid mode ('w') or filename: 'ipdl_yacctab.py'
Unable to create 'ipdl_yacctab.py'
[Errno 22] invalid mode ('w') or filename: 'ipdl_yacctab.py'
Unable to create 'ipdl_yacctab.py'
[Errno 22] invalid mode ('w') or filename: 'ipdl_yacctab.py'
Unable to create 'ipdl_yacctab.py'
[Errno 22] invalid mode ('w') or filename: 'ipdl_yacctab.py'
Unable to create 'ipdl_yacctab.py'

Comment 1

[Kyle Huey (Exited; not receiving bugmail, old account, do not use)]

BenWa, is this related to your stuff?

Comment 2

[Benoit Girard (:BenWa)]

Yes most certainly. I'm not sure why this would fail with pymake.

Perhaps the following line isn't portable because of the path seperator?
http://mxr.mozilla.org/mozilla-central/source/ipc/ipdl/ipdl/__init__.py#86

Comment 3

[Benoit Girard (:BenWa)]

Attachment: patch

Can you give this a try?

Comment 4

[Yuan Pengfei]

(In reply to Benoit Girard (:BenWa) from comment #3)
> Created attachment 582338 [details] [diff] [review]
> patch
> 
> Can you give this a try?

It does not work.
Now neither pymake nor gmake can do parallel build on Windows.

Comment 5

[Benoit Girard (:BenWa)]

Attachment: patch

If the build doesn't fail with j1 then it must be that we're incorrectly invoking the command for each ipdl instead of only once.

Let me know if this helps.

Comment 6

[Gregory Szorc [:gps]]

The backout of bug 629668 seems to have fixed my automated PyMake Windows build.

Comment 7

[Benoit Girard (:BenWa)]

GPS can you let me know if the attached patch fixes your problem? bug 629668 is a significant build improvement and having it unresolved will only get worse as we add more ipdl files soon.

Comment 8

[Gregory Szorc [:gps]]

The problem persists with attachment 582677 [details] [diff] [review] applied.

Comment 9

[Chris Cooper [:coop] (he/him)]

Mass close of pymake-related bugs.