Closed Bug 1154755 Opened 10 years ago Closed 10 years ago

Investigate win32file module import error for 2008 puppet configured

Categories

(Infrastructure & Operations :: RelOps: General, task)

Product:
Infrastructure & Operations
Component:
RelOps: General
Platform:
x86_64
Windows 7
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: markco, Assigned: markco)

References

Details

http://dev-master2.bb.releng.use1.mozilla.com:8401/builders/WINNT%205.2%20mozilla-central%20build/builds/19/steps/run_script/logs/stdio 13:29:39 INFO - Traceback (most recent call last): 13:29:39 INFO - File "c:\builds\moz2_slave\m-cen-w32-00000000000000000000\scripts\external_tools\clobberer.py", line 11, in <module> 13:29:39 INFO - from win32file import RemoveDirectory, DeleteFile, \ 13:29:39 INFO - ImportError: No module named win32file 13:29:39 ERROR - Return code: 1 13:29:39 ERROR - <bound method FxDesktopBuild.run_command of <__main__.FxDesktopBuild object at 0x023BFB90>> failed after 3 tries! 13:29:39 FATAL - failed to clobber build 13:29:39 FATAL - Running post_fatal callback... 13:29:39 ERROR - setting return code to 2 because fatal was called 13:29:39 FATAL - Exiting 2 13:29:39 INFO - Running post-run listener: _summarize 13:29:39 ERROR - # TBPL FAILURE # 13:29:39 INFO - ##### 13:29:39 INFO - ##### FxDesktopBuild summary: 13:29:39 INFO - ##### 13:29:39 ERROR - # TBPL FAILURE #
Assignee: relops → mcornmesser
What does the preceding Python invocation look like? It would be a few lines up in the log..
13:26:39 INFO - Running main action method: clobber 13:26:39 INFO - retry: Calling run_command with args: [['python', 'c:\\builds\\moz2_slave\\m-cen-w32-00000000000000000000\\scripts\\external_tools\\clobberer.py', '-s', 'scripts', '-s', 'logs', '-s', 'buildprops.json', '-s', 'token', '-s', 'oauth.txt', '-t', '168', 'https://api-pub-build.allizom.org/clobberer/lastclobber', u'mozilla-central', u'WINNT 5.2 mozilla-central build', 'm-cen-w32-00000000000000000000', u'b-2008-ec2-0005', u'http://dev-master1.srv.releng.scl3.mozilla.com:8401/']], kwargs: {'error_list': [{'substr': 'Error contacting server', 'explanation': 'Error contacting server for clobberer information.', 'level': 'error'}], 'cwd': 'c:\\builds\\moz2_slave'}, attempt #1 13:26:39 INFO - Running command: ['python', 'c:\\builds\\moz2_slave\\m-cen-w32-00000000000000000000\\scripts\\external_tools\\clobberer.py', '-s', 'scripts', '-s', 'logs', '-s', 'buildprops.json', '-s', 'token', '-s', 'oauth.txt', '-t', '168', 'https://api-pub-build.allizom.org/clobberer/lastclobber', u'mozilla-central', u'WINNT 5.2 mozilla-central build', 'm-cen-w32-00000000000000000000', u'b-2008-ec2-0005', u'http://dev-master1.srv.releng.scl3.mozilla.com:8401/'] in c:\builds\moz2_slave 13:26:39 INFO - Copy/paste: python c:\builds\moz2_slave\m-cen-w32-00000000000000000000\scripts\external_tools\clobberer.py -s scripts -s logs -s buildprops.json -s token -s oauth.txt -t 168 https://api-pub-build.allizom.org/clobberer/lastclobber mozilla-central "WINNT 5.2 mozilla-central build" m-cen-w32-00000000000000000000 b-2008-ec2-0005 http://dev-master1.srv.releng.scl3.mozilla.com:8401/ 13:26:39 INFO - Traceback (most recent call last): 13:26:39 INFO - File "c:\builds\moz2_slave\m-cen-w32-00000000000000000000\scripts\external_tools\clobberer.py", line 11, in <module> 13:26:39 INFO - from win32file import RemoveDirectory, DeleteFile, \ 13:26:39 INFO - ImportError: No module named win32file 13:26:39 ERROR - Return code: 1 13:26:39 INFO - retry: Failed, sleeping 60 seconds before retrying 13:27:39 INFO - retry: Calling run_command with args: [['python', 'c:\\builds\\moz2_slave\\m-cen-w32-00000000000000000000\\scripts\\external_tools\\clobberer.py', '-s', 'scripts', '-s', 'logs', '-s', 'buildprops.json', '-s', 'token', '-s', 'oauth.txt', '-t', '168', 'https://api-pub-build.allizom.org/clobberer/lastclobber', u'mozilla-central', u'WINNT 5.2 mozilla-central build', 'm-cen-w32-00000000000000000000', u'b-2008-ec2-0005', u'http://dev-master1.srv.releng.scl3.mozilla.com:8401/']], kwargs: {'error_list': [{'substr': 'Error contacting server', 'explanation': 'Error contacting server for clobberer information.', 'level': 'error'}], 'cwd': 'c:\\builds\\moz2_slave'}, attempt #2 13:27:39 INFO - Running command: ['python', 'c:\\builds\\moz2_slave\\m-cen-w32-00000000000000000000\\scripts\\external_tools\\clobberer.py', '-s', 'scripts', '-s', 'logs', '-s', 'buildprops.json', '-s', 'token', '-s', 'oauth.txt', '-t', '168', 'https://api-pub-build.allizom.org/clobberer/lastclobber', u'mozilla-central', u'WINNT 5.2 mozilla-central build', 'm-cen-w32-00000000000000000000', u'b-2008-ec2-0005', u'http://dev-master1.srv.releng.scl3.mozilla.com:8401/'] in c:\builds\moz2_slave 13:27:39 INFO - Copy/paste: python c:\builds\moz2_slave\m-cen-w32-00000000000000000000\scripts\external_tools\clobberer.py -s scripts -s logs -s buildprops.json -s token -s oauth.txt -t 168 https://api-pub-build.allizom.org/clobberer/lastclobber mozilla-central "WINNT 5.2 mozilla-central build" m-cen-w32-00000000000000000000 b-2008-ec2-0005 http://dev-master1.srv.releng.scl3.mozilla.com:8401/ 13:27:39 INFO - Traceback (most recent call last): 13:27:39 INFO - File "c:\builds\moz2_slave\m-cen-w32-00000000000000000000\scripts\external_tools\clobberer.py", line 11, in <module> 13:27:39 INFO - from win32file import RemoveDirectory, DeleteFile, \ 13:27:39 INFO - ImportError: No module named win32file
OK, so it's just finding Python from PATH. I suppose the next step is to ensure that win32file is actually installed and in the system path (run python, type 'import sys; print sys.path').
>>> print sys.path ['', 'C:\\mozilla-build\\buildbot-0.8.4-pre-moz6\\lib\\site-packages\\distribute -0.6.24-py2.7.egg', 'C:\\mozilla-build\\buildbot-0.8.4-pre-moz6\\lib\\site-packa ges\\pip-1.5.5-py2.7.egg', 'C:\\mozilla-build\\buildbot-0.8.4-pre-moz6\\Scripts\ \python27.zip', 'C:\\mozilla-build\\buildbot-0.8.4-pre-moz6\\DLLs', 'C:\\mozilla -build\\buildbot-0.8.4-pre-moz6\\lib', 'C:\\mozilla-build\\buildbot-0.8.4-pre-mo z6\\lib\\plat-win', 'C:\\mozilla-build\\buildbot-0.8.4-pre-moz6\\lib\\lib-tk', ' C:\\mozilla-build\\buildbot-0.8.4-pre-moz6\\Scripts', 'C:\\mozilla-build\\python \\Lib', 'C:\\mozilla-build\\python\\DLLs', 'C:\\mozilla-build\\python\\Lib\\lib- tk', 'C:\\mozilla-build\\buildbot-0.8.4-pre-moz6', 'C:\\mozilla-build\\buildbot- 0.8.4-pre-moz6\\lib\\site-packages', 'C:\\mozilla-build\\python\\lib\\site-packa ges\\setuptools-0.6c11-py2.7.egg', 'C:\\mozilla-build\\python\\lib\\site-package s\\pywin32-218-py2.7-win32.egg', 'C:\\mozilla-build\\python', 'C:\\mozilla-build \\python\\lib\\site-packages'] >>>
So this seems to because of the hard link between C:\mozilla-build\python and C:\mozilla-build\python27 not acting like a link. I have also seen this failure in datacenter on a try machine configured by Puppet.
Summary: Investigate win32file module import error for 2008 puppet configured AWS instances → Investigate win32file module import error for 2008 puppet configured
It turns out it is not a hard link but a symbolic link.
Blocks: 1156153
It's worth noting that we also saw PATH entries like `C:\mozilla-buildpython` -- so, missing a critical `\`. In some staring at puppet, I couldn't figure out why this would be the case.
The cause of this error was 2 different python directories. Only one of which had access to pywin module. The extra directory was eliminated, and the error ceased. This was addressed in Bug BUG 1156153.
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.