651108 - Preproduction buildbotcustom tests should be run file by file

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P2)

Description

[Rail Aliiev [:rail]]

<catlee> rail: can you try running the buildbotcustom tests one by one instead of all at once?
<rail> catlee, what do you mean? file by file?
<catlee> rail: yeah... for f in test/*.py; do python =trial $f; done
<rail> oh, using trial! 
<catlee> yeah, that too
* rail files a bug to not forget this
<rail> catlee, to be sure, the reason to run them file by file is to get better output or something else?
<catlee> rail: to fix the tests
<catlee> rail: there are reload() ordering issues because of the way both trial and nose find tests to run that cause failures

Comment 1

[Rail Aliiev [:rail]]

done in http://hg.mozilla.org/build/preproduction/rev/90630fe9b733

New output can be reviewed here: http://preproduction-master.build.mozilla.org:8710/builders/test-masters/builds/1784/steps/buildbotcustom_tests/logs/stdio