Closed
Bug 417935
Opened 17 years ago
Closed 17 years ago
Sisyphus/JavaScript Tests - use restart mode for browser tests
Categories
(Testing Graveyard :: Sisyphus, defect)
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: bc, Assigned: bc)
References
Details
Attachments
(2 files, 1 obsolete file)
1.90 KB,
patch
|
rcampbell
:
review+
|
Details | Diff | Splinter Review |
1.66 KB,
patch
|
rcampbell
:
review+
|
Details | Diff | Splinter Review |
Too many times since we have switched to non-restart mode, I have had the browser tests fail to complete due to regressions on one or the other branch. This means the entire browser test run will fail if a single test crashes or fails to complete.
Since we are running these once per day, the browser tests therefore sometimes will only find the one regression whereas the restart mode browser tests would have run to completion and reported on an unlimited number of regressions. In addition, a timeout regression which prevents a single test from completing can result in the entire test run waiting for the full five hours before it times out.
I recommend adding a -R parameter to all invocations of runtests.sh for the browser tests on each branch. This will use restart mode and allow the tests to complete regardless of regressions.
Flags: in-testsuite-
Flags: in-litmus-
Assignee | ||
Comment 1•17 years ago
|
||
rob, I just copied the method from class SisyphusJSTest(ShellCommand) into class SisyphusBrowserTest(SisyphusJSTest) thinking that it will inherit everything else and only override the start method.
Attachment #303734 -
Flags: review?(rcampbell)
Updated•17 years ago
|
Attachment #303734 -
Flags: review?(rcampbell) → review+
Assignee | ||
Comment 2•17 years ago
|
||
sorry, I should have realized that since we are doing -R now, we can include the tests which crash. I've also added the crash tests to the shell since they don't care.
Attachment #303734 -
Attachment is obsolete: true
Attachment #303738 -
Flags: review?(rcampbell)
Updated•17 years ago
|
Attachment #303738 -
Flags: review?(rcampbell) → review+
Assignee | ||
Comment 3•17 years ago
|
||
Checking in sisyphus.py;
/cvsroot/mozilla/tools/buildbot-configs/testing/sisyphus/sisyphus.py,v <-- sisyphus.py
new revision: 1.6; previous revision: 1.5
done
and copied to qm-jstest01.
Thanks!
Status: ASSIGNED → RESOLVED
Closed: 17 years ago
Resolution: --- → FIXED
Assignee | ||
Comment 4•17 years ago
|
||
I missed the windows parts of this... :-(
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Assignee | ||
Comment 5•17 years ago
|
||
this adds crashes to the windows shell, and crashes and restart to the windows browser tests.
Attachment #303868 -
Flags: review?(rcampbell)
Updated•17 years ago
|
Attachment #303868 -
Attachment is patch: true
Attachment #303868 -
Attachment mime type: application/octet-stream → text/plain
Comment 6•17 years ago
|
||
Comment on attachment 303868 [details] [diff] [review]
patch for windows
yep, that should be fine. I'll find a spot today to move that onto the master.
Attachment #303868 -
Flags: review?(rcampbell) → review+
Updated•17 years ago
|
Whiteboard: [install on master]
Assignee | ||
Comment 7•17 years ago
|
||
/cvsroot/mozilla/tools/buildbot-configs/testing/sisyphus/sisyphus.py,v <-- sisyphus.py
new revision: 1.7; previous revision: 1.6
I actually copied this to jstest01 and restarted everyone already. No need to do more.
Status: REOPENED → RESOLVED
Closed: 17 years ago → 17 years ago
Resolution: --- → FIXED
Assignee | ||
Updated•17 years ago
|
Whiteboard: [install on master]
Comment 8•16 years ago
|
||
Mass move of Sisyphus bugs to Testing : Sisyphus. Filter on SisyphusMassMove to ignore.
Component: Testing → Sisyphus
Flags: in-litmus-
Product: Core → Testing
QA Contact: testing → sisyphus
Updated•6 years ago
|
Product: Testing → Testing Graveyard
You need to log in
before you can comment on or make changes to this bug.
Description
•