Closed Bug 1328915 Opened 3 years ago Closed 2 years ago

disable linux32-debug devtools tests on all branches (trunk, aurora, beta, release, etc.)

Categories

(Release Engineering :: General, defect)

defect
Not set

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: jmaher, Assigned: jmaher)

References

(Blocks 3 open bugs)

Details

(Whiteboard: [stockwell disabled])

Attachments

(4 files, 1 obsolete file)

in addition there is some cleanup we might be able to do on ash for linux scheduled buildbot reftests.
Since we're just starting to run linux32 tests in taskcluster, here are the changes for taskcluster too.

https://treeherder.mozilla.org/#/jobs?repo=try&revision=3fdbf52227d27e7a65ea41ce6008d563fc7000e0
Attachment #8824115 - Flags: review?(jmaher)
Comment on attachment 8824115 [details] [diff] [review]
do not run mochitest-dt on taskcluster linux32/debug

Review of attachment 8824115 [details] [diff] [review]:
-----------------------------------------------------------------

great!
Attachment #8824115 - Flags: review?(jmaher) → review+
Assignee: nobody → jmaher
Status: NEW → ASSIGNED
Attachment #8824135 - Flags: review?(bugspam.Callek)
Attachment #8824137 - Flags: feedback?(ryanvm)
Comment on attachment 8824137 [details]
buildbot differences for the related patch

+1!
Attachment #8824137 - Flags: feedback?(ryanvm) → feedback+
Comment on attachment 8824135 [details] [diff] [review]
disable linux32 debug devtools and linux* on ash

This is going to be really pedantic, but can you please keep the suites alphabetized where you're adding MOCHITEST_DT_8 in?
Comment on attachment 8824135 [details] [diff] [review]
disable linux32 debug devtools and linux* on ash

Review of attachment 8824135 [details] [diff] [review]:
-----------------------------------------------------------------

I'm going to defer this review to buildduty -- however I tend to agree with RyanVM on the pedantic piece ;-)
Attachment #8824135 - Flags: review?(bugspam.Callek) → review?(aselagea)
updated patch to be alphabetical and verified the builder diffs are identical.
Attachment #8824135 - Attachment is obsolete: true
Attachment #8824135 - Flags: review?(aselagea)
Attachment #8824148 - Flags: review?(aselagea)
Comment on attachment 8824148 [details] [diff] [review]
disable linux32 debug devtools and linux* on ash

lgtm!
Attachment #8824148 - Flags: review?(aselagea) → review+
landed this:
https://hg.mozilla.org/build/buildbot-configs/rev/fb273fd16706d9b57d2fb486db3906f17128addb

will wait for test results to post in #releng and then for a reconfig when it is safe or scheduled.
Keywords: leave-open
Pushed by gbrown@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/4bea6ef3d9de
Do not run mochitest-dt on taskcluster linux32/debug; r=jmaher
Blocks: 1249211
Keywords: leave-open
Blocks: 1317152
I like a lame duck as well as the next guy, assuming the next guy is criminally insane and the nature of his insanity is related to unspeakable acts committed upon disabled waterfowl.

Linux32 debug devtools tests are now hidden on every tree.
the remaining work here is tracked in bug 1253312
Pushed by gbrown@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/0de700cdb5b6
Skip linux32/debug devtools tests in clipboard and gpu subsuites; r=me
As :jmaher noted in https://bugzilla.mozilla.org/show_bug.cgi?id=1319218#c5, some devtools tests were still running - and failing - on linux32/debug in subsuite jobs. This patch skips those tests too.
Attachment #8827224 - Flags: review+
The patch in comment 16 caused the gpu job to fail, like https://queue.taskcluster.net/v1/task/KYdIfoFDT_e9bVer4vUkdA/runs/0/artifacts/public/logs/live_backing.log, presumably because all the tests were skipped on linux32/debug. I enabled one of the tests to get around this. What's a better solution?
Flags: needinfo?(jmaher)
Keywords: leave-open
:gbrown, it looks like we are running into a failure where we detect tests to run, then end up skipping all of them and generate an error because no results were found:
[task 2017-01-16T19:47:05.032632Z] 19:47:05     INFO - SUITE-START | Running 4 tests
[task 2017-01-16T19:47:05.033488Z] 19:47:05     INFO - TEST-START | devtools/client/canvasdebugger/test/browser_canvas-actor-test-09.js
[task 2017-01-16T19:47:05.033570Z] 19:47:05     INFO - TEST-SKIP | devtools/client/canvasdebugger/test/browser_canvas-actor-test-09.js | took 1ms
[task 2017-01-16T19:47:05.034208Z] 19:47:05     INFO - TEST-START | devtools/client/canvasdebugger/test/browser_canvas-actor-test-10.js
[task 2017-01-16T19:47:05.034889Z] 19:47:05     INFO - TEST-SKIP | devtools/client/canvasdebugger/test/browser_canvas-actor-test-10.js | took 0ms
[task 2017-01-16T19:47:05.034967Z] 19:47:05     INFO - TEST-START | devtools/client/canvasdebugger/test/browser_canvas-actor-test-11.js
[task 2017-01-16T19:47:05.035627Z] 19:47:05     INFO - TEST-SKIP | devtools/client/canvasdebugger/test/browser_canvas-actor-test-11.js | took 0ms
[task 2017-01-16T19:47:05.035708Z] 19:47:05     INFO - TEST-START | devtools/client/canvasdebugger/test/browser_profiling-webgl.js
[task 2017-01-16T19:47:05.036365Z] 19:47:05     INFO - TEST-SKIP | devtools/client/canvasdebugger/test/browser_profiling-webgl.js | took 0ms
[task 2017-01-16T19:47:05.037048Z] 19:47:05     INFO -  TEST-INFO | checking window state
[task 2017-01-16T19:47:05.037128Z] 19:47:05     INFO -  Browser Chrome Test Summary
[task 2017-01-16T19:47:05.037800Z] 19:47:05     INFO -  	Passed: 0
[task 2017-01-16T19:47:05.037899Z] 19:47:05     INFO -  	Failed: 0
[task 2017-01-16T19:47:05.038576Z] 19:47:05     INFO -  	Todo: 0
[task 2017-01-16T19:47:05.039251Z] 19:47:05     INFO -  	Mode: e10s
[task 2017-01-16T19:47:05.039923Z] 19:47:05     INFO -  *** End BrowserChrome Test Results ***
[task 2017-01-16T19:47:05.040588Z] 19:47:05     INFO - Buffered messages finished
[task 2017-01-16T19:47:05.040661Z] 19:47:05     INFO - SUITE-END | took 0s
[task 2017-01-16T19:47:05.093309Z] 19:47:05    ERROR - Return code: 1
[task 2017-01-16T19:47:05.094527Z] 19:47:05     INFO - TinderboxPrint: mochitest-browser-chrome-gpu<br/>4/0/0
[task 2017-01-16T19:47:05.095102Z] 19:47:05    ERROR - # TBPL FAILURE #


in this case, we should fix the mochitest harness (runtests.py) to look at filtered tests and if there are no tests to run, then ignore the entire directory.
Flags: needinfo?(jmaher)
Whiteboard: [stockwell disabled]
Duplicate of this bug: 1229483
Status: ASSIGNED → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Removing leave-open keyword from resolved bugs, per :sylvestre.
Keywords: leave-open
Component: General Automation → General
Blocks: 1517383
You need to log in before you can comment on or make changes to this bug.