Closed Bug 1433276 Opened 3 years ago Closed 3 years ago
adjust non-e10s test scheduling
we have retained non-e10s test scheduling for a few reasons: 1) android still ships with non-e10s by default 2) not all desktop tests run on android, for example web-platform-tests which have unique service worker code 3) users can easily turn off e10s to use addons or adjust their browser (not a good reason, but still valid) We chose windows7-debug originally as this provided coverage of assertions and debug information to developers while gaining coverage on windows. Now that we are many months past the initial decision we are looking at what remains for non-e10s coverage and the top 3 reasons still exist. After some discussion we find that linux32-debug will give us great coverage. Ideally in coming months #2 will not be an issue and we can then make a decision that if we have enough tests running on android (geckoview in the future) that we can be confident our browser is stable then we could be closer to making a decision to not run non-e10s on desktop builds.
this is: mochitest-plain mochitest-browser-chrome mochitest-clipboard mochitest-devtools-chrome mochitest-gpu mochitest-webgl reftest reftest-no-accel crashtest jsreftest web-platform-tests web-platform-tests-reftests I wonder if we need: jsreftest reftest-no-accel mochitest-devtools-chrome mochitest-browser-chrome :snorp, a small attempt at reducing the tests by 4 types- what do you think?
Yeah, I think excluding those should be fine.
one last question- should this be on linux32 (stylo by default) or linux32-stylo-disabled ?
this patch will work for linux32/stylo- if we need stylo-disabled instead, I can adjust it quickly. The test failures are ones that were failing in the same way on win7-debug non-e10s
Assignee: nobody → jmaher
Status: NEW → ASSIGNED
(In reply to Joel Maher ( :jmaher) (UTC-5) from comment #3) > one last question- should this be on linux32 (stylo by default) or > linux32-stylo-disabled ? Just testing linux32 with Stylo default is adequate. We don't need to test non-e10s stylo-disabled because Stylo is already enabled by default on Android in Nightly.
Attachment #8945806 - Flags: review?(ahalberstadt)
Comment on attachment 8945806 [details] [diff] [review] move non-e10s testing to linux32-debug Review of attachment 8945806 [details] [diff] [review]: ----------------------------------------------------------------- It was hard to see what changed in the reftest.list, splinter kind of munged things up. Also, aren't there windows annotations in the web-platform manifests that should be removed? (I'm not familiar with these files) The taskcluster changes look good though.
Attachment #8945806 - Flags: review?(ahalberstadt) → review+
the web-platform-tests are really hard to edit- it seems as though we have every possibly config there and sometimes old ones we haven't ran for a long time. I would like to clean them up..i.e. if this is 80% of our cases, default to "timeout" or "crash" or "...", then exceptions for the passes.
Pushed by firstname.lastname@example.org: https://hg.mozilla.org/integration/mozilla-inbound/rev/9d96681c74f2 adjust non-e10s test scheduling. r=ahal
:jmaher, starting with this push, an almost perma failure starts to occur on dom/serviceworkers/test/test_workerupdatefoundevent.html Could you please take a look? Treeherder: https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&filter-resultStatus=testfailed&filter-resultStatus=busted&filter-resultStatus=exception&filter-resultStatus=runnable&filter-resultStatus=success&fromchange=4637ab31ae110a8747761ea00814463c5855b107&filter-searchStr=b5df8d5c2639fef31a716cd37d027da3f49f9643 Log: https://treeherder.mozilla.org/logviewer.html#?job_id=158871318&repo=mozilla-inbound&lineNumber=2146
Flags: needinfo?(jmaher) → needinfo?(bkelly)
Depends on: 1433689
Redirect NI to Marion to find someone to look at comment 10. The code looks just busted there. It should be using throw() instead of the undefined reject(). Its unclear to me if the test will pass if we fix that, though.
Flags: needinfo?(bkelly) → needinfo?(mdaly)
:catalin, can you take a look at this please?
Flags: needinfo?(mdaly) → needinfo?(catalin.badea392)
filed a new bug to re-enable this.
You need to log in before you can comment on or make changes to this bug.