Closed Bug 1282850 Opened 6 years ago Closed 6 years ago
bump fennec debug builds and tests to tier 1 in Taskcluster
58 bytes, text/x-review-board-request
No description provided.
Test failure rates for Android 4.3 opt and debug appear to be similar on taskcluster as compared to what they have been on buildbot. However, be aware of: - Bug 1280570 -- intermittent DMError failures affecting all Android 4.3 jobs have traditionally caused an automatic retry (a "blue" on treeherder); with taskcluster, these jobs simply fail (an "orange"). - Bug 1271070 and related bugs -- mochitest-gl and other webgl tests are currently prone to crashes in jemalloc_crash; taskcluster tests fail the same way, perhaps a little more frequently. - Robocop appears to be more stable on taskcluster. :) - These are early stages; there isn't a lot of data yet.
looks like we have to be more explicit with each build and suite compared to https://bugzilla.mozilla.org/show_bug.cgi?id=1243024 which is a good thing :) as per dev.planning announcement and coop's email, we are going to try making tc tier 2 jobs more critical for less critical jobs, e.g. debug builds, by making them tier 1. Review commit: https://reviewboard.mozilla.org/r/63588/diff/#index_header See other reviews: https://reviewboard.mozilla.org/r/63588/
Attachment #8769932 - Flags: review?(gbrown)
I'm guessing bug 1281004 will land shortly -- you may be better off rebasing on top of that (it'd certainly be a simpler patch).
hey Wes, would you mind giving bbot fennec debug builds and tests the same tier 2 'treatment' that you gave linux64 here: https://bugzilla.mozilla.org/show_bug.cgi?id=1243024#c13 after comment 2 lands? or show me how? I assume, like bbot jobs, it would be declared somewhere in the treeherder repo itself but I got lost. Could we coordinate this over irc or somewhere so A) I don't catch sheriffs off guard and B) we can time it so there is only 1 tier 1 build and test running at a time?
(In reply to Dustin J. Mitchell [:dustin] from comment #3) > I'm guessing bug 1281004 will land shortly -- you may be better off rebasing > on top of that (it'd certainly be a simpler patch). ah, cool. hoping to land this tomorrow tomorrow. If bug 1281004 lands before that, I'll revert and interdiff. ty for the heads up
(In reply to Jordan Lund (:jlund) from comment #4) > hey Wes, > > would you mind giving bbot fennec debug builds and tests the same tier 2 > 'treatment' that you gave linux64 here: > https://bugzilla.mozilla.org/show_bug.cgi?id=1243024#c13 after comment 2 > lands? > > or show me how? I assume, like bbot jobs, it would be declared somewhere in > the treeherder repo itself but I got lost. Could we coordinate this over irc > or somewhere so A) I don't catch sheriffs off guard and B) we can time it so > there is only 1 tier 1 build and test running at a time? Can do. I think the easiest way to get this done would be for it to land directly to mozilla-central, give it some time so you can verify that everything looks correct, then I can mark the bb jobs tier2, then merge your patch around to the integration branches soon after that.
Comment on attachment 8769932 [details] Bug 1282850 - bump fennec debug builds and tests to tier 1 in Taskcluster, https://reviewboard.mozilla.org/r/63588/#review60670 Remember that autophone is still using the buildbot builds; coordinate with :bc before stopping any buildbot Android builds. (But this change should be fine.) ::: taskcluster/ci/legacy/tasks/builds/android_api_15_debug.yml:57 (Diff revision 1) > # see https://github.com/mozilla/treeherder/blob/master/ui/js/values.js > platform: android-4-0-armv7-api15 > groupSymbol: tc > groupName: Submitted by taskcluster > symbol: B > - tier: 2 > + tier: 1 I think you could just remove the tier: specification and fall back to the tier 1 default. In the long term, I'd prefer that, but for now, maybe it's best to be explicit?
There is already an r+'d patch to rm that file so I don't think explicitness matters :)
Pushed by firstname.lastname@example.org: https://hg.mozilla.org/mozilla-central/rev/412755b08895 bump fennec debug builds and tests to tier 1 in Taskcluster, r=gbrown
This seems to have worked correctly. TC jobs are showing as tier1 and now that I've updated the tier-2 exclusion profile, buildbot jobs are showing as tier-2. We might need to resave the exclusion after jobs have had a chance to run to get the buildbot ones correctly showing as tier-2 everywhere (don't remember exactly how TH handles tier changes for existing buildbot jobs), but I think everything is going correctly as-is. We'll know by the end of the day when these jobs have had a chance to run everywhere on trunk. The tier-2 exclusion list will need to be updated to include aurora/beta/release as this patch makes its way down the release cycle. I don't believe we'll need to include any esr branches since 45 won't be getting this patch, and hopefully we'll be shutting off the buildbot jobs by the time esr52 is a thing.
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla50
You need to log in before you can comment on or make changes to this bug.