Closed Bug 1282850 Opened 6 years ago Closed 6 years ago

bump fennec debug builds and tests to tier 1 in Taskcluster

Categories

(Firefox Build System :: Task Configuration, task)

task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED
mozilla50

People

(Reporter: jlund, Unassigned)

References

Details

Attachments

(1 file)

No description provided.
Depends on: 1282901
Depends on: 1283091
Test failure rates for Android 4.3 opt and debug appear to be similar on taskcluster as compared to what they have been on buildbot. However, be aware of:

 - Bug 1280570 -- intermittent DMError failures affecting all Android 4.3 jobs have traditionally caused an automatic retry (a "blue" on treeherder); with taskcluster, these jobs simply fail (an "orange").
 - Bug 1271070 and related bugs -- mochitest-gl and other webgl tests are currently prone to crashes in jemalloc_crash; taskcluster tests fail the same way, perhaps a little more frequently.
 - Robocop appears to be more stable on taskcluster. :)
 - These are early stages; there isn't a lot of data yet.
looks like we have to be more explicit with each build and suite compared to
https://bugzilla.mozilla.org/show_bug.cgi?id=1243024

which is a good thing :)

as per dev.planning announcement and coop's email, we are going to try making
tc tier 2 jobs more critical for less critical jobs, e.g. debug builds, by
making them tier 1.

Review commit: https://reviewboard.mozilla.org/r/63588/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/63588/
Attachment #8769932 - Flags: review?(gbrown)
I'm guessing bug 1281004 will land shortly -- you may be better off rebasing on top of that (it'd certainly be a simpler patch).
hey Wes,

would you mind giving bbot fennec debug builds and tests the same tier 2 'treatment' that you gave linux64 here: https://bugzilla.mozilla.org/show_bug.cgi?id=1243024#c13 after comment 2 lands?

or show me how? I assume, like bbot jobs, it would be declared somewhere in the treeherder repo itself but I got lost. Could we coordinate this over irc or somewhere so A) I don't catch sheriffs off guard and B) we can time it so there is only 1 tier 1 build and test running at a time?
Flags: needinfo?(wkocher)
(In reply to Dustin J. Mitchell [:dustin] from comment #3)
> I'm guessing bug 1281004 will land shortly -- you may be better off rebasing
> on top of that (it'd certainly be a simpler patch).

ah, cool. hoping to land this tomorrow tomorrow. If bug 1281004 lands before that, I'll revert and interdiff. ty for the heads up
(In reply to Jordan Lund (:jlund) from comment #4)
> hey Wes,
> 
> would you mind giving bbot fennec debug builds and tests the same tier 2
> 'treatment' that you gave linux64 here:
> https://bugzilla.mozilla.org/show_bug.cgi?id=1243024#c13 after comment 2
> lands?
> 
> or show me how? I assume, like bbot jobs, it would be declared somewhere in
> the treeherder repo itself but I got lost. Could we coordinate this over irc
> or somewhere so A) I don't catch sheriffs off guard and B) we can time it so
> there is only 1 tier 1 build and test running at a time?

Can do. I think the easiest way to get this done would be for it to land directly to mozilla-central, give it some time so you can verify that everything looks correct, then I can mark the bb jobs tier2, then merge your patch around to the integration branches soon after that.
Flags: needinfo?(wkocher)
Attachment #8769932 - Flags: review?(gbrown) → review+
Comment on attachment 8769932 [details]
Bug 1282850 - bump fennec debug builds and tests to tier 1 in Taskcluster,

https://reviewboard.mozilla.org/r/63588/#review60670

Remember that autophone is still using the buildbot builds; coordinate with :bc before stopping any buildbot Android builds. (But this change should be fine.)

::: taskcluster/ci/legacy/tasks/builds/android_api_15_debug.yml:57
(Diff revision 1)
>          # see https://github.com/mozilla/treeherder/blob/master/ui/js/values.js
>          platform: android-4-0-armv7-api15
>        groupSymbol: tc
>        groupName: Submitted by taskcluster
>        symbol: B
> -      tier: 2
> +      tier: 1

I think you could just remove the tier: specification and fall back to the tier 1 default. In the long term, I'd prefer that, but for now, maybe it's best to be explicit?
There is already an r+'d patch to rm that file so I don't think explicitness matters :)
Pushed by jlund@mozilla.com:
https://hg.mozilla.org/mozilla-central/rev/412755b08895
bump fennec debug builds and tests to tier 1 in Taskcluster, r=gbrown
This seems to have worked correctly. 

TC jobs are showing as tier1 and now that I've updated the tier-2 exclusion profile, buildbot jobs are showing as tier-2. 

We might need to resave the exclusion after jobs have had a chance to run to get the buildbot ones correctly showing as tier-2 everywhere (don't remember exactly how TH handles tier changes for existing buildbot jobs), but I think everything is going correctly as-is. We'll know by the end of the day when these jobs have had a chance to run everywhere on trunk.

The tier-2 exclusion list will need to be updated to include aurora/beta/release as this patch makes its way down the release cycle. I don't believe we'll need to include any esr branches since 45 won't be getting this patch, and hopefully we'll be shutting off the buildbot jobs by the time esr52 is a thing.
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla50
Depends on: 1294297
Product: TaskCluster → Firefox Build System
You need to log in before you can comment on or make changes to this bug.