Closed Bug 1332205 Opened 3 years ago Closed 3 years ago

Bump Marionette tests on Android to Tier-2


(Testing :: Marionette, defect)

Version 3
Not set


(firefox52 fixed, firefox-esr52 fixed, firefox53 fixed, firefox54 fixed)

Tracking Status
firefox52 --- fixed
firefox-esr52 --- fixed
firefox53 --- fixed
firefox54 --- fixed


(Reporter: whimboo, Assigned: whimboo)




(2 files)

Once bug 1297394 has been fixed we should be good to bump the Marionette tests on Android to Tier-2. With it we will get try exposure so that upcoming changes do not cause new regressions for Android.
All high volume intermittent failures have been fixed. I'm going to work on a patch to bump to tier-2 now.
Assignee: nobody → hskupin
mozreview is currently failing to push to try. So I submitted a try build locally:
Attachment #8834293 - Flags: review?(jmaher)
All 90 Mn jobs on try are passing, so we might even have qualified us for Tier-1, but lets do it step by step and watch results over a couple of days until we can think about the next bump, which might only happen for integration branches then.
Comment on attachment 8834293 [details]
Bug 1332205 - Bump Marionette tests on Android to Tier-2.

thanks for doing many retriggers on try!
Attachment #8834293 - Flags: review?(jmaher) → review+
Pushed by
Bump Marionette tests on Android to Tier-2. r=jmaher
Closed: 3 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla54
Very low frequency of test failures also for Aurora and Beta. It would be great if we can get this patch uplifted to aurora and beta.
Whiteboard: [checkin-needed-aurora][checkin-needed-beta]
Flags: in-testsuite+
Whiteboard: [checkin-needed-aurora][checkin-needed-beta] → [checkin-needed-beta]
This doesn't apply to Beta.
Whiteboard: [checkin-needed-beta]
Some of the TC config changes haven't been made it into beta. So the patch looks indeed different. As attached you can find a patch which applies cleanly.
Whiteboard: [checkin-needed-beta]
Depends on: 1306848
Depends on: 1334035
Depends on: 1341466
You need to log in before you can comment on or make changes to this bug.