Closed Bug 1332205 Opened 3 years ago Closed 3 years ago

Bump Marionette tests on Android to Tier-2

Categories

(Testing :: Marionette, defect)

Version 3
defect
Not set

Tracking

(firefox52 fixed, firefox-esr52 fixed, firefox53 fixed, firefox54 fixed)

RESOLVED FIXED
mozilla54
Tracking Status
firefox52 --- fixed
firefox-esr52 --- fixed
firefox53 --- fixed
firefox54 --- fixed

People

(Reporter: whimboo, Assigned: whimboo)

References

Details

Attachments

(2 files)

Once bug 1297394 has been fixed we should be good to bump the Marionette tests on Android to Tier-2. With it we will get try exposure so that upcoming changes do not cause new regressions for Android.
All high volume intermittent failures have been fixed. I'm going to work on a patch to bump to tier-2 now.
Assignee: nobody → hskupin
Status: NEW → ASSIGNED
mozreview is currently failing to push to try. So I submitted a try build locally:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=80fe42468afa72b74533da217d62d56b3922e2e1
Attachment #8834293 - Flags: review?(jmaher)
All 90 Mn jobs on try are passing, so we might even have qualified us for Tier-1, but lets do it step by step and watch results over a couple of days until we can think about the next bump, which might only happen for integration branches then.
Comment on attachment 8834293 [details]
Bug 1332205 - Bump Marionette tests on Android to Tier-2.

https://reviewboard.mozilla.org/r/110278/#review111456

thanks for doing many retriggers on try!
Attachment #8834293 - Flags: review?(jmaher) → review+
Pushed by hskupin@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/7a30bb12372f
Bump Marionette tests on Android to Tier-2. r=jmaher
https://hg.mozilla.org/mozilla-central/rev/7a30bb12372f
Status: ASSIGNED → RESOLVED
Closed: 3 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla54
Very low frequency of test failures also for Aurora and Beta. It would be great if we can get this patch uplifted to aurora and beta.
Whiteboard: [checkin-needed-aurora][checkin-needed-beta]
https://hg.mozilla.org/releases/mozilla-aurora/rev/a4493daadab6
Flags: in-testsuite+
Whiteboard: [checkin-needed-aurora][checkin-needed-beta] → [checkin-needed-beta]
This doesn't apply to Beta.
Whiteboard: [checkin-needed-beta]
Some of the TC config changes haven't been made it into beta. So the patch looks indeed different. As attached you can find a patch which applies cleanly.
Whiteboard: [checkin-needed-beta]
Depends on: 1306848
Depends on: 1334035
Depends on: 1341466
You need to log in before you can comment on or make changes to this bug.