Closed Bug 1503636 Opened Last year Closed Last year

Enable mochitest-media on android-hw-p2 for built-projects

Categories

(Testing :: General, enhancement)

enhancement
Not set

Tracking

(firefox65 fixed)

RESOLVED FIXED
mozilla65
Tracking Status
firefox65 --- fixed

People

(Reporter: bc, Assigned: bc)

References

Details

Attachments

(2 files)

Up until the recent Bug 1502353 we had mochitest-media (mda) enabled on built-projects. Now that we have a stable environment it is time to re-enable them as tier 3 initially.
This carries forward several skips based on android version to include later versions which helps this pass on android-hw.

<https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=b01c21154dc2f671dc72b33b2746488424d25e3a>

Up until Monday or so, we weren't seeing as bad a problem on these tests but either the other changes related to bitbar or something else has surfaced some of these older failures again.

The mda3 failure dom/media/tests/mochitest/test_enumerateDevices.html is something new I haven't seen before but it was only once out of 20 times this push. I think if it reoccurs we can file a normal intermittent bug on it and track it.

We can and should relax some of the android version restrictions in this manifest since we don't test on some of these versions any more but I'll leave that to another time.

gbrown: This might affect your android-em testing so thought you would be interested.
Attachment #9021619 - Flags: review?(jmaher)
Attachment #9021619 - Flags: review?(gbrown)
Let's run this everywhere as tier 3 initially and tier 2 soon. That way we can more easily catch bustage due to taskcluster or releng changes and I will be able to delegate sheriffing to the actual sheriffs and not have to keep as close an eye on them personally. We have plenty of capacity for these as far as I can tell.
Attachment #9021620 - Flags: review?(jmaher)
Comment on attachment 9021619 [details] [diff] [review]
disable-mda1-failing-tests-on-android-hw.patch

Review of attachment 9021619 [details] [diff] [review]:
-----------------------------------------------------------------

The packet.net tests are api level 24, so these changes should help if we want to run mochitest-media there.
Attachment #9021619 - Flags: review?(gbrown) → review+
Attachment #9021619 - Flags: review?(jmaher) → review+
Comment on attachment 9021620 [details] [diff] [review]
enable-mda-on-built-projects.patch

Review of attachment 9021620 [details] [diff] [review]:
-----------------------------------------------------------------

glad to see things turned back on.
Attachment #9021620 - Flags: review?(jmaher) → review+
Pushed by bclary@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/d4960b3082d3
Carry forward disabled mochitest-media tests for android-hw, r=jmaher, gbrown.
https://hg.mozilla.org/integration/mozilla-inbound/rev/716e7d5c3da2
Enable mochitest-media on android-hw-p2 for built-projects, r=jmaher.
https://hg.mozilla.org/mozilla-central/rev/d4960b3082d3
https://hg.mozilla.org/mozilla-central/rev/716e7d5c3da2
Status: ASSIGNED → RESOLVED
Closed: Last year
Resolution: --- → FIXED
Target Milestone: --- → mozilla65
Blocks: 1483695
You need to log in before you can comment on or make changes to this bug.