1312914 - Intermittent TEST-UNEXPECTED-PASS | /encrypted-media/clearkey-mp4-playback-temporary-events.html | org.w3.clearkey, temporary, mp4, playback, check events - expected FAIL

Status: RESOLVED FIXED

(Testing :: web-platform-tests, defect)

Description

[Treeherder Bug Filer]

Filed by: wkocher [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=38202042&repo=mozilla-inbound

https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-inbound-macosx64-debug/1477415545/mozilla-inbound_yosemite_r7-debug_test-web-platform-tests-1-bm108-tests1-macosx-build1174.txt.gz

This started passing unexpectedly on this push: https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&revision=b71ce57f747f4c492a3588859e488256b7717284

Comment 1

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/7bd4999c4078
Skip these tests for now r=me

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/965602e3bd12
followup followup, disable yet another test

Comment 3

[James Graham [:jgraham]]

I guess the test must have intermittently failed on the try run before update. I think leaving it disabled is OK, but maybe that should be something the EME team decides.

Comment 4

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/7bd4999c4078
https://hg.mozilla.org/mozilla-central/rev/965602e3bd12

Comment 5

[Chris Pearce [:cpearce (Not reading bugmail)]]

Thanks for the ni?.

I'd expect this test to pass once you update the web platform tests. Which looks like is what happened? 

Rather than disabling a test which is "failing" with unexpected-pass, it would be better to mark it as expected-pass. However, I do know that this test changed upstream this morning, so it will fail when we re-sync from upstream.

I'll make a pass over the EME WPT after they've stabilized, and get them working in m-c.