1134888 - /media-source/mediasource-config-change-webm-a-bitrate.html often fails on virtual hardware on Windows

Status: RESOLVED WONTFIX

(Core :: Audio/Video, defect, P5)

Description

[Syd Polk :sydpolk]

The test fails with this:

 1:10.76 TEST_START: Thread-TestrunnerManager-1 /media-source/mediasource-config-change-webm-a-bitrate.html
 1:10.85 PROCESS_OUTPUT: Thread-3 (pid:1524) "WARNING: content window passed to PrivateBrowsingUtils.isWindowPrivate. Use isContentWindowPrivate instead (but only for frame scripts)."
 1:10.85 PROCESS_OUTPUT: Thread-3 (pid:1524) "pbu_isWindowPrivate@resource://gre/modules/PrivateBrowsingUtils.jsm:25:14"
 1:10.86 PROCESS_OUTPUT: Thread-3 (pid:1524) "nsBrowserAccess.prototype.openURI@chrome://browser/content/browser.js:14128:25"
 1:10.86 PROCESS_OUTPUT: Thread-3 (pid:1524) "__marionetteFunc@dummy file:17:30"
 1:10.86 PROCESS_OUTPUT: Thread-3 (pid:1524) "@dummy file:23:3"
 1:10.86 PROCESS_OUTPUT: Thread-3 (pid:1524) "executeWithCallback@chrome://marionette/content/marionette-listener.js:684:5"
 1:10.86 PROCESS_OUTPUT: Thread-3 (pid:1524) "executeAsyncScript@chrome://marionette/content/marionette-listener.js:577:3"
 1:11.45 TEST_END: Thread-TestrunnerManager-1 Harness OK. Subtests passed 0/1. Unexpected 1
Tests webm audio-only bitrate changes.
--------------------------------------
Expected PASS, got FAIL
assert_greater_than: duration expected a number greater than 2 but got NaN
 1:11.62 LOG: Thread-TestrunnerManager-1 WARNING u'runner_teardown' ()
 1:12.11 LOG: Thread-TestrunnerManager-1 INFO Setting up ssl
 1:12.27 PROCESS_OUTPUT: Thread-TestrunnerManager-1 (pid:certutil) ""
 1:12.31 PROCESS_OUTPUT: Thread-TestrunnerManager-1 (pid:certutil) ""
 1:12.34 PROCESS_OUTPUT: Thread-TestrunnerManager-1 (pid:certutil) "
Certificate Nickname                                         Trust Attributes
                                                             SSL,S/MIME,JAR/XPI

web-platform-tests                                           CT,, 

"

Happens with the aurora win32 build and the nightly win32 and win64 builds. Happens on virtual machines and real hardware.

Comment 1

[Syd Polk :sydpolk]

This test passes fine on the Mac:

 1:06.38 TEST_START: Thread-TestrunnerManager-1 /media-source/mediasource-config-change-webm-a-bitrate.html
 1:06.50 PROCESS_OUTPUT: Thread-2 (pid:22627) "WARNING: content window passed to PrivateBrowsingUtils.isWindowPrivate. Use isContentWindowPrivate instead (but only for frame scripts)."
 1:06.50 PROCESS_OUTPUT: Thread-2 (pid:22627) "pbu_isWindowPrivate@resource://gre/modules/PrivateBrowsingUtils.jsm:25:14"
 1:06.50 PROCESS_OUTPUT: Thread-2 (pid:22627) "nsBrowserAccess.prototype.openURI@chrome://browser/content/browser.js:14190:25"
 1:06.50 PROCESS_OUTPUT: Thread-2 (pid:22627) "__marionetteFunc@dummy file:17:30"
 1:06.50 PROCESS_OUTPUT: Thread-2 (pid:22627) "@dummy file:23:3"
 1:06.50 PROCESS_OUTPUT: Thread-2 (pid:22627) "executeWithCallback@chrome://marionette/content/marionette-listener.js:684:5"
 1:06.50 PROCESS_OUTPUT: Thread-2 (pid:22627) "executeAsyncScript@chrome://marionette/content/marionette-listener.js:577:3"
 1:09.85 TEST_END: Thread-TestrunnerManager-1 Harness OK. Subtests passed 1/1. Unexpected 0

Aurora and Nighty; all Mac OS versions.

Comment 2

[Syd Polk :sydpolk]

Attachment: Disable the mediasource-config-change-webm-a-bitrate.html test.

This test is unreliable on Windows, particularly with VMs.

Comment 3

[Syd Polk :sydpolk]

Comment on attachment 8575793 [details] [diff] [review]
Disable the mediasource-config-change-webm-a-bitrate.html test.

Please review. Per discussion in MSE Standup, we are going to skip this test.

Comment 4

[Chris Pearce [:cpearce (Not reading bugmail)]]

Comment on attachment 8575793 [details] [diff] [review]
Disable the mediasource-config-change-webm-a-bitrate.html test.

Review of attachment 8575793 [details] [diff] [review]:
-----------------------------------------------------------------

I'm going to assume this does what it looks like it does, because I don't actually know...

Comment 5

[:Ms2ger (he/him; ⌚ UTC+1/+2)]

https://hg.mozilla.org/integration/mozilla-inbound/rev/56e97ea0233b

Comment 6

[Ralph Giles (:rillian)]

We'd like to uplift this.

Comment 7

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/mozilla-central/rev/56e97ea0233b

Comment 8

[Ralph Giles (:rillian)]

https://hg.mozilla.org/releases/mozilla-aurora/rev/694d3b0b8100

Comment 9

[Ralph Giles (:rillian)]

https://hg.mozilla.org/releases/mozilla-beta/rev/84cb53dff47c

Comment 10

[Jean-Yves Avenard [:jya]]

Will revisit when webm with the new MSE is enabled.

Comment 11

[Firefox Bug Husbandry Bot]

Removing leave-open keyword from resolved bugs, per :sylvestre.