(In reply to Bryce Seager van Dyk (:bryce) from comment #7) > Do we have mix of passing and failing runs of these tests on MC? I see Linux ones reliably failing in the link from comment 0, but other operating systems look intermittent. E.g. Windows 7 shippable appears to be broken sometimes and other times not. I don't know what this suggest, if anything. Yes it is an intermittent failure, but it's a near-perma failure on linux since it's rarely passed. I haven't been able to find a difference between the passing and failing runs yet. So running locally, I managed to reproduce an error that would cause the task to timeout: ``` TestExecutor: Test 12.2.2.1:PlaybackPerfH264240p30fps@1X threw an error: NotSupportedError: Timed out while waiting for a CDM update ``` Here's what I did, maybe one of you can reproduce it too: ``` hg update -r 31fb4a2a69124b6a21e5d8f44a0407d489749407 ./mach build ./mach raptor -t raptor-youtube-playback-widevine-h264-sfr --post-startup-delay 1 --project mozilla-central # TEST PASSING hg update -r 79d69f36a2202fadd572b0243b618e100d29b525 ./mach build ./mach raptor -t raptor-youtube-playback-widevine-h264-sfr --post-startup-delay 1 --project mozilla-central 1. When the browser starts, and the test page is loading click on the chrome to get focus on the window. 2. Wait for the yellow banner to show, then immediately move the browser window - make sure you hold it for a good bit of time 5-15s (I moved mine to the top-left corner, but it doesn't seem to matter). ``` I haven't seen it pass yet after following these steps on the previous mozilla-central commit (`31fb4a2a69124b6a21e5d8f44a0407d489749407`), I can freely move the browser and the CDM is still installed.
Bug 1649819 Comment 8 Edit History
Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.
(In reply to Bryce Seager van Dyk (:bryce) from comment #7) > Do we have mix of passing and failing runs of these tests on MC? I see Linux ones reliably failing in the link from comment 0, but other operating systems look intermittent. E.g. Windows 7 shippable appears to be broken sometimes and other times not. I don't know what this suggest, if anything. Yes it is an intermittent failure, but it's a near-perma failure on linux since it's rarely passed. I haven't been able to find a difference between the passing and failing runs yet. So running locally, I managed to reproduce an error that would cause the task to timeout: ``` TestExecutor: Test 12.2.2.1:PlaybackPerfH264240p30fps@1X threw an error: NotSupportedError: Timed out while waiting for a CDM update ``` Here's what I did, maybe one of you can reproduce it too: ``` hg update -r 31fb4a2a69124b6a21e5d8f44a0407d489749407 ./mach build ./mach raptor -t raptor-youtube-playback-widevine-h264-sfr --post-startup-delay 1 --project mozilla-central # TEST PASSING hg update -r 79d69f36a2202fadd572b0243b618e100d29b525 ./mach build ./mach raptor -t raptor-youtube-playback-widevine-h264-sfr --post-startup-delay 1 --project mozilla-central 1. When the browser starts, and the test page is loading click on the chrome to get focus on the window. 2. Wait for the yellow banner to show, then immediately move the browser window - make sure you hold it for a good bit of time 5-15s (I moved mine to the top-left corner, but it doesn't seem to matter). ``` I haven't seen it pass yet after following these steps and on the previous mozilla-central commit (`31fb4a2a69124b6a21e5d8f44a0407d489749407`), I can freely move the browser and the CDM is still installed.