1260903 - Playback tests on YouTube can fail due to Autoplay

Status: RESOLVED INCOMPLETE

(Testing Graveyard :: external-media-tests, defect)

Description

[Bryce Seager van Dyk [:bryce] (he/him) - Not reading bugmail]

When performing playback tests on my local dev build I get intermittent fails due to autoplay moving to another video. This results in the test checking expected conditions against the autoplayed video rather than the video set up by the tests, which in turn fails.

I see this fairly regularly running against my local debug build. I am running with e10s and hardware acceleration both disabled. I am running on Windows 10, on a recent MacBook Pro.

Log from such a failure:

> 2:16.42 TEST_START: MainThread test_video_playback.py TestVideoPlayback.test_video_playback_partial
> 2:33.59 LOG: MainThread INFO https://youtu.be/AbAACm1IQE0
> 2:52.92 LOG: MainThread INFO https://www.youtube.com/watch?v=yOQQCoxs8-k
> 4:41.23 LOG: MainThread INFO https://www.youtube.com/watch?v=1visYpIREUM
> 5:01.54 TEST_END: MainThread FAIL, expected PASS
> Traceback (most recent call last):
>  File "c:\Projects\mozilla-central\testing/marionette/harness\marionette\marionette_test.py", line 351, in run
>    testMethod()
>  File "c:\Projects\mozilla-central\dom/media/test/external\external_media_harness\testcase.py", line 180, in test_video_playback_partial
>    self.run_playback(video)
>  File "c:\Projects\mozilla-central\dom/media/test/external\external_media_harness\testcase.py", line 75, in run_playback
>    raise self.failureException(e)
> AssertionError: Video https://www.youtube.com/watch?v=v-en-iDeZEE&ebc=ANyPxKpR4bUO587m7egFyGIekliQQjojmBLHJ7ysTQl7CBzU1yLvMFbd15w5kigznv2GB2VnfXiFx0ltDtZBeiZsIyopAdRuPQ stalled.
> VideoPuppeteer - test url: https://www.youtube.com/watch?v=1visYpIREUM: {
>         (video)
>         current_time: 5.207,
>         duration: 30.061,
>         expected_duration: 8.056825,
>         lag: 20.7141070586,
>         url: https://www.youtube.com/watch?v=v-en-iDeZEEebc=ANyPxKpR4bUO587m7egFyGIekliQQjojmBLHJ7ysTQl7CBzU1yLvMFbd15w5kigznv2B2VnfXiFx0ltDtZBeiZsIyopAdRuPQ
>         src: mediasource:https://www.youtube.com/de720124-af3e-4cd6-ae59-a204d8b9613e
>         frames total: 184
>          - dropped: 0
>          - corrupted: 0
> }