1575575 - Add fullscreen youtube-playback tests for MacOS power testing

Status: RESOLVED FIXED

(Testing :: Raptor, task, P2)

Description

[Greg Mierzwinski [:sparky]]

This bug is to add fullscreen youtube tests for MacOS power testing.

See here for work being done to give the youtube-playback tests the ability to run fullscreen: https://github.com/mozilla/perf-youtube-playback/pull/3

Once that is implemented and running in production, we can add a new test.

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Note that it would be great to have those tests running to verify any improvement for bug 1576107.

Comment 2

[Greg Mierzwinski [:sparky]]

To use this flag in automation on a link like: https://yttest.prod.mozaws.net/2019/main.html?test_type=playbackperf-test&fullscreen=true&raptor=true&command=run&exclude=1,2&muted=true#1567172400697

You have to set this Firefox pref to false: full-screen-api.allow-trusted-requests-only
Also, to remove the full-screen info pop-up at the top of the screen, set the following pref to 0: full-screen-api.warning.timeout

Comment 3

[Greg Mierzwinski [:sparky]]

We won't be able to have fullscreen tests on chrome browsers because they don't have the ability to set a pref/policy setting to allow fullscreen without user-interaction.

I was able to get it working with selenium though:

from selenium import webdriver

drv = webdriver.Chrome()
drv.get('http://localhost/perf-youtube-playback/2019/main.html?test_type=playbackperf-test&raptor=true&command=run&tests=8&muted=true&fullscreen=true')
video = drv.find_element_by_tag_name('video')
video.send_keys('f')

To use this, in the ytp test files, I changed the code that dealt with fullscreen in perf-youtube-playback/2019/main.js (lines 165-170) to:

          document.getElementById(vid).onkeypress = function() {
            document.getElementById(vid).webkitRequestFullscreen();
          }

I think this is another point for getting resource tests out of raptor and into it's own test suite.

Comment 4

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1575575 - Add fullscreen and windowed youtube-playback power tests. r?#perftest

This patch adds fullscreen and windowed youtube tests for the V9 and H264 encoding at 1080p30 and 1080p60. Each subtest runs for 20 page cycles which amounts to about 5 minutes each. It also begins adding these to power test tasks running on the macosx-1014 reference hardware.

Comment 5

[Greg Mierzwinski [:sparky]]

Try run: https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=87488d152cd2f924a21db55ab0325226cca453c6

Comment 6

[Greg Mierzwinski [:sparky]]

Try run after review changes: https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=9d44ec828e7ac046307be9dbb06045434e17707f

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/cfc6ee518965
Add fullscreen and windowed youtube-playback power tests. r=perftest-reviewers,stephendonner,dhouse,rwood

Comment 8

[Stefan Hindli [:stefan_hindli]]

https://hg.mozilla.org/mozilla-central/rev/cfc6ee518965