Closed Bug 1575575 Opened 2 years ago Closed 2 years ago

Add fullscreen youtube-playback tests for MacOS power testing

Categories

(Testing :: Raptor, task, P2)

Version 3
task

Tracking

(firefox71 fixed)

RESOLVED FIXED
mozilla71
Tracking Status
firefox71 --- fixed

People

(Reporter: sparky, Assigned: sparky)

References

(Blocks 1 open bug)

Details

Attachments

(1 file)

This bug is to add fullscreen youtube tests for MacOS power testing.

See here for work being done to give the youtube-playback tests the ability to run fullscreen: https://github.com/mozilla/perf-youtube-playback/pull/3

Once that is implemented and running in production, we can add a new test.

Status: NEW → ASSIGNED
Priority: -- → P2
No longer depends on: 1572190
Depends on: 1572190

Note that it would be great to have those tests running to verify any improvement for bug 1576107.

Blocks: 1576107

To use this flag in automation on a link like: https://yttest.prod.mozaws.net/2019/main.html?test_type=playbackperf-test&fullscreen=true&raptor=true&command=run&exclude=1,2&muted=true#1567172400697

You have to set this Firefox pref to false: full-screen-api.allow-trusted-requests-only
Also, to remove the full-screen info pop-up at the top of the screen, set the following pref to 0: full-screen-api.warning.timeout

We won't be able to have fullscreen tests on chrome browsers because they don't have the ability to set a pref/policy setting to allow fullscreen without user-interaction.

I was able to get it working with selenium though:

from selenium import webdriver

drv = webdriver.Chrome()
drv.get('http://localhost/perf-youtube-playback/2019/main.html?test_type=playbackperf-test&raptor=true&command=run&tests=8&muted=true&fullscreen=true')
video = drv.find_element_by_tag_name('video')
video.send_keys('f')

To use this, in the ytp test files, I changed the code that dealt with fullscreen in perf-youtube-playback/2019/main.js (lines 165-170) to:

          document.getElementById(vid).onkeypress = function() {
            document.getElementById(vid).webkitRequestFullscreen();
          }

I think this is another point for getting resource tests out of raptor and into it's own test suite.

This patch adds fullscreen and windowed youtube tests for the V9 and H264 encoding at 1080p30 and 1080p60. Each subtest runs for 20 page cycles which amounts to about 5 minutes each. It also begins adding these to power test tasks running on the macosx-1014 reference hardware.

Pushed by gmierz2@outlook.com:
https://hg.mozilla.org/integration/autoland/rev/cfc6ee518965
Add fullscreen and windowed youtube-playback power tests. r=perftest-reviewers,stephendonner,dhouse,rwood
Status: ASSIGNED → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla71
You need to log in before you can comment on or make changes to this bug.