1539090 - [meta] Test performance of 4k media streaming playback on Fire TV stick 4k

Status: RESOLVED INCOMPLETE

(Testing :: Performance, enhancement, P2)

Description

[Henrik Skupin [:whimboo][⌚️UTC+1]]

This meta bug covers the necessary work to enable performance tests for media streaming the YouTube reference video via Firefox on GeckoView for the Fire TV stick 4k device.

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+1]]

After setting up the connection to the Fire TV stick I checked if Raptor works on that platform, and I can prove that both the tp6m-1 and speedometer tests work fine with the geckoview_example app. Trying to use the Firefox app it fails already with starting the activity:

09:18:14 INFO - adb shell_output: adb -s G070VM0990350952 wait-for-device shell am start -W -n org.mozilla.tv.firefox/org.mozilla.tv.firefox.GeckoViewActivity -a android.intent.action.Main --ez use_multiprocess True --es args "-profile /sdcard/raptor/profile --es env0 LOG_VERBOSE=1 --es env1 R_LOG_LEVEL=6" -d about:blank; echo adb_returncode=$?, timeout: None, root: False, timedout: None, exitcode: 0, output: Starting: Intent { act=android.intent.action.Main dat=about:blank cmp=org.mozilla.tv.firefox/.GeckoViewActivity (has extras) }
09:18:14 INFO - Error type 3
09:18:14 INFO - Error: Activity class {org.mozilla.tv.firefox/org.mozilla.tv.firefox.GeckoViewActivity} does not exist.

If it turns out that we cannot use geckoview_example or the reference browser, we will have to investigate and fix that first. But there would still be the problem that the Firefox app doesn't support WebExtensions which Raptor needs.

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+1]]

I actually filed bug 1539761 for the missing Fire TV platform support.

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Note that with bug 1552484 fixed you are now able to run those tests on the FireTV stick 4k locally. Just run the following mach command with your stick being connected to the computer:

mach raptor-test --test=raptor-youtube-playback --post-startup-delay=0 --app=geckoview --binary org.mozilla.geckoview_example

Now this bug is in blocked state because we still don't have hardware in CI.

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Also I implemented those tests as benchmark tests and not video streaming tests which was covered on bug 1539111.