1566174 - Taskcluster config for raptor browsertime win10 page-load test

Status: VERIFIED FIXED

(Testing :: Raptor, task, P2)

Description

[Robert Wood [:rwood]]

Create a taskcluster job definition for the raptor browsertime page-load test that will run on Win 10 production performance hardware alongside the other raptor test jobs.

Comment 1

[Nick Alexander :nalexander [he/him]]

Attachment: Bug 1566174 - Pre: Download `fetch-content` in mozharness tests when possible. r?tomprince

This can correctly handle .tar.xz packages, which
_download_fetches does not do.

I do not know under what conditions GECKO_HEAD_* might not be set. I
think there are none but don't know how to prove that, so the fallback
remains.

Depends on D38777

Comment 2

[Nick Alexander :nalexander [he/him]]

Attachment: Bug 1566174 - Part 1: WIP on Fetch ffmpeg for browsertime.

Depends on D38778

Comment 3

[Nick Alexander :nalexander [he/him]]

Attachment: Bug 1566174 - Part 2: WIP on Fetch chromedriver for browsertime.

Depends on D38779

Comment 4

[Nick Alexander :nalexander [he/him]]

Attachment: Bug 1566174 - Part 2: Add browsertime dependencies to Raptor tasks when --browsertime flag is present. r?tomprince,rwood

Depends on D38780

Comment 5

[Nick Alexander :nalexander [he/him]]

Urgh, non of the releng-hardware we care about has Python zstandard available: see https://treeherder.mozilla.org/#/jobs?repo=try&revision=51843fba863369122e2638215aa0816ce5064b39.

glandium, tomprince: I see at https://searchfox.org/mozilla-central/rev/a650fac7b069ded3d63eba530271ce80e6cafb1b/taskcluster/scripts/misc/fetch-content#367-368 that only .tar.zst is supported. Is that just convenience, or is there a reason to restrict? I'd like to expand to something that's available on releng-hardware, probably .tar.bz2.

Comment 6

[Nick Alexander :nalexander [he/him]]

Attachment: Bug 1566174 - Part 1: Add ffmpeg and chromedriver fetch tasks for browsertime. r?#build

Browsertime needs these to produce videos, and to invoke Chrome, respectively.

Comment 7

[Nick Alexander :nalexander [he/him]]

(In reply to Nick Alexander :nalexander [he/him] from comment #5)

Urgh, non of the releng-hardware we care about has Python zstandard available: see https://treeherder.mozilla.org/#/jobs?repo=try&revision=51843fba863369122e2638215aa0816ce5064b39.

glandium, tomprince: I see at https://searchfox.org/mozilla-central/rev/a650fac7b069ded3d63eba530271ce80e6cafb1b/taskcluster/scripts/misc/fetch-content#367-368 that only .tar.zst is supported. Is that just convenience, or is there a reason to restrict? I'd like to expand to something that's available on releng-hardware, probably .tar.bz2.

It looks like this isn't desired: see Bug 1576698 and the review comments. I'm trying to work around all of these factors in the latest patches.

Comment 8

[Nick Alexander :nalexander [he/him]]

Try build without --browsertime: https://treeherder.mozilla.org/#/jobs?repo=try&revision=0fd4107f9a5e067b4ba59c2e85468e532247f662
Try build with --browsertime: https://treeherder.mozilla.org/#/jobs?repo=try&selectedJob=265252353&revision=18bcf9c9a82f3ea0f9702626741d802d1f58b700

The browsertime tasks aren't expected to succeed, but they are expected to run in a reasonable environment. (There is some logging, IIRC.)

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/da82816d4978
Part 1: Add ffmpeg and chromedriver fetch tasks for browsertime. r=froydnj
https://hg.mozilla.org/integration/autoland/rev/77c5686583a5
Part 2: Add browsertime dependencies to Raptor tasks when --browsertime flag is present. r=rwood,tomprince

Comment 10

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/da82816d4978
https://hg.mozilla.org/mozilla-central/rev/77c5686583a5

Comment 11

[Stephen Donner [:stephend] Not actively reading bugmail]

Attachment: Post-fix screenshot

Comment 12

[Stephen Donner [:stephend] Not actively reading bugmail]

Verified FIXED; I was able to push and try to build/run Browsertime (which, as mentioned in comment 8, isn't expected to pass, but will, and does, build w/correct components):

https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=2edd9b6567dee220226d1ef87a3c1e19418335d3&selectedJob=266001871