Open Bug 1585484 Opened 6 months ago Updated 1 month ago

Make `mach browsertime --setup` install `geckodriver` from toolchain tasks

Categories

(Testing :: Performance, task, P3)

Version 3
task

Tracking

(Not tracked)

People

(Reporter: nalexander, Unassigned)

References

(Blocks 1 open bug)

Details

Right now we install a custom geckodriver with preliminary support for Android that I uploaded to Github. See Bug 1556567. But we now have toolchain geckodriver builds (Bug 1534533) with support for Android out of the box (Bug 1525126 and friends). We definitely want a newer geckodriver, and my guess is that using the newest toolchain build will be better than tracking Geckodriver releases explicitly.

This could look like using the artifact installation logic from mach bootstrap in mach browsertime --setup: see https://searchfox.org/mozilla-central/rev/f372e8a46ef7659ef61be9938ec2a3ea34d343c6/python/mozboot/mozboot/base.py#309-328.

Note that you will use developer builds when doing that right now. Maybe for the time being you might want to pin a specific changeset for the download? In the future we want to release geckodriver from taskcluster, but there is still a bit of work to do.

You might also want to use the signed builds of geckodriver to prevent issues with AV software right after releases, or any kind of change to geckodriver. I assume it's not only CI which runs the tests, but also developers on their local machines.

Priority: -- → P1
See Also: → 1592063
Depends on: 1592063
Priority: P1 → P4

Note: Using the official release v0.26 of geckodriver does work when running raptor browsertime on GVE app; so looks like we should be able to move to using the release one instead of the custom driver.

Great to hear! I made a couple of changes based on Nick's WiP, so I cannot tell what actually could have fixed it. But yes, please use the official version of geckodriver for that purpose.

Assignee: nobody → tarek
Priority: P4 → P3

:tarek, are you currently working on this? If you're not actively hacking on this anymore, can you unassign yourself and set it to P3?

Status: NEW → ASSIGNED
Priority: P3 → P1

Now that we do not use a custom geckodriver anymore but a release via browsertime, maybe this bug isn't that important anymore? I would still see benefits from being able to utilize new features and bug fixes in geckodriver before a new release of it happened. But how often is that the case? Feel free to set it back to P2 if it is, otherwise I will follow Greg's advice with P3 for now.

Assignee: tarek → nobody
Status: ASSIGNED → NEW
Priority: P1 → P2

Now that we do not use a custom geckodriver anymore but a release via browsertime, maybe this bug isn't that important anymore? I would still see benefits from being able to utilize new features and bug fixes in geckodriver before a new release of it happened. But how often is that the case? Feel free to set it back to P2 if it is, otherwise I will follow Greg's advice with P3 for now.

Priority: P2 → P3
You need to log in before you can comment on or make changes to this bug.