1614372 - ./mach try chooser runs test by default on way too many configurations

Status: NEW

(Developer Infrastructure :: Try, defect, P3)

Description

[Olli Pettay [:smaug][[e-mail]]]

Rather often one just needs basic mochitest and/or wpt tests on a debug build or so.
But try chooser by default selects not only the normal builds, but also -fis, -sw and -qr.
It would be nice to have some checkbox for all those special builds.

Comment 1

[Masayuki Nakano [:masayuki] (he/him)(JST, +0900)]

And also headless should be an option (or somebody might want to test only with headless mode).

Comment 2

[Andrew Halberstadt [:ahal]]

Yes, these are very good ideas.

The logic behind mach try chooser is too tightly coupled to the interface (because I'm not good at web development). While bug 1519449 is definitely not a hard blocker, it may make sense to tackle that one first before making the UI and related logic too much more complicated. Otherwise, solving this bug might be a bad time.

This bug will likely need to sit in the backlog for awhile though as I'm currently working on an "automatic" scheduler (for try and autoland). Though if anyone wants to take a try at it, I'm happy to provide guidance.