1620339 - make it easy/automatic to run likely-to-fail mochitests

Status: NEW

(Firefox :: Messaging System, task, P3)

Description

[Dan Mosedale (:dmosedale, :dmose)]

In the GitHub repo, we had a special taskcluster docker image that run mochitests for us on every PR, which made for a super tight feedback loop . Now that we're back in m-c, the general infrastructure is that we land something through Phab/Lando, and then if the mochitests fail, it gets backed out.

It would be nice to at least transmogrify the script that we have (browser/components/newtab/mochitest.sh) so that it works correctly locally. Or, alternately, Mardak says he has a similar local script that maybe we should just use to replace the existing mochitest.sh. Both of these scripts run our own mochitests, plus a list of mochitests on things tightly coupled to our work that fail semi-regularly when we make some change.

Markdak also pointed out that such a thing could be implemented in a way that works broadly across m-c (eg mach test-related), but that probably wants to be a spin-off of this bug.