Open Bug 1162954 Opened 7 years ago Updated 2 years ago

REFTEST_MANIFESTS property does nothing in automation and is a footgun


(Firefox Build System :: General, defect)

Not set


(Not tracked)


(Reporter: kats, Unassigned)



- Create some new reftests, list them in a reftest.list, and add that list file to REFTEST_MANIFESTS in a file (see e.g.
- Run reftests locally. This works fine
- Push to try.

Expected: reftests run.
Actual: Reftests don't get run.

It looks like the reftest jobs that run in automation completely ignore REFTEST_MANIFESTS and just hard-code layout/reftests/reftest.list as the one and only reftest manifest. This is bad because you could write a bunch of reftests, get them passing locally, do a push to try which is green and land without realizing that your fancy new reftests are not getting run in automation at all.
Product: Core → Firefox Build System
You need to log in before you can comment on or make changes to this bug.