1224627 - If I use --tag and some mochitest subsuite doesn't run any tests because of that, the subsuite should pass, not fail

Status: NEW

(Testing :: Mochitest, defect)

Description

[Nick Fitzgerald [:fitzgen] [⏰PST; UTC-8]]

Example try push: https://treeherder.mozilla.org/#/jobs?repo=try&revision=faff97a08ad9

Try syntax: "try: -b do -p all -u xpcshell,mochitests -t none --tag devtools-memory"

There are a bunch of random mochitests in a few different random mochitest subsuites/chunks that are tagged devtools-memory, but most subsuites/chunks don't have any such tagged tests. That leads to most of them failing, when really running zero tests is what is expected and correct.

Comment 1

[Nick Fitzgerald [:fitzgen] [⏰PST; UTC-8]]

Attachment: wow so many failures

Comment 2

[Nick Fitzgerald [:fitzgen] [⏰PST; UTC-8]]

Attachment: nevermind, not a failure, it just didn't run tests (as expected)