1979400 - ./mach test python/mozperftest/mozperftest/tests/test_mochitest.py doesn't work

Status: NEW

(Testing :: General, defect, P2)

Description

[Florian Quèze [:florian]]

python/mozperftest/mozperftest/tests/test_mochitest.py failed in one of my try pushes, and to reproduce locally to try and fix it, mach test didn't work:

$ ./mach test python/mozperftest/mozperftest/tests/test_mochitest.py
UNKNOWN TEST: python/mozperftest/mozperftest/tests/test_mochitest.py
I was unable to find tests from the given argument(s).

You should specify a test directory, filename, test suite name, or
abbreviation.

It's possible my little brain doesn't know about the type of test you are
trying to execute. If you suspect this, please request support by filing
a bug at
https://bugzilla.mozilla.org/enter_bug.cgi?product=Testing&component=General.

I had to figure out that I needed ./mach perftest-test python/mozperftest/mozperftest/tests/test_mochitest.py instead.

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

The severity field is not set for this bug.
:jmaher, could you have a look please?

For more information, please visit BugBot documentation.

Comment 2

[Greg Mierzwinski [:sparky]]

So this file contains unit tests in mozperftest, is it expected to work with mach test? I have a feeling that this might be an invalid bug, but I'm not sure if unit tests should be runnable through mach test.

Comment 3

[Florian Quèze [:florian]]

(In reply to Greg Mierzwinski [:sparky] from comment #2)

So this file contains unit tests in mozperftest, is it expected to work with mach test? I have a feeling that this might be an invalid bug, but I'm not sure if unit tests should be runnable through mach test.

Is there a reason for perf tests to not run in mach test?

Comment 4

[Greg Mierzwinski [:sparky]]

(In reply to Florian Quèze [:florian] from comment #3)

Is there a reason for perf tests to not run in mach test?

It's not a performance test. I might also be causing some confusion when I say unit test - it's not a unit test for Firefox, but a unit test for the mozperftest test harness (like those that get run in the source-test taskcluster kind, or that you run through ./mach python-test). More specifically, it's a set of unit tests for the mochitest test layer in the mozperftest test harness itself.