Closed Bug 1507235 Opened Last year Closed 9 months ago
Add capability to run telemetry-tests-client locally
47 bytes, text/x-phabricator-request
|Details | Review|
We need a way to run the telemetry-tests-client suite locally to efficiently develop tests for Firefox Client Telemetry. Currently the following command fails on my setup on OS X with an ImportError: ./mach marionette-test \ --gecko-log "-" \ --binary /Applications/FirefoxNightly.app/Contents/MacOS/firefox-bin \ --server-root=toolkit/components/telemetry/tests/marionette/harness/www \ toolkit/components/telemetry/tests/marionette/tests/client/test_main_tab_scalars.py ImportError: No module named telemetry_harness.testcase :davehunt and I developed a workaround, which can be used a starting point for this: https://gist.github.com/hackebrot/8303a0c75d897c840e30463527df52d4 With this patch applied, I am able to successfully run the telemetry-tests-client tests as you would expect.
Hey Raphael, are you going to work on this anytime soon? Do you have plans for that?
Assignee: nobody → chartjes
Hey Alessio, :chartjes and I discussed this last week!
(In reply to Raphael Pierzina [:raphael] UTC+01:00 from comment #2) > Hey Alessio, :chartjes and I discussed this last week! Cool, thanks! Marking this as P1 so that it shows in our team's dashboard and out of the triage list.
Priority: -- → P1
Getting the following error when trying to run the tests on my macos machine with the suggested patches applied ./mach marionette-test \ --gecko-log "-" \ --binary "/Applications/Firefox Nightly.app/Contents/MacOS/firefox-bin" \ --server-root=toolkit/components/telemetry/tests/marionette/harness/www \ toolkit/components/telemetry/tests/marionette/tests/client/test_main_tab_scalars.py It looks like you tried to run a mach command from an invalid context. The marionette-test command failed to meet the following conditions: is_firefox_or_android - Must have a Firefox or Android build. Run |mach help| to show a list of all commands available to the current context.
Please run `./mach bootstrap` and `./mach build` to set up a Desktop Artifact build on your machine and try again with the marionette-test command.
No, we don't want to have those tests run via `mach marionette test`. Telemetry uses a custom harness, and as such would need it's own implementation of the mach command. See Firefox UI tests for example.
Pushed by email@example.com: https://hg.mozilla.org/integration/autoland/rev/875609b03809 Add capability to run telemetry-tests-client locally; r=raphael
You need to log in before you can comment on or make changes to this bug.