1501973 - [telemetry] Update marionette tests to run from tests archive

Status: RESOLVED FIXED

(Toolkit :: Telemetry, enhancement, P1)

Description

[Raphael Aurich [:raphael] UTC+02:00]

Currently the telemetry-tests-client suite [1] requires a source checkout and erroneously works on the assumption, that the tests, the test harness, and the requirements files are located in the user directory on disk [2]. This resulted in errors on the windows worker (see bug 1500185).

Ideally we would update the telemetry marionette tests to run from the tests archive (target.common.tests.tar.gz) and rely on abs_dirs [3] to contain the correct base path to the required files.

[1]: https://searchfox.org/mozilla-central/source/taskcluster/ci/test/misc.yml#60
[2]: https://searchfox.org/mozilla-central/source/testing/mozharness/scripts/telemetry/telemetry_client.py#16
[3]: https://searchfox.org/mozilla-central/source/testing/mozharness/scripts/telemetry/telemetry_client.py#113

Comment 1

[Raphael Aurich [:raphael] UTC+02:00]

Attachment: Bug 1501973 - Add telemetry marionette files to tests archive; r?whimboo,ahal

Comment 2

[Raphael Aurich [:raphael] UTC+02:00]

Attachment: Bug 1501973 - Create requirements file for archived telemetry tests; r?whimboo,ahal

Depends on D9769

Comment 3

[Raphael Aurich [:raphael] UTC+02:00]

Attachment: Bug 1501973 - Update telemetry tests to run from tests archive; r?whimboo,ahal

Depends on D9770

Comment 4

[Raphael Aurich [:raphael] UTC+02:00]

Try run for telemetry-tests-client jobs:
https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=592092f7fc884346efd6386566494f25df5035d4

Comment 5

[Alessio Placitelli [:Dexter]]

Flagging this as P1 as it's being assigned and being worked on.

Comment 6

[Henrik Skupin [:whimboo][⌚️UTC+1]]

What's the status of this bug? I see that all revisions have been closed, but nothing got landed?

Comment 7

[Henrik Skupin [:whimboo][⌚️UTC+1]]

I have just seen that the revisions were all landed separately and not in one batch to autoland earlier today, like:

https://hg.mozilla.org/integration/autoland/rev/ebc6c19f0ba728c79cccce5972fa7bdf87d03929

Why didn't Phabricator or some other tool commented about that on Bugzilla?

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/45a43c25a3db
Create requirements file for archived telemetry tests; r=ahal

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/629bcd4ed798
Update telemetry tests to run from tests archive; r=ahal

Comment 10

[Raul Gurzau (:RaulG)]

https://hg.mozilla.org/mozilla-central/rev/ebc6c19f0ba7
https://hg.mozilla.org/mozilla-central/rev/45a43c25a3db
https://hg.mozilla.org/mozilla-central/rev/629bcd4ed798

Comment 11

[Raphael Aurich [:raphael] UTC+02:00]

The commits for this bug landed. Resolved!