Resolve CI test failures for the telemetry-tests-client suite

RESOLVED FIXED in Firefox 64

Status

()

enhancement
P1
normal
RESOLVED FIXED
10 months ago
8 months ago

People

(Reporter: raphael, Assigned: raphael)

Tracking

unspecified
mozilla64
Points:
---
Dependency tree / graph

Firefox Tracking Flags

(firefox64 fixed)

Details

Attachments

(11 attachments, 5 obsolete attachments)

46 bytes, text/x-phabricator-request
Details | Review
46 bytes, text/x-phabricator-request
Details | Review
46 bytes, text/x-phabricator-request
Details | Review
46 bytes, text/x-phabricator-request
Details | Review
46 bytes, text/x-phabricator-request
Details | Review
46 bytes, text/x-phabricator-request
Details | Review
46 bytes, text/x-phabricator-request
Details | Review
46 bytes, text/x-phabricator-request
Details | Review
46 bytes, text/x-phabricator-request
Details | Review
46 bytes, text/x-phabricator-request
Details | Review
46 bytes, text/x-phabricator-request
Details | Review
Currently the telemetry-tests-client suite fails on CI due to an issue with installing Python dependencies.

See try build https://treeherder.mozilla.org/#/jobs?repo=try&revision=ba593ba8f3c602ae79e1b0d410218a515a541d61&filter-tier=1&filter-tier=2&filter-tier=3&selectedJob=197340728
Resolved an issue with installing "mozterm" from telemetry_tests_requirements.txt by updating "../tools/mozterm" to "../../python/mozterm".
It appears marionette/harness/marionette_harness/runner/httpd.py is coded against "WebTestHttpd" of wptserve 2.0, however the environment has 1.4 installed which is the latest release on PyPI and Mozilla's index server. The path to wptserve in config/marionette_requirements.txt is "../tools/wptserve", but probably needs to be "../web-platform/tests/tools/wptserve".
Setting as P1 (which is how we track bugs that are actively worked on).
Priority: -- → P1
Depends on: 1493622
Depends on: 1493658
Currently the telemetry-tests-client suite fails on CI. This patch addresses a series of problems with Python dependencies and the test implementation.
Comment on attachment 9011804 [details]
[telemetry] Resolve CI test failures in telemetry-tests-client suite (Bug 1488468).

Dave Hunt [:davehunt] ⌚️UTC+1 has approved the revision.
Attachment #9011804 - Flags: review+
QA Contact: gfritzsche

Comment 20

8 months ago
Pushed by dhunt@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/246160f26d96
Bump wptserve in marionette_requirements.txt to 2.0.0; r=davehunt
https://hg.mozilla.org/integration/autoland/rev/af05b1808f36
Do not share ping_list of TelemetryTestCase between instances; r=davehunt
https://hg.mozilla.org/integration/autoland/rev/5084bccfd9ac
Update telemetry_client.py to expect three return values for evaluate_parser(); r=davehunt
https://hg.mozilla.org/integration/autoland/rev/b6f68f56cc7f
Remove wait.until calls and improve formatting in test_main_tab_scalar; r=davehunt
https://hg.mozilla.org/integration/autoland/rev/b2a9499e2c3e
Update requirements files for telemetry tests; r=davehunt
Blocks: 1382854
Attachment #9014841 - Attachment is obsolete: true
Attachment #9014530 - Attachment is obsolete: true
Attachment #9014537 - Attachment is obsolete: true
Attachment #9014539 - Attachment is obsolete: true
Attachment #9011804 - Attachment is obsolete: true
:raphael as this bug is closed, we typically take care of follow ups by opening new bugs. I reviewed the patches before realising they're attached to a closed bug. Could you open a new bug and submit your patches again, and you can carry across my r+ or request it again and I'll approve/land them.
Flags: needinfo?(rpierzina)
Reopening the bug this time for the follow-ups. Next time please really create a new bug for that.
Status: RESOLVED → REOPENED
Flags: needinfo?(rpierzina)
Resolution: FIXED → ---

Comment 26

8 months ago
Pushed by hskupin@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/bf88501c1f8a
Filter ping_list in Wait function of TelemetryTestCase; r=davehunt
https://hg.mozilla.org/integration/autoland/rev/51b87be56bca
Move HTTP POST request to wait_for_ping in TestPingServer; r=davehunt

Comment 27

8 months ago
bugherder
https://hg.mozilla.org/mozilla-central/rev/bf88501c1f8a
https://hg.mozilla.org/mozilla-central/rev/51b87be56bca
Status: REOPENED → RESOLVED
Closed: 8 months ago8 months ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.