1647760 - Perma debug + asan telemetry/marionette/tests/client/test_fog_deletion_request_ping.py TestDeletionRequestPing.test_deletion_request_ping_across_sessions when Gecko 79 merges to Beta on 2020-06-29

Status: VERIFIED FIXED

(Toolkit :: Telemetry, defect, P1)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

[Tracking Requested - why for this release]:

central-as-early-beta simulation: https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&selectedTaskRun=aNOsfwi-Qb2SJVLHLpcfkw.0&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=38bee322eba66dfce13232ead776305460ab18f7&searchStr=tt%28c%29

Log: https://treeherder.mozilla.org/logviewer.html#?job_id=307240200&repo=try

[task 2020-06-23T12:25:33.696Z] 12:25:33 INFO - 1592915133682 Marionette DEBUG 1 -> [0,30,"Marionette:SetContext",{"value":"content"}]
[task 2020-06-23T12:25:33.696Z] 12:25:33 INFO - 1592915133683 Marionette DEBUG 1 <- [1,30,null,{"value":null}]
[task 2020-06-23T12:25:33.696Z] 12:25:33 INFO - 1592915133684 Marionette DEBUG 1 -> [0,31,"WebDriver:GetPageSource",{}]
[task 2020-06-23T12:25:33.711Z] 12:25:33 INFO - TEST-UNEXPECTED-FAIL | telemetry/marionette/tests/client/test_fog_deletion_request_ping.py TestDeletionRequestPing.test_deletion_request_ping_across_sessions | AssertionError: Error waiting for ping: Timed out after 60.1 seconds
[task 2020-06-23T12:25:33.712Z] 12:25:33 INFO - Traceback (most recent call last):
[task 2020-06-23T12:25:33.712Z] 12:25:33 INFO - File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_harness/marionette_test/testcases.py", line 196, in run
[task 2020-06-23T12:25:33.712Z] 12:25:33 INFO - testMethod()
[task 2020-06-23T12:25:33.713Z] 12:25:33 INFO - File "/builds/worker/workspace/build/tests/telemetry/marionette/tests/client/test_fog_deletion_request_ping.py", line 20, in test_deletion_request_ping_across_sessions
[task 2020-06-23T12:25:33.714Z] 12:25:33 INFO - ping_server=self.fog_ping_server,
[task 2020-06-23T12:25:33.714Z] 12:25:33 INFO - File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/telemetry_harness/testcase.py", line 153, in wait_for_ping
[task 2020-06-23T12:25:33.714Z] 12:25:33 INFO - [ping] = self.wait_for_pings(action_func, ping_filter, 1, ping_server=ping_server)
[task 2020-06-23T12:25:33.714Z] 12:25:33 INFO - File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/telemetry_harness/testcase.py", line 145, in wait_for_pings
[task 2020-06-23T12:25:33.714Z] 12:25:33 INFO - self.fail("Error waiting for ping: {}".format(e.message))

Comment 1

[Raphael Aurich [:raphael] UTC+01:00]

We use the retrieve the app.update.channel preference using Marionette to dynamically skip the FOG deletion-request ping test on channels other than nightly and default.

Here's a successful try run for this test for reference: https://treeherder.mozilla.org/#/jobs?repo=try&revision=04a34ea5437a0876abde27a365fa19c006408623

Comment 2

[Chris H-C :chutten]

:froydnj recommended instead using AppConstants.NIGHTLY_BUILD for our check, so we'll need to adapt to that.

Comment 3

[Raphael Aurich [:raphael] UTC+01:00]

Adding :chutten's comment on matrix for the sake of documentation:

The specific stumbling block we hit was how the profile's app.update.channel is not the same as the channel used to build the binary

Comment 4

[Chris H-C :chutten]

Attachment: Bug 1647760 - Check the build channel not the profile's channel in fog tests r?raphael!

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/1280c8594a86
Check the build channel not the profile's channel in fog tests r=raphael

Comment 6

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/1280c8594a86

Comment 7

[Natalia Csoregi [:nataliaCs]]

No new occurrences in today's beta-sim: https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&resultStatus=testfailed%2Cbusted%2Cexception%2Crunnable&revision=f8439875f0c6f251ee23c04f5b9547e93722a4c3