Open Bug 1499994 Opened 6 years ago Updated 2 years ago

Perma-fail test-verify devtools/client/shared/test/browser_telemetry_sidebar.js | DEVTOOLS_COMPUTEDVIEW_OPENED_COUNT correct. - Got {"0":3,"1":0}, expected {"0":2,"1":0}

Categories

(DevTools :: General, defect, P5)

Product:
DevTools
Component:
General
Type:
defect

Tracking

(Not tracked)

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure, leave-open, Whiteboard: [retriggered])

Attachments

(1 file)

Bug 1499994 - Revert test instrumentation for Changes panel telemetry. r=pbro
47 bytes, text/x-phabricator-request
Details | Review 
Filed by: aciure [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=206296014&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/c_ChcUDRRNm8hleU5ByE7Q/runs/0/artifacts/public/logs/live_backing.log

[task 2018-10-18T06:01:43.448Z] 06:01:43     INFO - TEST-PASS | devtools/client/shared/test/browser_telemetry_sidebar.js | DEVTOOLS_RULEVIEW_OPENED_COUNT correct. - 
[task 2018-10-18T06:01:43.449Z] 06:01:43     INFO - Buffered messages finished
[task 2018-10-18T06:01:43.451Z] 06:01:43     INFO - TEST-UNEXPECTED-FAIL | devtools/client/shared/test/browser_telemetry_sidebar.js | DEVTOOLS_COMPUTEDVIEW_OPENED_COUNT correct. - Got [3,0,0], expected [2,0,0]
[task 2018-10-18T06:01:43.453Z] 06:01:43     INFO - Stack trace:
[task 2018-10-18T06:01:43.454Z] 06:01:43     INFO - chrome://mochikit/content/browser-test.js:test_is:1295
[task 2018-10-18T06:01:43.455Z] 06:01:43     INFO - chrome://mochitests/content/browser/devtools/client/shared/test/telemetry-test-helpers.js:checkTelemetry:119
[task 2018-10-18T06:01:43.457Z] 06:01:43     INFO - chrome://mochitests/content/browser/devtools/client/shared/test/browser_telemetry_sidebar.js:checkResults:159
[task 2018-10-18T06:01:43.458Z] 06:01:43     INFO - chrome://mochitests/content/browser/devtools/client/shared/test/browser_telemetry_sidebar.js:null:121
[task 2018-10-18T06:01:43.459Z] 06:01:43     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1093
[task 2018-10-18T06:01:43.460Z] 06:01:43     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1084
[task 2018-10-18T06:01:43.461Z] 06:01:43     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:981
[task 2018-10-18T06:01:43.462Z] 06:01:43     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:795
[task 2018-10-18T06:01:43.464Z] 06:01:43     INFO - Not taking screenshot here: see the one that was previously logged
[task 2018-10-18T06:01:43.467Z] 06:01:43     INFO - TEST-UNEXPECTED-FAIL | devtools/client/shared/test/browser_telemetry_sidebar.js | DEVTOOLS_LAYOUTVIEW_OPENED_COUNT correct. - Got [2,0,0], expected [3,0,0]
[task 2018-10-18T06:01:43.468Z] 06:01:43     INFO - Stack trace:
[task 2018-10-18T06:01:43.468Z] 06:01:43     INFO - chrome://mochikit/content/browser-test.js:test_is:1295
[task 2018-10-18T06:01:43.469Z] 06:01:43     INFO - chrome://mochitests/content/browser/devtools/client/shared/test/telemetry-test-helpers.js:checkTelemetry:119
[task 2018-10-18T06:01:43.470Z] 06:01:43     INFO - chrome://mochitests/content/browser/devtools/client/shared/test/browser_telemetry_sidebar.js:checkResults:160
[task 2018-10-18T06:01:43.471Z] 06:01:43     INFO - chrome://mochitests/content/browser/devtools/client/shared/test/browser_telemetry_sidebar.js:null:121
[task 2018-10-18T06:01:43.472Z] 06:01:43     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1093
[task 2018-10-18T06:01:43.473Z] 06:01:43     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1084
[task 2018-10-18T06:01:43.474Z] 06:01:43     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:981
[task 2018-10-18T06:01:43.476Z] 06:01:43     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:795
Summary: Intermittent devtools/client/shared/test/browser_telemetry_sidebar.js | DEVTOOLS_COMPUTEDVIEW_OPENED_COUNT correct. - Got [3,0,0], expected [2,0,0] → Perma-fail devtools/client/shared/test/browser_telemetry_sidebar.js | DEVTOOLS_COMPUTEDVIEW_OPENED_COUNT correct. - Got [3,0,0], expected [2,0,0]
Summary: Perma-fail devtools/client/shared/test/browser_telemetry_sidebar.js | DEVTOOLS_COMPUTEDVIEW_OPENED_COUNT correct. - Got [3,0,0], expected [2,0,0] → Perma-fail test-verify devtools/client/shared/test/browser_telemetry_sidebar.js | DEVTOOLS_COMPUTEDVIEW_OPENED_COUNT correct. - Got [3,0,0], expected [2,0,0]
Summary: Perma-fail test-verify devtools/client/shared/test/browser_telemetry_sidebar.js | DEVTOOLS_COMPUTEDVIEW_OPENED_COUNT correct. - Got [3,0,0], expected [2,0,0] → Perma-fail test-verify devtools/client/shared/test/browser_telemetry_sidebar.js | DEVTOOLS_COMPUTEDVIEW_OPENED_COUNT correct. - Got {"0":3,"1":0}, expected {"0":2,"1":0}
This bug failed 33 in the last 7 days. Occurs on linux64, osx-10-10, windows10-64, windows7-32 on debug, pgo an opt build types.

Recent log:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=215050989&repo=mozilla-inbound&lineNumber=5707


pbro: Can you please take a look at this bug?
Flags: needinfo?(pbrosset)
I've been trying to take a look but I don't understand enough about the failing test and the helpers it uses to debug this.
Perhaps Razvan (already needinfo'd) can take a look.
Otherwise, I would suggest asking Mike (who I'll needinfo here too).
Flags: needinfo?(pbrosset) → needinfo?(mratcliffe)
This removes the instrumentation to test the basic telemetry for the Changes panel (open count, time opened).
I decided to revert the test instrumentation for telemetry on the Changes panel which is causing this issue. 

I don't know how to fix this. It caused me trouble while working Bug 1509890, but the latest try run for it looked ok and I thought I fixed it: https://treeherder.mozilla.org/#/jobs?repo=try&revision=4bf2df3b650770d8615ee773b736c21c8e7ff926

Since I'm away this week and don't have time to investigate prior to the upcoming merge date, I'd rather just revert the changes.
Flags: needinfo?(rcaliman)
Assignee: nobody → rcaliman
Status: NEW → ASSIGNED
Pushed by rcaliman@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/05e7fea07c8d
Revert test instrumentation for Changes panel telemetry. r=pbro
Landing the patch to address the spike in fails, but leaving this open since this issue predates the Changes telemetry test.
Keywords: leave-open
Flags: needinfo?(mratcliffe)
Assignee: rcaliman → nobody
Status: ASSIGNED → NEW
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: