Closed Bug 1815731 Opened 2 years ago Closed 2 years ago

Intermittent [TV] remote/cdp/test/browser/runtime/browser_evaluate.js | single tracking bug

Categories

(Remote Protocol :: CDP, defect)

Product:
Remote Protocol
Component:
CDP
Type:
defect

Tracking

(firefox-esr102 unaffected, firefox109 unaffected, firefox110 unaffected, firefox111 disabled, firefox112 affected)

Status:
RESOLVED WORKSFORME
Tracking Flags:
Tracking Status
firefox-esr102 --- unaffected
firefox109 --- unaffected
firefox110 --- unaffected
firefox111 --- disabled
firefox112 --- affected

People

(Reporter: chorotan, Unassigned)

References

(Regression)

Details

(Keywords: intermittent-failure, regression)

Failure push: https://treeherder.mozilla.org/jobs?repo=autoland&revision=228fd72317102a4e983e6371cb20eb474734c587&selectedTaskRun=cO7K0uPHQHiNdkmz48bfIw.0

Failure log: https://firefoxci.taskcluster-artifacts.net/YsYD6SfRS_WhueQ8VR4ABw/0/public/logs/live_backing.log

[task 2023-02-08T14:23:33.795Z] 14:23:33     INFO - TEST-PASS | remote/cdp/test/browser/runtime/browser_evaluate.js | Exception details are passed as a RemoteObject - {"exception":{"type":"string","value":"foo"}} deepEqual {"exception":{"type":"string","value":"foo"}} - 
[task 2023-02-08T14:23:33.796Z] 14:23:33     INFO - Buffered messages logged at 14:23:33
[task 2023-02-08T14:23:33.796Z] 14:23:33     INFO - CDP client closed
[task 2023-02-08T14:23:33.797Z] 14:23:33     INFO - Leaving test bound exceptionDetailsThrowValue
[task 2023-02-08T14:23:33.797Z] 14:23:33     INFO - Buffered messages finished
[task 2023-02-08T14:23:33.798Z] 14:23:33     INFO - TEST-UNEXPECTED-FAIL | remote/cdp/test/browser/runtime/browser_evaluate.js | This test exceeded the timeout threshold. It should be rewritten or split up. If that's not possible, use requestLongerTimeout(N), but only as a last resort. - 
[task 2023-02-08T14:23:33.799Z] 14:23:33     INFO - GECKO(1614) | MEMORY STAT | vsize 130552399MB | residentFast 1593MB
[task 2023-02-08T14:23:33.805Z] 14:23:33     INFO - TEST-OK | remote/cdp/test/browser/runtime/browser_evaluate.js | took 132270ms
[task 2023-02-08T14:23:33.806Z] 14:23:33     INFO - GECKO(1614) | 1675866213298	RemoteAgent	TRACE	CDPConnection dfebf945-8e9c-44d4-850b-4627694bd4e3 <- {
[task 2023-02-08T14:23:33.807Z] 14:23:33     INFO - GECKO(1614) | 	"method": "Target.targetCreated",
[task 2023-02-08T14:23:33.807Z] 14:23:33     INFO - GECKO(1614) | 	"params": {
[task 2023-02-08T14:23:33.808Z] 14:23:33     INFO - GECKO(1614) | 		"targetInfo": {
[task 2023-02-08T14:23:33.809Z] 14:23:33     INFO - GECKO(1614) | 			"targetId": "8e55c535-c56b-46df-bd42-4e40b77acec1",
[task 2023-02-08T14:23:33.809Z] 14:23:33     INFO - GECKO(1614) | 			"type": "page",
[task 2023-02-08T14:23:33.810Z] 14:23:33     INFO - GECKO(1614) | 			"title": "",
[task 2023-02-08T14:23:33.810Z] 14:23:33     INFO - GECKO(1614) | 			"url": "about:blank",
[task 2023-02-08T14:23:33.811Z] 14:23:33     INFO - GECKO(1614) | 			"attached": false,
[task 2023-02-08T14:23:33.811Z] 14:23:33     INFO - GECKO(1614) | 			"browserContextId": null
[task 2023-02-08T14:23:33.812Z] 14:23:33     INFO - GECKO(1614) | 		}
[task 2023-02-08T14:23:33.813Z] 14:23:33     INFO - GECKO(1614) | 	}
[task 2023-02-08T14:23:33.813Z] 14:23:33     INFO - GECKO(1614) | }
[task 2023-02-08T14:23:33.814Z] 14:23:33     INFO - GECKO(1614) | 1675866213299	RemoteAgent	TRACE	CDPConnection 13a75867-ede9-49ef-bd05-1251d60d225c <- {
[task 2023-02-08T14:23:33.818Z] 14:23:33     INFO - GECKO(1614) | 	"method": "Target.targetCreated",
[task 2023-02-08T14:23:33.819Z] 14:23:33     INFO - GECKO(1614) | 	"params": {
[task 2023-02-08T14:23:33.820Z] 14:23:33     INFO - GECKO(1614) | 		"targetInfo": {
[task 2023-02-08T14:23:33.820Z] 14:23:33     INFO - GECKO(1614) | 			"targetId": "8e55c535-c56b-46df-bd42-4e40b77acec1",
[task 2023-02-08T14:23:33.821Z] 14:23:33     INFO - GECKO(1614) | 			"type": "page",
[task 2023-02-08T14:23:33.822Z] 14:23:33     INFO - GECKO(1614) | 			"title": "",
[task 2023-02-08T14:23:33.822Z] 14:23:33     INFO - GECKO(1614) | 			"url": "about:blank",
[task 2023-02-08T14:23:33.823Z] 14:23:33     INFO - GECKO(1614) | 			"attached": false,
[task 2023-02-08T14:23:33.824Z] 14:23:33     INFO - GECKO(1614) | 			"browserContextId": null
[task 2023-02-08T14:23:33.824Z] 14:23:33     INFO - GECKO(1614) | 		}
[task 2023-02-08T14:23:33.825Z] 14:23:33     INFO - GECKO(1614) | 	}
[task 2023-02-08T14:23:33.825Z] 14:23:33     INFO - GECKO(1614) | }

:whimboo, since you are the author of the regressor, bug 1786299, could you take a look? Also, could you set the severity field?

For more information, please visit auto_nag documentation.

Flags: needinfo?(hskupin)

Set release status flags based on info from the regressing bug 1786299

status-firefox109: --- → unaffected
status-firefox110: --- → unaffected
status-firefox111: --- → affected
status-firefox-esr102: --- → unaffected
Summary: Intermittent [TV] remote/cdp/test/browser/runtime/browser_evaluate.js | This test exceeded the timeout threshold. It should be rewritten or split up. If that's not possible, use requestLongerTimeout(N), but only as a last resort. → Intermittent [TV] remote/cdp/test/browser/runtime/browser_evaluate.js | single tracking bug
Flags: needinfo?(hskupin)

It should no longer be related to bug 1734020 so maybe splitting the test will already help. I've filed bug 1815838 to do that.

As often with Test Verify bugs, the regression is not necessarily from Bug 1786299. Tests usually don't run with test-verify until they are modified. So it's very likely that Bug 1786299 only surfaced the issue because it triggered the test to run in verify mode.

Set release status flags based on info from the regressing bug 1786299

status-firefox112: --- → affected

Looks like we don't have any other failure since bug 1815838 was fixed.

Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → WORKSFORME

With the addition of the extra Promise tests on bug 1702860 this failure is happening again for TV jobs. I filed bug 1820459 to get the Promise tests split-off to their own files.

Status: RESOLVED → REOPENED
Depends on: 1820459
Flags: needinfo?(oj)
Resolution: WORKSFORME → ---
Flags: needinfo?(oj)

With the fix for bug 1820459 landed the TV jobs work fine again:
https://treeherder.mozilla.org/jobs?repo=autoland&searchStr=tv&revision=ede7a981caffe0b12db4898cfac096a741f15399

Status: REOPENED → RESOLVED
Closed: 2 years ago → 2 years ago
Resolution: --- → WORKSFORME
You need to log in before you can comment on or make changes to this bug.