1603266 - Intermittent remote/test/browser/page/browser_scriptToEvaluateOnNewDocument.js | Expected number of contexts got created - Got 3, expected 2

Status: RESOLVED FIXED

(Remote Protocol :: Agent, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ccoroiu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=280748661&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/BL5zZt1CQFOgJpOKpj4qjw/runs/0/artifacts/public/logs/live_backing.log

---

[task 2019-12-11T22:11:16.941Z] 22:11:16 INFO - TEST-PASS | remote/test/browser/page/browser_scriptToEvaluateOnNewDocument.js | Two scripts should have different ids -
[task 2019-12-11T22:11:16.941Z] 22:11:16 INFO - Buffered messages logged at 22:11:14
[task 2019-12-11T22:11:16.942Z] 22:11:16 INFO - CDP client closed
[task 2019-12-11T22:11:16.942Z] 22:11:16 INFO - CDP server stopped
[task 2019-12-11T22:11:16.942Z] 22:11:16 INFO - Leaving test bound
[task 2019-12-11T22:11:16.943Z] 22:11:16 INFO - Entering test bound
[task 2019-12-11T22:11:16.943Z] 22:11:16 INFO - CDP server started
[task 2019-12-11T22:11:16.943Z] 22:11:16 INFO - Buffered messages logged at 22:11:16
[task 2019-12-11T22:11:16.943Z] 22:11:16 INFO - CDP client instantiated
[task 2019-12-11T22:11:16.944Z] 22:11:16 INFO - Runtime.executionContextCreated: isolated
[task 2019-12-11T22:11:16.944Z] 22:11:16 INFO - url data:text/html;charset=utf-8,%3C!doctype%20html%3E%0A%3Cmeta%20charset%3Dutf-8%3E%0Adefault-test-page
[task 2019-12-11T22:11:16.945Z] 22:11:16 INFO - Runtime.executionContextCreated: default
[task 2019-12-11T22:11:16.945Z] 22:11:16 INFO - url data:text/html;charset=utf-8,%3C!doctype%20html%3E%0A%3Cmeta%20charset%3Dutf-8%3E%0A%3Cp%3ENext
[task 2019-12-11T22:11:16.945Z] 22:11:16 INFO - Runtime.executionContextCreated: isolated
[task 2019-12-11T22:11:16.945Z] 22:11:16 INFO - url data:text/html;charset=utf-8,%3C!doctype%20html%3E%0A%3Cmeta%20charset%3Dutf-8%3E%0A%3Cp%3ENext
[task 2019-12-11T22:11:16.945Z] 22:11:16 INFO - Buffered messages finished
[task 2019-12-11T22:11:16.946Z] 22:11:16 INFO - TEST-UNEXPECTED-FAIL | remote/test/browser/page/browser_scriptToEvaluateOnNewDocument.js | Expected number of contexts got created - Got 3, expected 2
[task 2019-12-11T22:11:16.946Z] 22:11:16 INFO - Stack trace:
[task 2019-12-11T22:11:16.946Z] 22:11:16 INFO - chrome://mochikit/content/browser-test.js:test_is:1320
[task 2019-12-11T22:11:16.946Z] 22:11:16 INFO - chrome://mochitests/content/browser/remote/test/browser/page/browser_scriptToEvaluateOnNewDocument.js:checkIsolatedContextAfterLoad:111
[task 2019-12-11T22:11:16.946Z] 22:11:16 INFO - chrome://mochitests/content/browser/remote/test/browser/page/browser_scriptToEvaluateOnNewDocument.js:addWithIsolatedWorldAndNavigate:57
[task 2019-12-11T22:11:16.947Z] 22:11:16 INFO - chrome://mochitests/content/browser/remote/test/browser/head.js:this.add_task/<:42
[task 2019-12-11T22:11:16.947Z] 22:11:16 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1062
[task 2019-12-11T22:11:16.947Z] 22:11:16 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1097
[task 2019-12-11T22:11:16.947Z] 22:11:16 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:925
[task 2019-12-11T22:11:16.947Z] 22:11:16 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:808
[task 2019-12-11T22:11:16.947Z] 22:11:16 INFO - Not taking screenshot here: see the one that was previously logged
[task 2019-12-11T22:11:16.947Z] 22:11:16 INFO - TEST-UNEXPECTED-FAIL | remote/test/browser/page/browser_scriptToEvaluateOnNewDocument.js | Got default context - Got false, expected true
[task 2019-12-11T22:11:16.947Z] 22:11:16 INFO - Stack trace:
[task 2019-12-11T22:11:16.947Z] 22:11:16 INFO - chrome://mochikit/content/browser-test.js:test_is:1320
[task 2019-12-11T22:11:16.947Z] 22:11:16 INFO - chrome://mochitests/content/browser/remote/test/browser/page/browser_scriptToEvaluateOnNewDocument.js:checkIsolatedContextAfterLoad:112
[task 2019-12-11T22:11:16.947Z] 22:11:16 INFO - chrome://mochitests/content/browser/remote/test/browser/page/browser_scriptToEvaluateOnNewDocument.js:addWithIsolatedWorldAndNavigate:57
[task 2019-12-11T22:11:16.947Z] 22:11:16 INFO - chrome://mochitests/content/browser/remote/test/browser/head.js:this.add_task/<:42
[task 2019-12-11T22:11:16.947Z] 22:11:16 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1062
[task 2019-12-11T22:11:16.948Z] 22:11:16 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1097
[task 2019-12-11T22:11:16.948Z] 22:11:16 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:925
[task 2019-12-11T22:11:16.948Z] 22:11:16 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:808
[task 2019-12-11T22:11:16.948Z] 22:11:16 INFO - Not taking screenshot here: see the one that was previously logged

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

That's a new test as written by Maja over on bug 1597879.

Comment 2

[Maja Frydrychowicz :impossibus (was :maja_zf) (needinfo me)]

Attachment: Bug 1603266 - Flush irrelevant events when testing context creation; r=#remote

Comment 3

[Intermittent Failures Robot]

23 failures in 956 pushes (0.024 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 5
• autoland: 18

Platform breakdown:

• windows7-32: 20
• windows10-64-ccov: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603266&startday=2019-12-12&endday=2019-12-12&tree=all

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ac0df4ca8d54
Flush irrelevant events when testing context creation; r=remote-protocol-reviewers,whimboo

Comment 5

[Raul Gurzau (:RaulG)]

https://hg.mozilla.org/mozilla-central/rev/ac0df4ca8d54

Comment 6

[Intermittent Failures Robot]

15 failures in 845 pushes (0.018 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 10
• mozilla-central: 5

Platform breakdown:

• windows7-32: 12
• windows10-64-ccov: 2
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603266&startday=2019-12-13&endday=2019-12-13&tree=all

Comment 7

[Intermittent Failures Robot]

48 failures in 4867 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #22 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 38
• mozilla-central: 10

Platform breakdown:

• windows7-32: 41
• linux64: 1
• windows10-64-ccov: 5
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603266&startday=2019-12-09&endday=2019-12-15&tree=all