1604202 - Intermittent devtools/client/netmonitor/test/browser_net_websocket_stacks.js | The attached url is correct. - Got http://example.com/browser/devtools/client/netmonitor/test/js_websocket-worker-test.js, expected ws://localhost:8080/

Status: ASSIGNED

(DevTools :: Netmonitor, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=281339007&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RmVfnNLuTZWHZcPGSZfqzg/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RmVfnNLuTZWHZcPGSZfqzg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2019-12-16T12:07:41.672Z] 12:07:41 INFO - TEST-PASS | devtools/client/netmonitor/test/browser_net_websocket_stacks.js | Request #0 (document) has an empty stacktrace -
[task 2019-12-16T12:07:41.672Z] 12:07:41 INFO - > Verifying: GET ws://localhost:8080/ ({cause:{type:"websocket", loadingDocumentUri:"http://example.com/browser/devtools/client/netmonitor/test/html_websocket-test-page.html"}})
[task 2019-12-16T12:07:41.673Z] 12:07:41 INFO - Visible index of item: 1
[task 2019-12-16T12:07:41.673Z] 12:07:41 INFO - TEST-PASS | devtools/client/netmonitor/test/browser_net_websocket_stacks.js | The attached method is correct. -
[task 2019-12-16T12:07:41.674Z] 12:07:41 INFO - Buffered messages finished
[task 2019-12-16T12:07:41.674Z] 12:07:41 INFO - TEST-UNEXPECTED-FAIL | devtools/client/netmonitor/test/browser_net_websocket_stacks.js | The attached url is correct. - Got http://example.com/browser/devtools/client/netmonitor/test/js_websocket-worker-test.js, expected ws://localhost:8080/
[task 2019-12-16T12:07:41.674Z] 12:07:41 INFO - Stack trace:
[task 2019-12-16T12:07:41.675Z] 12:07:41 INFO - chrome://mochikit/content/browser-test.js:test_is:1320
[task 2019-12-16T12:07:41.675Z] 12:07:41 INFO - chrome://mochitests/content/browser/devtools/client/netmonitor/test/head.js:verifyRequestItemTarget:540
[task 2019-12-16T12:07:41.675Z] 12:07:41 INFO - chrome://mochitests/content/browser/devtools/client/netmonitor/test/head.js:validateRequests/<:1083
[task 2019-12-16T12:07:41.676Z] 12:07:41 INFO - chrome://mochitests/content/browser/devtools/client/netmonitor/test/head.js:validateRequests:1079
[task 2019-12-16T12:07:41.676Z] 12:07:41 INFO - chrome://mochitests/content/browser/devtools/client/netmonitor/test/browser_net_websocket_stacks.js:null:78
[task 2019-12-16T12:07:41.676Z] 12:07:41 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1062
[task 2019-12-16T12:07:41.677Z] 12:07:41 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1097
[task 2019-12-16T12:07:41.679Z] 12:07:41 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:919
[task 2019-12-16T12:07:41.679Z] 12:07:41 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:808
[task 2019-12-16T12:07:41.680Z] 12:07:41 INFO - TEST-PASS | devtools/client/netmonitor/test/browser_net_websocket_stacks.js | The displayed method is correct. -
[task 2019-12-16T12:07:41.680Z] 12:07:41 INFO - TEST-PASS | devtools/client/netmonitor/test/browser_net_websocket_stacks.js | The displayed file is correct. -
[task 2019-12-16T12:07:41.684Z] 12:07:41 INFO - Not taking screenshot here: see the one that was previously logged

Comment 1

[Intermittent Failures Robot]

18 failures in 803 pushes (0.022 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 8
• mozilla-central: 10

Platform breakdown:

• linux64: 2
• windows10-64: 3
• windows7-32: 3
• macosx1014-64-shippable: 2
• macosx1014-64: 2
• linux64-shippable: 2
• windows7-32-shippable: 2
• windows10-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604202&startday=2019-12-16&endday=2019-12-16&tree=all

Comment 2

[Intermittent Failures Robot]

18 failures in 4582 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 10

Platform breakdown:

• linux64: 2
• windows10-64: 3
• windows7-32: 3
• macosx1014-64-shippable: 2
• macosx1014-64: 2
• linux64-shippable: 2
• windows7-32-shippable: 2
• windows10-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604202&startday=2019-12-16&endday=2019-12-22&tree=all

Comment 3

[Intermittent Failures Robot]

3 failures in 1862 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1
• try: 1

Platform breakdown:

• macosx1014-64-shippable: 2
• linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604202&startday=2019-12-30&endday=2020-01-05&tree=all

Comment 4

[Intermittent Failures Robot]

1 failures in 4472 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604202&startday=2020-01-06&endday=2020-01-12&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 5483 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604202&startday=2020-03-02&endday=2020-03-08&tree=all

Comment 6

[Intermittent Failures Robot]

1 failures in 4955 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604202&startday=2020-03-16&endday=2020-03-22&tree=all

Comment 7

[Intermittent Failures Robot]

1 failures in 5015 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604202&startday=2020-03-30&endday=2020-04-05&tree=all

Comment 8

[Intermittent Failures Robot]

7 failures in 5582 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7

Platform breakdown:

• windows7-32: 1
• windows10-64: 1
• linux1804-64: 1
• windows10-64-shippable: 1
• linux1804-64-shippable: 1
• windows7-32-shippable: 1
• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604202&startday=2020-04-20&endday=2020-04-26&tree=all

Comment 9

[Bogdan Tara[:bogdan_tara | bogdant]]

This has escalated to Tier 1: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=308994908&repo=autoland&lineNumber=3182

Comment 10

[Intermittent Failures Robot]

27 failures in 1037 pushes (0.026 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 25
• mozilla-central: 2

Platform breakdown:

• windows10-64: 8
• macosx1014-64: 8
• linux1804-64-asan: 6
• macosx1014-64-shippable: 4
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604202&startday=2020-07-08&endday=2020-07-08&tree=all

Comment 11

[Razvan Maries]

It is also a very frequently failure: https://treeherder.mozilla.org/#/jobs?repo=autoland&resultStatus=success%2Cpending%2Crunning%2Ctestfailed%2Cbusted%2Cexception&searchStr=os%2Cx%2C10.14%2Cdebug%2Cmochitests%2Ctest-macosx1014-64%2Fdebug-mochitest-devtools-chrome-e10s-3%2Cm%28dt3%29&tochange=ccd521ebc464ffdad1a5abfa3f03a9df603c67da&fromchange=2d33ba8128eb083af383dc9f70e2b4d4d3db202f&selectedTaskRun=Yec6v5CbSnqkrWYC9B5wOA.0

Comment 12

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

The recent batch of failures is a regression from bug 1437626. Dimi, please investigate.

Comment 13

[Intermittent Failures Robot]

59 failures in 993 pushes (0.059 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 47
• mozilla-central: 7
• try: 5

Platform breakdown:

• macosx1014-64: 28
• linux1804-64-asan: 5
• macosx1014-64-shippable: 7
• linux1804-64-ccov: 1
• windows10-64: 14
• macosx1014-64-devedition: 1
• linux1804-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604202&startday=2020-07-09&endday=2020-07-09&tree=all

Comment 14

[Intermittent Failures Robot]

50 failures in 1064 pushes (0.047 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 42
• mozilla-central: 7
• try: 1

Platform breakdown:

• windows10-64: 13
• macosx1014-64-shippable: 2
• macosx1014-64: 22
• linux1804-64-asan: 7
• windows7-32: 2
• linux1804-64: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604202&startday=2020-07-10&endday=2020-07-10&tree=all

Comment 15

[Razvan Maries]

Attachment: Bug 1604202 - Disabled browser_net_websocket_stacks.js on all platforms. r?#intermittent-reviewers

Comment 16

[Razvan Maries]

There are 144 total failures in the last 7 days. I created a patch to disable this test in order to reduce the failure frequency.

Comment 17

[Intermittent Failures Robot]

16 failures in 236 pushes (0.068 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 14
• try: 2

Platform breakdown:

• macosx1014-64: 4
• windows10-64: 5
• macosx1014-64-shippable: 2
• linux1804-64-asan: 4
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604202&startday=2020-07-11&endday=2020-07-11&tree=all

Comment 18

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/86dc1b71a184
Disabled browser_net_websocket_stacks.js on all platforms. r=jmaher

Comment 19

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/86dc1b71a184

Comment 20

[Intermittent Failures Robot]

165 failures in 5265 pushes (0.031 failures/push) were associated with this bug in the last 7 days.

This is the #5 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 135
• mozilla-central: 18
• try: 12

Platform breakdown:

• macosx1014-64: 68
• windows10-64: 45
• linux1804-64-asan: 23
• macosx1014-64-shippable: 15
• linux1804-64: 10
• linux1804-64-ccov: 1
• macosx1014-64-devedition: 1
• windows7-32: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1604202&startday=2020-07-06&endday=2020-07-12&tree=all

Comment 21

[Dimi Lee [:dimi]]

I can reproduce this in my local build without the patch in bug 1437626. I think the patch in bug 1437626 may affect the timing we trigger network events so the testcase fails more frequently now.
If I understand correctly, the test expects a fixed order of network events[1][2], which isn't true sometimes.

Hi Alexandre,
Since you reviewed the testcase, I would like to know if you or someone you know can help investigate this issue. I am not very familiar with that part so not quite sure how to fix it. Thanks!

[1] https://searchfox.org/mozilla-central/rev/89814940895946b48b4c04c702efd2c676ec8e7e/devtools/client/netmonitor/test/browser_net_websocket_stacks.js#13-48
[2] https://searchfox.org/mozilla-central/rev/89814940895946b48b4c04c702efd2c676ec8e7e/devtools/client/netmonitor/test/head.js#1181-1192

Comment 22

[Alexandre Poirot [:ochameau]]

I'm on PTO, forwarding to bomsy.

Comment 23

[Hubert Boma Manilla (:bomsy)]

Hello Dimi,
Thanks for looking at this.
Yes you are correct the test expects that the network events should be in an expected order, but that does not seem to be the case sometimes.

I've confirmed with the necko team that the platform does not guarantee the order of the requests.
So we should refactor the test to not depend on the order.

I'll have a patch to fix in a bit

Thanks

Comment 24

[Hubert Boma Manilla (:bomsy)]

Attachment: Bug 1604202 - Remove the dependency on the order of the network events r=honza

Comment 25

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/944ef50a7278
Remove the dependency on the order of the network events r=Honza

Comment 26

[Cristina Coroiu [:ccoroiu]]

https://hg.mozilla.org/mozilla-central/rev/944ef50a7278

Comment 27

[Intermittent Failures Robot]

1 failures in 3891 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• macosx1014-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1604202&startday=2021-01-25&endday=2021-01-31&tree=all