1609162 - Intermittent remote/cdp/test/browser/<random> | Uncaught exception - [object ProgressEvent] (could not start server on port 9222) [NS_ERROR_SOCKET_ADDRESS_IN_USE]

Status: RESOLVED FIXED

(Remote Protocol :: Agent, defect, P2)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=284860440&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/bwnHcUBDSeqEuTIa63_IcA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-01-14T15:53:26.268Z] 15:53:26 INFO - TEST-PASS | remote/test/browser/target/browser_activateTarget.js | activateTarget raised error without an argument -
[task 2020-01-14T15:53:26.268Z] 15:53:26 INFO - CDP client closed
[task 2020-01-14T15:53:26.268Z] 15:53:26 INFO - CDP server stopped
[task 2020-01-14T15:53:26.268Z] 15:53:26 INFO - Leaving test bound raisesWithoutArguments
[task 2020-01-14T15:53:26.268Z] 15:53:26 INFO - Entering test bound raisesWithUnknownTargetId
[task 2020-01-14T15:53:26.269Z] 15:53:26 INFO - CDP server started
[task 2020-01-14T15:53:26.269Z] 15:53:26 INFO - Buffered messages logged at 15:53:25
[task 2020-01-14T15:53:26.269Z] 15:53:26 INFO - CDP client instantiated
[task 2020-01-14T15:53:26.270Z] 15:53:26 INFO - TEST-PASS | remote/test/browser/target/browser_activateTarget.js | activateTarget raised error with unkown target id -
[task 2020-01-14T15:53:26.274Z] 15:53:26 INFO - CDP client closed
[task 2020-01-14T15:53:26.274Z] 15:53:26 INFO - CDP server stopped
[task 2020-01-14T15:53:26.274Z] 15:53:26 INFO - Leaving test bound raisesWithUnknownTargetId
[task 2020-01-14T15:53:26.274Z] 15:53:26 INFO - Entering test bound selectTabInOtherWindow
[task 2020-01-14T15:53:26.274Z] 15:53:26 INFO - CDP server started
[task 2020-01-14T15:53:26.274Z] 15:53:26 INFO - CDP server stopped
[task 2020-01-14T15:53:26.274Z] 15:53:26 INFO - Buffered messages finished
[task 2020-01-14T15:53:26.275Z] 15:53:26 INFO - TEST-UNEXPECTED-FAIL | remote/test/browser/target/browser_activateTarget.js | Uncaught exception - [object ProgressEvent]
[task 2020-01-14T15:53:26.275Z] 15:53:26 INFO - Leaving test bound selectTabInOtherWindow
[task 2020-01-14T15:53:26.275Z] 15:53:26 INFO - GECKO(4884) | MEMORY STAT vsizeMaxContiguous not supported in this build configuration.
[task 2020-01-14T15:53:26.276Z] 15:53:26 INFO - GECKO(4884) | MEMORY STAT | vsize 2847MB | residentFast 354MB | heapAllocated 159MB
[task 2020-01-14T15:53:26.281Z] 15:53:26 INFO - TEST-OK | remote/test/browser/target/browser_activateTarget.js | took 1781ms

Comment 1

[Intermittent Failures Robot]

1 failures in 3773 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-01-13&endday=2020-01-19&tree=all

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Problem here is that the internal httpd client is not able to create the server socket because it is still in use:

[task 2020-01-14T15:53:24.199Z] 15:53:24     INFO - TEST-START | remote/test/browser/target/browser_activateTarget.js
[task 2020-01-14T15:53:25.449Z] 15:53:25     INFO - GECKO(4884) | !!! could not start server on port 9222: [Exception... "Component returned failure code: 0x804b0036 (NS_ERROR_SOCKET_ADDRESS_IN_USE) [nsIServerSocket.init]"  nsresult: "0x804b0036 (NS_ERROR_SOCKET_ADDRESS_IN_USE)"  location: "JS frame :: chrome://remote/content/server/HTTPD.jsm :: _start :: line 570"  data: no]
[task 2020-01-14T15:53:25.451Z] 15:53:25     INFO - GECKO(4884) | 1579017205445	RemoteAgent	ERROR	unable to stop listener: [Exception... "Unexpected error"  nsresult: "0x8000ffff (NS_ERROR_UNEXPECTED)"  location: "JS frame :: chrome://remote/content/server/HTTPD.jsm :: stop :: line 624"  data: no] Stack trace: stop()@HTTPD.jsm:624
[task 2020-01-14T15:53:25.452Z] 15:53:25     INFO - GECKO(4884) | close()@RemoteAgent.jsm:119
[task 2020-01-14T15:53:25.452Z] 15:53:25     INFO - GECKO(4884) | asyncListen()@RemoteAgent.jsm:100
[task 2020-01-14T15:53:25.453Z] 15:53:25     INFO - GECKO(4884) | 1579017205445	RemoteAgent	ERROR	Unable to start remote agent: : [Exception... "Component is not available"  nsresult: "0x80040111 (NS_ERROR_NOT_AVAILABLE)"  location: "JS frame :: chrome://remote/content/server/HTTPD.jsm :: _start :: line 615"  data: no] Stack trace: _start()@HTTPD.jsm:615
[task 2020-01-14T15:53:25.454Z] 15:53:25     INFO - GECKO(4884) | asyncListen()@RemoteAgent.jsm:93

Comment 5

[Intermittent Failures Robot]

1 failures in 3364 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-02-03&endday=2020-02-09&tree=all

Comment 6

[Intermittent Failures Robot]

2 failures in 4045 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• linux1804-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-02-17&endday=2020-02-23&tree=all

Comment 8

[Intermittent Failures Robot]

3 failures in 5233 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 2

Platform breakdown:

• linux1804-64-ccov: 1
• linux1804-64-shippable: 1
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-02-24&endday=2020-03-01&tree=all

Comment 9

[Intermittent Failures Robot]

3 failures in 5483 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• linux1804-64: 1
• linux1804-64-shippable: 1
• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-03-02&endday=2020-03-08&tree=all

Comment 10

[Intermittent Failures Robot]

1 failures in 4773 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-03-23&endday=2020-03-29&tree=all

Comment 11

[Intermittent Failures Robot]

3 failures in 5015 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 1

Platform breakdown:

• linux1804-64-shippable: 2
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-03-30&endday=2020-04-05&tree=all

Comment 12

[Intermittent Failures Robot]

3 failures in 4823 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 1

Platform breakdown:

• linux1804-64-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-04-06&endday=2020-04-12&tree=all

Comment 14

[Intermittent Failures Robot]

4 failures in 4528 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 3

Platform breakdown:

• linux1804-64: 2
• linux1804-64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-04-13&endday=2020-04-19&tree=all

Comment 15

[Intermittent Failures Robot]

6 failures in 5582 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 1

Platform breakdown:

• linux1804-64-shippable: 1
• linux1804-64-qr: 3
• linux1804-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-04-20&endday=2020-04-26&tree=all

Comment 16

[Intermittent Failures Robot]

4 failures in 5423 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 2

Platform breakdown:

• linux1804-64: 2
• linux1804-64-qr: 1
• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-04-27&endday=2020-05-03&tree=all

Comment 17

[Intermittent Failures Robot]

9 failures in 5276 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 1

Platform breakdown:

• linux1804-64-shippable-qr: 7
• linux1804-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-05-04&endday=2020-05-10&tree=all

Comment 18

[Intermittent Failures Robot]

6 failures in 5488 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6

Platform breakdown:

• linux1804-64: 1
• linux1804-64-shippable-qr: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-05-11&endday=2020-05-17&tree=all

Comment 19

[Intermittent Failures Robot]

7 failures in 4727 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 3

Platform breakdown:

• linux1804-64-shippable: 1
• linux1804-64-shippable-qr: 4
• linux1804-64: 1
• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-05-18&endday=2020-05-24&tree=all

Comment 21

[Intermittent Failures Robot]

6 failures in 5458 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 3

Platform breakdown:

• linux1804-64-shippable-qr: 3
• linux1804-64-shippable: 1
• linux1804-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-05-25&endday=2020-05-31&tree=all

Comment 22

[Intermittent Failures Robot]

5 failures in 4949 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5

Platform breakdown:

• linux1804-64-shippable-qr: 4
• linux1804-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-06-01&endday=2020-06-07&tree=all

Comment 23

[Intermittent Failures Robot]

4 failures in 5211 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1

Platform breakdown:

• linux1804-64-shippable: 2
• linux1804-64-shippable-qr: 1
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-06-08&endday=2020-06-14&tree=all

Comment 25

[Intermittent Failures Robot]

6 failures in 4035 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 2

Platform breakdown:

• linux1804-64-shippable-qr: 4
• linux1804-64-qr: 1
• linux1804-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-06-15&endday=2020-06-21&tree=all

Comment 26

[Intermittent Failures Robot]

6 failures in 5252 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 2

Platform breakdown:

• linux1804-64-shippable-qr: 3
• linux1804-64-qr: 1
• linux1804-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-06-22&endday=2020-06-28&tree=all

Comment 27

[Intermittent Failures Robot]

1 failures in 4516 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-06-29&endday=2020-07-05&tree=all

Comment 28

[Intermittent Failures Robot]

2 failures in 5265 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform breakdown:

• linux1804-64-shippable-qr: 1
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-07-06&endday=2020-07-12&tree=all

Comment 29

[Intermittent Failures Robot]

3 failures in 4014 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform breakdown:

• linux1804-64-qr: 2
• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-07-13&endday=2020-07-19&tree=all

Comment 30

[Intermittent Failures Robot]

2 failures in 4310 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• linux1804-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-07-20&endday=2020-07-26&tree=all

Comment 31

[Intermittent Failures Robot]

6 failures in 4289 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 5

Platform breakdown:

• linux1804-64: 2
• linux1804-64-qr: 3
• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-07-27&endday=2020-08-02&tree=all

Comment 32

[Intermittent Failures Robot]

3 failures in 4618 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• linux1804-64-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-08-03&endday=2020-08-09&tree=all

Comment 33

[Intermittent Failures Robot]

1 failures in 4100 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-08-17&endday=2020-08-23&tree=all

Comment 34

[Intermittent Failures Robot]

2 failures in 4046 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• linux1804-64-qr: 1
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-08-24&endday=2020-08-30&tree=all

Comment 35

[Intermittent Failures Robot]

2 failures in 2984 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• linux1804-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-08-31&endday=2020-09-06&tree=all

Comment 36

[Intermittent Failures Robot]

4 failures in 3410 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform breakdown:

• linux1804-64-qr: 2
• linux1804-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-09-07&endday=2020-09-13&tree=all

Comment 37

[Intermittent Failures Robot]

2 failures in 3760 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform breakdown:

• linux1804-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-09-14&endday=2020-09-20&tree=all

Comment 38

[Intermittent Failures Robot]

2 failures in 4019 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• linux1804-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-09-21&endday=2020-09-27&tree=all

Comment 39

[Intermittent Failures Robot]

3 failures in 4195 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• linux1804-64: 2
• linux1804-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-09-28&endday=2020-10-04&tree=all

Comment 40

[Intermittent Failures Robot]

1 failures in 4130 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-10-05&endday=2020-10-11&tree=all

Comment 41

[Intermittent Failures Robot]

1 failures in 3694 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-10-12&endday=2020-10-18&tree=all

Comment 42

[Intermittent Failures Robot]

1 failures in 4128 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1609162&startday=2020-11-02&endday=2020-11-08&tree=all

Comment 43

[Intermittent Failures Robot]

1 failures in 4040 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2020-11-09&endday=2020-11-15&tree=all

Comment 44

[Intermittent Failures Robot]

1 failures in 4810 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2020-11-16&endday=2020-11-22&tree=all

Comment 45

[Intermittent Failures Robot]

1 failures in 1479 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2020-11-23&endday=2020-11-29&tree=all

Comment 46

[Intermittent Failures Robot]

2 failures in 3712 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform breakdown:

• linux1804-64-qr: 1
• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2020-11-30&endday=2020-12-06&tree=all

Comment 47

[Intermittent Failures Robot]

2 failures in 4060 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform breakdown:

• linux1804-64: 1
• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2020-12-07&endday=2020-12-13&tree=all

Comment 48

[Intermittent Failures Robot]

3 failures in 3421 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 1

Platform breakdown:

• linux1804-64: 1
• linux1804-64-shippable-qr: 1
• linux1804-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2020-12-14&endday=2020-12-20&tree=all

Comment 49

[Intermittent Failures Robot]

2 failures in 1450 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform breakdown:

• linux1804-64: 1
• linux1804-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2020-12-21&endday=2020-12-27&tree=all

Comment 50

[Intermittent Failures Robot]

2 failures in 2956 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform breakdown:

• linux1804-64-qr: 1
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2021-01-04&endday=2021-01-10&tree=all

Comment 51

[Intermittent Failures Robot]

1 failures in 3810 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2021-01-11&endday=2021-01-17&tree=all

Comment 52

[Intermittent Failures Robot]

4 failures in 4322 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform and build breakdown:

• linux1804-64: 2
  • debug: 1
  • opt: 1
• linux1804-64-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2021-02-08&endday=2021-02-14&tree=all

Comment 53

[Intermittent Failures Robot]

2 failures in 3737 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64: 1
  • debug: 1
• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2021-02-15&endday=2021-02-21&tree=all

Comment 54

[Intermittent Failures Robot]

18 failures in 4327 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• mozilla-central: 6
• try: 2

Platform and build breakdown:

• linux1804-64: 10
  • opt: 9
  • debug: 1
• linux1804-64-ccov: 1
  • opt: 1
• linux1804-64-shippable-qr: 2
  • opt: 2
• linux1804-64-qr: 1
  • opt: 1
• linux1804-64-shippable: 3
  • opt: 3
• linux1804-64-devedition: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2021-02-22&endday=2021-02-28&tree=all

Comment 55

[Henrik Skupin [:whimboo][⌚️UTC+1]]

This is actually a Linux-only issue.

Comment 56

[Andreea Pavel [:apavel]]

There are 29 total failures in the last 7 days on

• linux1804-64 opt
• linux1804-64-qr opt
• linux1804-64-shippable opt
  Recent failure log:

[task 2021-03-06T11:14:26.271Z] 11:14:26 INFO - TEST-START | remote/cdp/test/browser/dom/browser_describeNode.js
[task 2021-03-06T11:14:26.750Z] 11:14:26 INFO - GECKO(1841) | 1615029266740 RemoteAgent TRACE (connection {372d78ae-b26a-47f2-b076-fb28df436176})-> {"id":1,"method":"Target.setDiscoverTargets","params":{"discover":true}}
[task 2021-03-06T11:14:26.750Z] 11:14:26 INFO - GECKO(1841) | 1615029266742 RemoteAgent TRACE <-(connection {372d78ae-b26a-47f2-b076-fb28df436176}) {"method":"Target.targetCreated","params":{"targetInfo":{"targetId":"98e11a8d-5d8c-421c-b93d-323b38861138","type":"page","title":"","url":"about:blank","attached":false,"browserContextId":null}}}
[task 2021-03-06T11:14:26.751Z] 11:14:26 INFO - GECKO(1841) | 1615029266742 RemoteAgent TRACE <-(connection {372d78ae-b26a-47f2-b076-fb28df436176}) {"method":"Target.targetCreated","params":{"targetInfo":{"targetId":"f2631a45-e4f9-4806-9223-1d80339af13f","type":"browser","attached":false}}}
[task 2021-03-06T11:14:26.751Z] 11:14:26 INFO - GECKO(1841) | 1615029266742 RemoteAgent TRACE <-(connection {372d78ae-b26a-47f2-b076-fb28df436176}) {"method":"Target.targetCreated","params":{"targetInfo":{"targetId":"adfad258-200c-4b3e-9424-66fd2491a02a","type":"page","title":"","url":"about:blank","attached":true,"browserContextId":null}}}
[task 2021-03-06T11:14:26.752Z] 11:14:26 INFO - GECKO(1841) | 1615029266742 RemoteAgent TRACE <-(connection {372d78ae-b26a-47f2-b076-fb28df436176}) {"id":1,"result":{}}
[task 2021-03-06T11:14:26.752Z] 11:14:26 INFO - GECKO(1841) | 1615029266744 RemoteAgent TRACE (connection {372d78ae-b26a-47f2-b076-fb28df436176})-> {"id":2,"method":"DOM.describeNode","params":{"objectId":null}}
[task 2021-03-06T11:14:26.752Z] 11:14:26 INFO - GECKO(1841) | 1615029266746 RemoteAgent TRACE <-(connection {372d78ae-b26a-47f2-b076-fb28df436176}) {"id":2,"error":{"message":"objectId: string value expected","data":"describeNode@chrome://remote/content/cdp/domains/content ... /cdp/domains/DomainCache.jsm:101:25\nreceiveMessage@chrome://remote/content/cdp/sessions/ContentProcessSession.jsm:84:45\n"}}
[task 2021-03-06T11:14:26.753Z] 11:14:26 INFO - GECKO(1841) | 1615029266747 RemoteAgent TRACE (connection {372d78ae-b26a-47f2-b076-fb28df436176})-> {"id":3,"method":"DOM.describeNode","params":{"objectId":true}}
[task 2021-03-06T11:14:26.753Z] 11:14:26 INFO - GECKO(1841) | 1615029266747 RemoteAgent TRACE <-(connection {372d78ae-b26a-47f2-b076-fb28df436176}) {"id":3,"error":{"message":"objectId: string value expected","data":"describeNode@chrome://remote/content/cdp/domains/content ... /cdp/domains/DomainCache.jsm:101:25\nreceiveMessage@chrome://remote/content/cdp/sessions/ContentProcessSession.jsm:84:45\n"}}
[task 2021-03-06T11:14:26.754Z] 11:14:26 INFO - GECKO(1841) | 1615029266748 RemoteAgent TRACE (connection {372d78ae-b26a-47f2-b076-fb28df436176})-> {"id":4,"method":"DOM.describeNode","params":{"objectId":1}}
[task 2021-03-06T11:14:26.756Z] 11:14:26 INFO - GECKO(1841) | 1615029266749 RemoteAgent TRACE <-(connection {372d78ae-b26a-47f2-b076-fb28df436176}) {"id":4,"error":{"message":"objectId: string value expected","data":"describeNode@chrome://remote/content/cdp/domains/content ... /cdp/domains/DomainCache.jsm:101:25\nreceiveMessage@chrome://remote/content/cdp/sessions/ContentProcessSession.jsm:84:45\n"}}
[task 2021-03-06T11:14:26.763Z] 11:14:26 INFO - GECKO(1841) | 1615029266756 RemoteAgent TRACE (connection {372d78ae-b26a-47f2-b076-fb28df436176})-> {"id":5,"method":"DOM.describeNode","params":{"objectId":[]}}
[task 2021-03-06T11:14:26.763Z] 11:14:26 INFO - GECKO(1841) | 1615029266756 RemoteAgent TRACE <-(connection {372d78ae-b26a-47f2-b076-fb28df436176}) {"id":5,"error":{"message":"objectId: string value expected","data":"describeNode@chrome://remote/content/cdp/domains/content ... /cdp/domains/DomainCache.jsm:101:25\nreceiveMessage@chrome://remote/content/cdp/sessions/ContentProcessSession.jsm:84:45\n"}}
[task 2021-03-06T11:14:26.763Z] 11:14:26 INFO - GECKO(1841) | 1615029266757 RemoteAgent TRACE (connection {372d78ae-b26a-47f2-b076-fb28df436176})-> {"id":6,"method":"DOM.describeNode","params":{"objectId":{}}}
[task 2021-03-06T11:14:26.764Z] 11:14:26 INFO - GECKO(1841) | 1615029266758 RemoteAgent TRACE <-(connection {372d78ae-b26a-47f2-b076-fb28df436176}) {"id":6,"error":{"message":"objectId: string value expected","data":"describeNode@chrome://remote/content/cdp/domains/content ... /cdp/domains/DomainCache.jsm:101:25\nreceiveMessage@chrome://remote/content/cdp/sessions/ContentProcessSession.jsm:84:45\n"}}
[task 2021-03-06T11:14:26.771Z] 11:14:26 INFO - GECKO(1841) | 1615029266765 RemoteAgent TRACE <-(connection {372d78ae-b26a-47f2-b076-fb28df436176}) {"method":"Target.targetDestroyed","params":{"targetId":"adfad258-200c-4b3e-9424-66fd2491a02a"}}
[task 2021-03-06T11:14:26.791Z] 11:14:26 INFO - GECKO(1841) | 1615029266776 RemoteAgent TRACE <-(connection {372d78ae-b26a-47f2-b076-fb28df436176}) {"method":"Target.targetDestroyed","params":{"targetId":"98e11a8d-5d8c-421c-b93d-323b38861138"}}
[task 2021-03-06T11:14:26.792Z] 11:14:26 INFO - GECKO(1841) | 1615029266777 RemoteAgent TRACE <-(connection {372d78ae-b26a-47f2-b076-fb28df436176}) {"method":"Target.targetDestroyed","params":{"targetId":"f2631a45-e4f9-4806-9223-1d80339af13f"}}
[task 2021-03-06T11:14:26.809Z] 11:14:26 INFO - GECKO(1841) | !!! could not start server on port 9222: [Exception... "Component returned failure code: 0x804b0036 (NS_ERROR_SOCKET_ADDRESS_IN_USE) [nsIServerSocket.init]" nsresult: "0x804b0036 (NS_ERROR_SOCKET_ADDRESS_IN_USE)" location: "JS frame :: chrome://remote/content/server/HTTPD.jsm :: _start :: line 567" data: no]
[task 2021-03-06T11:14:26.810Z] 11:14:26 INFO - GECKO(1841) | 1615029266803 RemoteAgent ERROR unable to stop listener: [Exception... "Unexpected error" nsresult: "0x8000ffff (NS_ERROR_UNEXPECTED)" location: "JS frame :: chrome://remote/content/server/HTTPD.jsm :: stop :: line 621" data: no] Stack trace: stop()@HTTPD.jsm:621
[task 2021-03-06T11:14:26.811Z] 11:14:26 INFO - GECKO(1841) | close()@RemoteAgent.jsm:129
[task 2021-03-06T11:14:26.812Z] 11:14:26 INFO - GECKO(1841) | asyncListen()@RemoteAgent.jsm:110
[task 2021-03-06T11:14:26.813Z] 11:14:26 INFO - GECKO(1841) | 1615029266804 RemoteAgent ERROR Unable to start remote agent: : [Exception... "Component is not available" nsresult: "0x80040111 (NS_ERROR_NOT_AVAILABLE)" location: "JS frame :: chrome://remote/content/server/HTTPD.jsm :: _start :: line 612" data: no] Stack trace: _start()@HTTPD.jsm:612
[task 2021-03-06T11:14:26.814Z] 11:14:26 INFO - GECKO(1841) | asyncListen()@RemoteAgent.jsm:103
[task 2021-03-06T11:14:27.177Z] 11:14:27 INFO - TEST-INFO | started process screentopng
[task 2021-03-06T11:14:27.416Z] 11:14:27 INFO - TEST-INFO | screentopng: exit 0
[task 2021-03-06T11:14:27.417Z] 11:14:27 INFO - Buffered messages logged at 11:14:26
[task 2021-03-06T11:14:27.417Z] 11:14:27 INFO - Entering test bound objectIdInvalidTypes
[task 2021-03-06T11:14:27.418Z] 11:14:27 INFO - CDP server started
[task 2021-03-06T11:14:27.418Z] 11:14:27 INFO - CDP client instantiated
[task 2021-03-06T11:14:27.419Z] 11:14:27 INFO - TEST-PASS | remote/cdp/test/browser/dom/browser_describeNode.js | Fails with invalid type: null -
[task 2021-03-06T11:14:27.419Z] 11:14:27 INFO - TEST-PASS | remote/cdp/test/browser/dom/browser_describeNode.js | Fails with invalid type: true -
[task 2021-03-06T11:14:27.420Z] 11:14:27 INFO - TEST-PASS | remote/cdp/test/browser/dom/browser_describeNode.js | Fails with invalid type: 1 -
[task 2021-03-06T11:14:27.420Z] 11:14:27 INFO - TEST-PASS | remote/cdp/test/browser/dom/browser_describeNode.js | Fails with invalid type: -
[task 2021-03-06T11:14:27.421Z] 11:14:27 INFO - TEST-PASS | remote/cdp/test/browser/dom/browser_describeNode.js | Fails with invalid type: [object Object] -
[task 2021-03-06T11:14:27.421Z] 11:14:27 INFO - CDP client closed
[task 2021-03-06T11:14:27.422Z] 11:14:27 INFO - CDP server stopped
[task 2021-03-06T11:14:27.422Z] 11:14:27 INFO - Leaving test bound objectIdInvalidTypes
[task 2021-03-06T11:14:27.423Z] 11:14:27 INFO - Entering test bound objectIdUnknownValue
[task 2021-03-06T11:14:27.423Z] 11:14:27 INFO - CDP server started
[task 2021-03-06T11:14:27.424Z] 11:14:27 INFO - Buffered messages logged at 11:14:27
[task 2021-03-06T11:14:27.424Z] 11:14:27 INFO - CDP server stopped
[task 2021-03-06T11:14:27.425Z] 11:14:27 INFO - Buffered messages finished
[task 2021-03-06T11:14:27.425Z] 11:14:27 INFO - TEST-UNEXPECTED-FAIL | remote/cdp/test/browser/dom/browser_describeNode.js | Uncaught exception - [object ProgressEvent]
[task 2021-03-06T11:14:27.426Z] 11:14:27 INFO - Leaving test bound objectIdUnknownValue
[task 2021-03-06T11:14:27.426Z] 11:14:27 INFO - Entering test bound objectIdIsNotANode
[task 2021-03-06T11:14:27.427Z] 11:14:27 INFO - CDP server started
[task 2021-03-06T11:14:27.624Z] 11:14:27 INFO - CDP client instantiated
[task 2021-03-06T11:14:27.624Z] 11:14:27 INFO - GECKO(1841) | 1615029267617 RemoteAgent TRACE (connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f})-> {"id":1,"method":"Target.setDiscoverTargets","params":{"discover":true}}
[task 2021-03-06T11:14:27.624Z] 11:14:27 INFO - GECKO(1841) | 1615029267617 RemoteAgent TRACE <-(connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f}) {"method":"Target.targetCreated","params":{"targetInfo":{"targetId":"9fa4b6a1-4519-4e65-83e3-a983c3f55004","type":"page","title":"","url":"about:blank","attached":false,"browserContextId":null}}}
[task 2021-03-06T11:14:27.624Z] 11:14:27 INFO - GECKO(1841) | 1615029267617 RemoteAgent TRACE <-(connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f}) {"method":"Target.targetCreated","params":{"targetInfo":{"targetId":"2ebc1982-ad9f-4e04-9dc4-268836827408","type":"browser","attached":false}}}
[task 2021-03-06T11:14:27.624Z] 11:14:27 INFO - GECKO(1841) | 1615029267617 RemoteAgent TRACE <-(connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f}) {"method":"Target.targetCreated","params":{"targetInfo":{"targetId":"a03a71df-84ca-48cc-952a-e8b2339c384b","type":"page","title":"","url":"about:blank","attached":true,"browserContextId":null}}}
[task 2021-03-06T11:14:27.624Z] 11:14:27 INFO - GECKO(1841) | 1615029267617 RemoteAgent TRACE <-(connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f}) {"id":1,"result":{}}
[task 2021-03-06T11:14:27.661Z] 11:14:27 INFO - GECKO(1841) | 1615029267657 RemoteAgent TRACE (connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f})-> {"id":2,"method":"Runtime.enable","params":{}}
[task 2021-03-06T11:14:27.665Z] 11:14:27 INFO - GECKO(1841) | 1615029267661 RemoteAgent TRACE <-(connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f}) {"id":2,"result":{}}
[task 2021-03-06T11:14:27.666Z] 11:14:27 INFO - GECKO(1841) | 1615029267663 RemoteAgent TRACE (connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f})-> {"id":3,"method":"Runtime.evaluate","params":{"expression":"[42]"}}
[task 2021-03-06T11:14:27.669Z] 11:14:27 INFO - GECKO(1841) | 1615029267664 RemoteAgent TRACE <-(connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f}) {"method":"Runtime.executionContextCreated","params":{"context":{"id":1,"origin":"about:blank","name":"","auxData":{"isDefault":true,"frameId":"57","type":"default"}}}}
[task 2021-03-06T11:14:27.670Z] 11:14:27 INFO - GECKO(1841) | 1615029267666 RemoteAgent TRACE <-(connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f}) {"id":3,"result":{"result":{"objectId":"83605fce-a71b-49e4-8183-fd1f9816ee92","type":"object","subtype":"array"}}}
[task 2021-03-06T11:14:27.706Z] 11:14:27 INFO - GECKO(1841) | 1615029267701 RemoteAgent TRACE (connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f})-> {"id":4,"method":"DOM.describeNode","params":{"objectId":"83605fce-a71b-49e4-8183-fd1f9816ee92"}}
[task 2021-03-06T11:14:27.707Z] 11:14:27 INFO - GECKO(1841) | 1615029267703 RemoteAgent TRACE <-(connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f}) {"id":4,"error":{"message":"Object id doesn't reference a Node","data":"describeNode@chrome://remote/content/cdp/domains/cont ... /cdp/domains/DomainCache.jsm:101:25\nreceiveMessage@chrome://remote/content/cdp/sessions/ContentProcessSession.jsm:84:45\n"}}
[task 2021-03-06T11:14:27.707Z] 11:14:27 INFO - TEST-PASS | remote/cdp/test/browser/dom/browser_describeNode.js | Fails if objectId doesn't reference a DOM node -
[task 2021-03-06T11:14:27.721Z] 11:14:27 INFO - GECKO(1841) | 1615029267710 RemoteAgent TRACE <-(connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f}) {"method":"Target.targetDestroyed","params":{"targetId":"a03a71df-84ca-48cc-952a-e8b2339c384b"}}
[task 2021-03-06T11:14:27.725Z] 11:14:27 INFO - CDP client closed
[task 2021-03-06T11:14:27.729Z] 11:14:27 INFO - GECKO(1841) | 1615029267719 RemoteAgent TRACE <-(connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f}) {"method":"Target.targetDestroyed","params":{"targetId":"9fa4b6a1-4519-4e65-83e3-a983c3f55004"}}
[task 2021-03-06T11:14:27.732Z] 11:14:27 INFO - GECKO(1841) | 1615029267719 RemoteAgent TRACE <-(connection {b8b3e0ed-aac0-43f5-8f69-7f59b807203f}) {"method":"Target.targetDestroyed","params":{"targetId":"2ebc1982-ad9f-4e04-9dc4-268836827408"}}
[task 2021-03-06T11:14:27.736Z] 11:14:27 INFO - CDP server stopped
[task 2021-03-06T11:14:27.736Z] 11:14:27 INFO - Leaving test bound objectIdIsNotANode

Henrik are you working on this?

Comment 57

[Intermittent Failures Robot]

25 failures in 3683 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

This is the #37 most frequent failure this week.

Repository breakdown:

• autoland: 18
• mozilla-central: 5
• try: 2

Platform and build breakdown:

• linux1804-64: 12
  • opt: 12
• linux1804-64-ccov: 1
  • opt: 1
• linux1804-64-shippable-qr: 1
  • opt: 1
• linux1804-64-qr: 6
  • opt: 6
• linux1804-64-shippable: 4
  • opt: 4
• linux1804-64-devedition: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2021-03-01&endday=2021-03-07&tree=all

Comment 58

[Henrik Skupin [:whimboo][⌚️UTC+1]]

(In reply to Andreea Pavel [:apavel] from comment #56)

Henrik are you working on this?

Not at this point but it looks like we have to take care about it soon. Something caused the number of failures to spike up.

Comment 59

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Before bug 1693288 (using clang 12) landed this was mostly a perma failure for ccov builds on Linux. Maybe it helps to reproduce the problem, which now mostly sounds like a race happening especially with slower builds.

Comment 61

[Henrik Skupin [:whimboo][⌚️UTC+1]]

The underlying problem here seems to be all around the socket as created by the HTTP server (httpd.js). At some point a formerly running server instance seems to not correctly close the socket, and then for the next test a new instance cannot be launched because the port is still taken.

The error message that gets thrown by httpd.js isn't that clear and as such I would propose to actually make it better first. Then we should identify why the socket isn't closed. Given that this only happens for opt builds it might be equivalent to bug 1663533 which causes a crash for debug builds somewhere in the socket library.

Comment 62

[Intermittent Failures Robot]

51 failures in 4622 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #20 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 24
• mozilla-central: 25
• try: 2

Platform and build breakdown:

• linux1804-64: 19
  • opt: 19
• linux1804-64-ccov: 19
  • opt: 19
• linux1804-64-shippable: 6
  • opt: 6
• linux1804-64-shippable-qr: 1
  • opt: 1
• linux1804-64-devedition: 1
  • opt: 1
• linux1804-64-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2021-03-08&endday=2021-03-14&tree=all

Comment 64

[Henrik Skupin [:whimboo][⌚️UTC+1]]

To get further information about a possible issue within httpd.js I enabled its debug logging, and pushed another try build. Reproducing the failure was kind hard, bug finally I got it with a CCOV build:

https://treeherder.mozilla.org/logviewer?job_id=333059473&repo=try

Here it can be seen that we correctly close the port 9222, but why the next connection fails it's not clear:

[task 2021-03-12T21:10:25.902Z] 21:10:25     INFO - GECKO(1898) | 1615583425880	RemoteAgent	TRACE	<-(connection {4f134395-8d9d-40d1-8c2d-bf553e23fd82}) {"method":"Target.targetDestroyed","params":{"targetId":"726f3ce6-992f-43c8-8006-7780623391fa"}}
[task 2021-03-12T21:10:25.903Z] 21:10:25     INFO - GECKO(1898) | HTTPD-INFO | >>> stopping listening on port 9222
[task 2021-03-12T21:10:25.904Z] 21:10:25     INFO - GECKO(1898) | HTTPD-INFO | >>> shutting down server on port 9222
[task 2021-03-12T21:10:25.905Z] 21:10:25     INFO - GECKO(1898) | HTTPD-INFO | *** no open connections, notifying async from onStopListening
[task 2021-03-12T21:10:25.906Z] 21:10:25     INFO - GECKO(1898) | HTTPD-INFO | *** _notifyStopped async callback
[task 2021-03-12T21:10:25.906Z] 21:10:25     INFO - GECKO(1898) | 1615583425883	RemoteAgent	DEBUG	Setting recommended pref focusmanager.testmode to true
[task 2021-03-12T21:10:25.913Z] 21:10:25     INFO - GECKO(1898) | 1615583425884	RemoteAgent	DEBUG	Setting recommended pref toolkit.startup.max_resumed_crashes to -1
[task 2021-03-12T21:10:25.915Z] 21:10:25     INFO - GECKO(1898) | 1615583425885	RemoteAgent	DEBUG	Setting recommended pref browser.contentblocking.features.standard to -tp,tpPrivate,cookieBehavior0,-cm,-fp
[task 2021-03-12T21:10:25.917Z] 21:10:25     INFO - GECKO(1898) | 1615583425887	RemoteAgent	DEBUG	Setting recommended pref prompts.contentPromptSubDialog to false
[task 2021-03-12T21:10:25.917Z] 21:10:25     INFO - GECKO(1898) | !!! could not start server on port 9222: [Exception... "Component returned failure code: 0x804b0036 (NS_ERROR_SOCKET_ADDRESS_IN_USE) [nsIServerSocket.init]"  nsresult: "0x804b0036 (NS_ERROR_SOCKET_ADDRESS_IN_USE)"  location: "JS frame :: chrome://remote/content/server/HTTPD.jsm :: _start :: line 567"  data: no]

Maybe we have some kind of race condition here where the Remote Agent tries to create a new connection whereby the old one hasn't been closed yet.

Comment 65

[Henrik Skupin [:whimboo][⌚️UTC+1]]

So what's actually happening here... When the tries to enter the listening state and it cannot start the HTTP server, it currently only logs an entry, and then continues as everything is fine:

https://searchfox.org/mozilla-central/rev/aa9a7136835deb0eeba00c62bb50a4a0e2cdea2d/remote/components/RemoteAgent.jsm#121

Previously, which means before bug 1590828 landed, the code actually throws an error. That error was then picked-up by the Mochitest and following lines weren't executed anymore:

https://searchfox.org/mozilla-central/rev/aa9a7136835deb0eeba00c62bb50a4a0e2cdea2d/remote/cdp/test/browser/head.js#50-51

But now that is the case, and the very first call to any CDP.* command will fail with a XMLHttpRequest error that results in [object ProgressEvent].

As such we should really return an error when the HTTP server cannot be started and put into listening mode. I'm not sure why throwing the error has been removed.

Note that with such a change the underlying issue will not be changed but a proper error be handled / logged.

Comment 66

[Intermittent Failures Robot]

43 failures in 4257 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #17 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 18
• mozilla-central: 23
• try: 2

Platform and build breakdown:

• linux1804-64: 15
  • opt: 14
  • debug: 1
• linux1804-64-ccov: 15
  • opt: 15
• linux1804-64-shippable: 7
  • opt: 7
• linux1804-64-qr: 3
  • opt: 3
• linux1804-64-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2021-03-15&endday=2021-03-21&tree=all

Comment 67

[Alexandru Michis [:malexandru]]

There have been 40 total failures in the last 7 days (recent failure log).
Affected platforms are:

• linux1804-64-shippable-qr, linux1804-64-shippable, linux1804-64-ccov
• linux1804-64 opt, linux1804-64-qr opt

Comment 68

[Intermittent Failures Robot]

50 failures in 3967 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #26 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 28
• try: 5
• autoland: 8
• mozilla-beta: 9

Platform and build breakdown:

• linux1804-64-ccov: 21
  • opt: 21
• linux1804-64-shippable: 9
  • opt: 9
• linux1804-64-devedition: 6
  • opt: 6
• linux1804-64: 6
  • opt: 6
• linux1804-64-shippable-qr: 6
  • opt: 6
• linux1804-64-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2021-03-22&endday=2021-03-28&tree=all

Comment 69

[Henrik Skupin [:whimboo][⌚️UTC+1]]

The problem here is that for each and every browser-chrome mochitest we stop and re-initialize the Remote Agent:
https://searchfox.org/mozilla-central/rev/cc4a17cea338fe236626d838ca96e9bf6a775675/remote/cdp/test/browser/head.js#50,95

Interestingly this means that we also start / stop the HTTP server, and drop all the registered websocket connections. Not sure if that is something we actually want to allow for consumers of the RemoteAgent module. Also this would mean that the HTTPd port can change. Here I thought that the port is actually fixed on the value as specified via --remote-debugging-port, and cannot be changed during the whole lifetime of the Firefox process. But locking the port would actually break some tests that check that the Remote Agent can also listen on pre-defined ports. But nevertheless the type of test is wrong here and we would need a harness like Marionette to check that.

I think a discussion is needed how the lifetime of the connection should look like, and if the current behavior is acceptable - especially for BiDi. I'm actually a bit worried here.

Comment 70

[Julian Descottes [:jdescottes]]

As discussed on Elements with :whimboo will take this.
We will try to use a single RemoteAgent instance for a given suite. And we will isolate remote/cdp/test/browser/browser_agent.js which needs to start/stop the RemoteAgent in a separate ini file.

Comment 71

[Julian Descottes [:jdescottes]]

Attachment: Bug 1609162 - [remote] Start remote agent only once in remote mochitests

Comment 72

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a3bc2d23debb
[remote] Start remote agent only once in remote mochitests r=remote-protocol-reviewers,whimboo

Comment 73

[Bogdan Tara[:bogdan_tara | bogdant]]

https://hg.mozilla.org/mozilla-central/rev/a3bc2d23debb

Comment 74

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Do you have any objections to uplift this to beta?

Comment 75

[Julian Descottes [:jdescottes]]

Uplift to beta should be fine, let me know if there are any merge conflicts.

Comment 76

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/releases/mozilla-beta/rev/e841f4e1fd71

Comment 77

[Intermittent Failures Robot]

7 failures in 3125 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 5
• autoland: 2

Platform and build breakdown:

• linux1804-64-ccov: 3
  • opt: 3
• linux1804-64-shippable: 2
  • opt: 2
• linux1804-64: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2021-03-29&endday=2021-04-04&tree=all

Comment 78

[Intermittent Failures Robot]

1 failures in 3165 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1609162&startday=2022-01-31&endday=2022-02-06&tree=all