1685912 - Intermittent mochitest TEST-UNEXPECTED-TIMEOUT | Last test finished | application timed out after 370 seconds with no output

Status: RESOLVED DUPLICATE of bug 1358898

(Core :: DOM: Networking, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=326295338&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/L9DOnmfMREm9f5ai4Z9cqg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-01-10T13:12:43.283Z] 13:12:43     INFO - TEST-START | dom/fetch/tests/browser_blobFromFile.js
[task 2021-01-10T13:12:44.904Z] 13:12:44     INFO - GECKO(3793) | MEMORY STAT vsizeMaxContiguous not supported in this build configuration.
[task 2021-01-10T13:12:44.904Z] 13:12:44     INFO - GECKO(3793) | MEMORY STAT heapAllocated not supported in this build configuration.
[task 2021-01-10T13:12:44.904Z] 13:12:44     INFO - GECKO(3793) | MEMORY STAT | vsize 130550970MB | residentFast 1709MB
[task 2021-01-10T13:12:44.904Z] 13:12:44     INFO - TEST-OK | dom/fetch/tests/browser_blobFromFile.js | took 1621ms
[task 2021-01-10T13:12:45.014Z] 13:12:45     INFO - checking window state
[task 2021-01-10T13:12:47.857Z] 13:12:47     INFO - GECKO(3793) | Completed ShutdownLeaks collections in process 3979
[task 2021-01-10T13:12:47.872Z] 13:12:47     INFO - GECKO(3793) | Completed ShutdownLeaks collections in process 3865
[task 2021-01-10T13:12:48.049Z] 13:12:48     INFO - GECKO(3793) | Completed ShutdownLeaks collections in process 3890
[task 2021-01-10T13:12:48.165Z] 13:12:48     INFO - GECKO(3793) | Completed ShutdownLeaks collections in process 3947
[task 2021-01-10T13:18:58.178Z] 13:18:58     INFO - Buffered messages finished
[task 2021-01-10T13:18:58.179Z] 13:18:58    ERROR - TEST-UNEXPECTED-TIMEOUT | Last test finished | application timed out after 370 seconds with no output
[task 2021-01-10T13:18:58.180Z] 13:18:58    ERROR - Force-terminating active process(es).```

Comment 1

[Intermittent Failures Robot]

1 failures in 2956 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-tsan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-01-04&endday=2021-01-10&tree=all

Comment 2

[Intermittent Failures Robot]

1 failures in 3810 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• linux1804-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-01-11&endday=2021-01-17&tree=all

Comment 3

[Intermittent Failures Robot]

2 failures in 3488 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• windows10-64: 1
  • asan: 1
• android-hw-p2-8-0-arm7-api-16-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-01-18&endday=2021-01-24&tree=all

Comment 4

[Intermittent Failures Robot]

1 failures in 3966 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows7-32-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-02-01&endday=2021-02-07&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 3737 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-02-15&endday=2021-02-21&tree=all

Comment 6

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 7

[Dorel Luca [:dluca]]

Recent log:
https://treeherder.mozilla.org/logviewer?job_id=330382259&repo=autoland&lineNumber=4332

Comment 8

[Intermittent Failures Robot]

17 failures in 635 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 15
• mozilla-central: 2

Platform and build breakdown:

• linux1804-64: 4
  • debug: 4
• linux1804-64-asan: 5
  • opt: 5
• linux1804-64-asan-qr: 7
  • opt: 7
• linux1804-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-05-18&endday=2021-05-18&tree=all

Comment 9

[Intermittent Failures Robot]

45 failures in 3061 pushes (0.015 failures/push) were associated with this bug in the last 7 days.

This is the #21 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 34
• mozilla-central: 10
• try: 1

Platform and build breakdown:

• linux1804-64: 14
  • debug: 14
• linux1804-64-asan: 13
  • opt: 13
• linux1804-64-asan-qr: 13
  • opt: 13
• linux1804-64-qr: 3
  • debug: 3
• linux1804-64-ccov: 1
  • opt: 1
• windows10-64: 1
  • asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-05-17&endday=2021-05-23&tree=all

Comment 10

[Intermittent Failures Robot]

32 failures in 2908 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #34 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 23
• mozilla-central: 8
• try: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 5
  • opt: 5
• linux1804-64-qr: 4
  • debug: 4
• linux1804-64: 16
  • debug: 16
• linux1804-64-asan: 6
  • opt: 6
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-05-24&endday=2021-05-30&tree=all

Comment 11

[Intermittent Failures Robot]

32 failures in 3065 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #45 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 25
• mozilla-central: 5
• mozilla-beta: 2

Platform and build breakdown:

• linux1804-64-asan: 12
  • opt: 12
• linux1804-64-qr: 5
  • debug: 5
• linux1804-64: 8
  • debug: 8
• linux1804-64-asan-qr: 6
  • opt: 6
• linux1804-64-ccov: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-05-31&endday=2021-06-06&tree=all

Comment 12

[Sandor Molnar[:smolnar]]

There have been a total of 31 failures in the past 7 days.

Platforms affected:

• linux1804-64 opt/debug
• linux1804-64-asan opt
• linux1804-64-asan-webrender opt

Comment 13

[Intermittent Failures Robot]

31 failures in 3502 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 24
• mozilla-central: 5
• mozilla-release: 1
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64: 9
  • debug: 9
• linux1804-64-asan-qr: 5
  • opt: 5
• linux1804-64-asan: 14
  • opt: 14
• linux1804-64-qr: 1
  • debug: 1
• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-ccov: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-06-07&endday=2021-06-13&tree=all

Comment 14

[Intermittent Failures Robot]

18 failures in 2888 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 12
• mozilla-central: 6

Platform and build breakdown:

• linux1804-64: 3
  • debug: 3
• linux1804-64-asan: 5
  • opt: 5
• linux1804-64-asan-qr: 3
  • opt: 3
• macosx1015-64-qr: 2
  • debug: 2
• linux1804-64-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-06-14&endday=2021-06-20&tree=all

Comment 15

[Intermittent Failures Robot]

9 failures in 3115 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• try: 1
• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-tsan: 1
  • opt: 1
• linux1804-64-asan: 2
  • opt: 2
• linux1804-64-qr: 2
  • debug: 2
• linux1804-64: 4
  • debug: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-06-21&endday=2021-06-27&tree=all

Comment 16

[Intermittent Failures Robot]

9 failures in 723 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 1
• comm-central: 5

Platform and build breakdown:

• linux1804-64: 1
  • debug: 1
• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-tsan: 1
  • opt: 1
• linux1804-64-qr: 1
  • debug: 1
• macosx1015-64: 3
  • opt: 3
• macosx1015-64-shippable: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-06-28&endday=2021-07-04&tree=all

Comment 17

[Intermittent Failures Robot]

7 failures in 2387 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 3

Platform and build breakdown:

• linux1804-64: 4
  • debug: 4
• linux1804-64-qr: 2
  • debug: 2
• windows10-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-07-05&endday=2021-07-11&tree=all

Comment 18

[Intermittent Failures Robot]

13 failures in 2224 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 6
• autoland: 7

Platform and build breakdown:

• linux1804-64-qr: 7
  • debug: 7
• linux1804-64: 2
  • debug: 2
• macosx1015-64-qr: 2
  • debug: 2
• linux1804-64-tsan: 1
  • opt: 1
• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-07-12&endday=2021-07-18&tree=all

Comment 19

[Intermittent Failures Robot]

13 failures in 2940 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• mozilla-central: 3

Platform and build breakdown:

• linux1804-64: 3
  • debug: 3
• macosx1015-64-qr: 5
  • debug: 5
• linux1804-64-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-07-19&endday=2021-07-25&tree=all

Comment 20

[Intermittent Failures Robot]

15 failures in 3131 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 13
• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-qr: 11
  • debug: 11
• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64: 1
  • debug: 1
• windows10-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-07-26&endday=2021-08-01&tree=all

Comment 21

[Intermittent Failures Robot]

11 failures in 2829 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-qr: 7
  • debug: 7
• windows10-64-asan-qr: 2
  • opt: 2
• macosx1015-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-08-02&endday=2021-08-08&tree=all

Comment 22

[Intermittent Failures Robot]

19 failures in 3025 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 14
• mozilla-central: 5

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-tsan-qr: 4
  • opt: 4
• linux1804-64-qr: 13
  • debug: 13
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-08-09&endday=2021-08-15&tree=all

Comment 23

[Intermittent Failures Robot]

16 failures in 2899 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 12
• mozilla-central: 3
• mozilla-beta: 1

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • opt: 1
• linux1804-64-qr: 13
  • debug: 13
• windows10-64-asan-qr: 1
  • opt: 1
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-08-16&endday=2021-08-22&tree=all

Comment 24

[Intermittent Failures Robot]

24 failures in 2580 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 20
• mozilla-central: 4

Platform and build breakdown:

• linux1804-64-qr: 15
  • debug: 15
• macosx1015-64-qr: 4
  • debug: 3
  • opt: 1
• linux1804-64-tsan-qr: 4
  • opt: 4
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-08-23&endday=2021-08-29&tree=all

Comment 25

[Intermittent Failures Robot]

25 failures in 3084 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 21
• mozilla-central: 4

Platform and build breakdown:

• macosx1015-64-qr: 5
  • debug: 5
• linux1804-64-qr: 20
  • debug: 20

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-08-30&endday=2021-09-05&tree=all

Comment 26

[Intermittent Failures Robot]

20 failures in 3266 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 11
• autoland: 8
• try: 1

Platform and build breakdown:

• linux1804-64-qr: 8
  • debug: 8
• linux1804-64-tsan-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1
• macosx1015-64-qr: 2
  • opt: 2
• linux1804-64-ccov-qr: 8
  • opt: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-09-06&endday=2021-09-12&tree=all

Comment 27

[Intermittent Failures Robot]

15 failures in 825 pushes (0.018 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 8
• autoland: 7

Platform and build breakdown:

• linux1804-64-ccov-qr: 7
  • opt: 7
• linux1804-64-qr: 8
  • debug: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-09-17&endday=2021-09-17&tree=all

Comment 28

[Intermittent Failures Robot]

56 failures in 3375 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #16 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 34
• autoland: 21
• mozilla-esr91: 1

Platform and build breakdown:

• macosx1015-64-qr: 4
  • debug: 4
• linux1804-64-qr: 25
  • debug: 24
  • opt: 1
• linux1804-64-ccov-qr: 25
  • opt: 25
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-09-13&endday=2021-09-19&tree=all

Comment 29

[Intermittent Failures Robot]

15 failures in 615 pushes (0.024 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 12
• autoland: 3

Platform and build breakdown:

• linux1804-64-ccov-qr: 10
  • opt: 10
• linux1804-64-qr: 4
  • debug: 4
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-09-22&endday=2021-09-22&tree=all

Comment 30

[Intermittent Failures Robot]

65 failures in 2873 pushes (0.023 failures/push) were associated with this bug in the last 7 days.

This is the #9 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 22
• mozilla-central: 42
• mozilla-esr91: 1

Platform and build breakdown:

• linux1804-64-qr: 19
  • debug: 19
• linux1804-64-ccov-qr: 41
  • opt: 41
• linux1804-64-tsan-qr: 1
  • opt: 1
• macosx1015-64-qr: 2
  • debug: 2
• macosx1015-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-09-20&endday=2021-09-26&tree=all

Comment 31

[Marian-Vasile Laza]

here have been 53 total failures in the last 7 days, recent failure log.
Affected platforms are:

• linux1804-64-ccov-qr
• linux1804-64-qr
• linux1804-64-tsan-qr
• macosx1015-64-qr
• macosx1015-64-shippable-qr

task 2021-09-30T01:21:46.845Z] 01:21:46     INFO - GECKO(1542) | [Parent 1542, Main Thread] WARNING: NS_ENSURE_TRUE(mReady) failed: file /builds/worker/checkouts/gecko/xpfe/appshell/nsWindowMediator.cpp:161
[task 2021-09-30T01:21:46.846Z] 01:21:46     INFO - GECKO(1542) | JavaScript error: resource:///modules/sessionstore/SessionStore.jsm, line 5097: NS_ERROR_UNEXPECTED: Component returned failure code: 0x8000ffff (NS_ERROR_UNEXPECTED) [nsIWindowMediator.getEnumerator]
[task 2021-09-30T01:22:39.123Z] 01:22:39     INFO - GECKO(1542) | XPCOM_MEM_BLOAT_LOG: /tmp/tmp1oqanzxw.mozrunner/runtests_leaks.log
[task 2021-09-30T01:22:39.125Z] 01:22:39     INFO - GECKO(1542) | Writing to log: /tmp/tmp1oqanzxw.mozrunner/runtests_leaks.log
[task 2021-09-30T01:22:40.137Z] 01:22:40     INFO - GECKO(1542) | Hit MOZ_CRASH(Shutdown hanging after all known phases and workers finished.) at /builds/worker/checkouts/gecko/toolkit/components/terminator/nsTerminator.cpp:246
[task 2021-09-30T01:22:40.139Z] 01:22:40     INFO - GECKO(1542) | #01: mozilla::(anonymous namespace)::RunWatchdog(void*) [toolkit/components/terminator/nsTerminator.cpp:246]
[task 2021-09-30T01:22:40.155Z] 01:22:40     INFO - GECKO(1542) | #02: _pt_root [nsprpub/pr/src/pthreads/ptthread.c:204]
[task 2021-09-30T01:22:40.158Z] 01:22:40     INFO - GECKO(1542) | #03: ??? [/lib/x86_64-linux-gnu/libpthread.so.0 + 0x76db]
[task 2021-09-30T01:22:40.160Z] 01:22:40     INFO - GECKO(1542) | #04: clone [/lib/x86_64-linux-gnu/libc.so.6 + 0x121a3f]
[task 2021-09-30T01:22:40.163Z] 01:22:40     INFO - GECKO(1542) | #05: ??? (???:???)
[task 2021-09-30T01:22:40.164Z] 01:22:40     INFO - GECKO(1542) | ExceptionHandler::GenerateDump cloned child 13007
[task 2021-09-30T01:22:40.165Z] 01:22:40     INFO - GECKO(1542) | ExceptionHandler::SendContinueSignalToChild sent continue signal to child
[task 2021-09-30T01:22:40.165Z] 01:22:40     INFO - GECKO(1542) | ExceptionHandler::WaitForContinueSignal waiting for continue signal...
[task 2021-09-30T01:22:40.318Z] 01:22:40     INFO - GECKO(1542) | [Child 11225, IPC I/O Child] WARNING: [A906E2DFE15A4950.59CFCCA1BACC26FA]: Ignoring message 'EVENT_MESSAGE' to peer 1.1 due to a missing broker: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:297
[task 2021-09-30T01:22:40.320Z] 01:22:40     INFO - GECKO(1542) | [Child 11225, IPC I/O Child] WARNING: [A906E2DFE15A4950.59CFCCA1BACC26FA]: Ignoring message 'EVENT_MESSAGE' to peer 1.1 due to a missing broker: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:297
[task 2021-09-30T01:22:40.324Z] 01:22:40     INFO - GECKO(1542) | [Child 11225, IPC I/O Child] WARNING: [A906E2DFE15A4950.59CFCCA1BACC26FA]: Ignoring message 'EVENT_MESSAGE' to peer 1.1 due to a missing broker: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:297
[task 2021-09-30T01:22:40.326Z] 01:22:40     INFO - GECKO(1542) | [Child 11225, IPC I/O Child] WARNING: [A906E2DFE15A4950.59CFCCA1BACC26FA]: Ignoring message 'EVENT_MESSAGE' to peer 1.1 due to a missing broker: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:297
[task 2021-09-30T01:22:40.329Z] 01:22:40     INFO - GECKO(1542) | [Child 11225, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:527
[task 2021-09-30T01:22:40.330Z] 01:22:40     INFO - GECKO(1542) | [GFX1-]: Receive IPC close with reason=AbnormalShutdown
[task 2021-09-30T01:28:50.337Z] 01:28:50     INFO - Buffered messages finished
[task 2021-09-30T01:28:50.338Z] 01:28:50    ERROR - TEST-UNEXPECTED-TIMEOUT | Last test finished | application timed out after 370 seconds with no output
[task 2021-09-30T01:28:50.338Z] 01:28:50    ERROR - Force-terminating active process(es).
[task 2021-09-30T01:28:50.339Z] 01:28:50     INFO - Determining child pids from psutil...
[task 2021-09-30T01:28:50.371Z] 01:28:50     INFO - []
[task 2021-09-30T01:28:50.374Z] 01:28:50     INFO - ==> process 1542 launched child process 1560

Comment 32

[Intermittent Failures Robot]

61 failures in 3376 pushes (0.018 failures/push) were associated with this bug in the last 7 days.

This is the #15 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-central: 30
• autoland: 31

Platform and build breakdown:

• linux1804-64-qr: 27
  • debug: 27
• linux1804-64-ccov-qr: 25
  • opt: 25
• linux1804-64-tsan-qr: 4
  • opt: 4
• macosx1015-64-qr: 3
  • debug: 3
• macosx1015-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-09-27&endday=2021-10-03&tree=all

Comment 33

[Marian-Vasile Laza]

There have been 69 total failures in the last 7 days, recent failure log.
Affected platforms are:

• linux1804-64-ccov-qr
• linux1804-64-qr
• linux1804-64-tsan-qr
• macosx1015-64-qr
• macosx1015-64-shippable-qr

Comment 34

[Intermittent Failures Robot]

16 failures in 645 pushes (0.025 failures/push) were associated with this bug yesterday.

Repository breakdown:

• elm: 1
• autoland: 5
• mozilla-central: 10

Platform and build breakdown:

• linux1804-64-qr: 6
  • debug: 6
• macosx1015-64-shippable-qr: 2
  • opt: 2
• linux1804-64-ccov-qr: 8
  • opt: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-10-06&endday=2021-10-06&tree=all

Comment 35

[Jens Stutte [:jstutte]]

So these are probably just random shutdown hangs like bug 1358898.
In the linux flavor of the logs I looked at we directly see the:

[task 2021-10-06T17:13:59.775Z] 17:13:59     INFO - PROCESS-CRASH | Main app process exited normally | application crashed [@ _pt_root]
[task 2021-10-06T17:13:59.775Z] 17:13:59     INFO - Mozilla crash reason: MOZ_CRASH(Shutdown hanging after all known phases and workers finished.)

In the OSX version of the hang there is no shutdown crash, not sure what that means. But I think, this is just a dupe of bug 1358898.

Comment 36

[Intermittent Failures Robot]

57 failures in 3626 pushes (0.016 failures/push) were associated with this bug in the last 7 days.

This is the #17 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 18
• mozilla-central: 37
• elm: 1
• try: 1

Platform and build breakdown:

• linux1804-64-qr: 24
  • debug: 24
• linux1804-64-ccov-qr: 26
  • opt: 26
• macosx1015-64-shippable-qr: 3
  • opt: 3
• linux1804-64-tsan-qr: 3
  • opt: 3
• macosx1015-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-10-04&endday=2021-10-10&tree=all

Comment 37

[Andreea Pavel [:apavel]]

I checked the last 15 failure logs and all f them seem to indicate 1358898, same for the existing mac failures classified here.
Based on above comment from Jens, closing as a duplicate of bug 1358898.

Comment 38

[Intermittent Failures Robot]

30 failures in 3315 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

This is the #42 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 13
• mozilla-central: 17

Platform and build breakdown:

• linux1804-64-qr: 8
  • debug: 8
• linux1804-64-ccov-qr: 14
  • opt: 14
• linux1804-64-tsan-qr: 6
  • opt: 6
• macosx1015-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685912&startday=2021-10-11&endday=2021-10-17&tree=all