1742677 - Intermittent TEST-UNEXPECTED-TIMEOUT | Last test finished | application timed out after 370 seconds with no output

Status: RESOLVED INCOMPLETE

(WebExtensions :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=358992374&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/M7TGIpdKQ8umY-l2Ps-Y9g/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-11-23T18:30:02.575Z] 18:30:02     INFO - TEST-START | toolkit/components/extensions/test/mochitest/test_startup_canary.html
[task 2021-11-23T18:30:02.694Z] 18:30:02     INFO - GECKO(18200) | MEMORY STAT | vsize 2801MB | residentFast 364MB | heapAllocated 14MB
[task 2021-11-23T18:30:02.710Z] 18:30:02     INFO - TEST-OK | toolkit/components/extensions/test/mochitest/test_startup_canary.html | took 135ms
[task 2021-11-23T18:30:02.763Z] 18:30:02     INFO - TEST-START | Shutdown
[task 2021-11-23T18:30:02.763Z] 18:30:02     INFO - Passed:  3817
[task 2021-11-23T18:30:02.763Z] 18:30:02     INFO - Failed:  0
[task 2021-11-23T18:30:02.764Z] 18:30:02     INFO - Todo:    1
[task 2021-11-23T18:30:02.764Z] 18:30:02     INFO - Mode:    e10s
[task 2021-11-23T18:30:02.764Z] 18:30:02     INFO - Slowest: 46549ms - /tests/toolkit/components/extensions/test/mochitest/test_ext_tabs_permissions.html
[task 2021-11-23T18:30:02.766Z] 18:30:02     INFO - SimpleTest FINISHED
[task 2021-11-23T18:30:02.766Z] 18:30:02     INFO - TEST-INFO | Ran 1 Loops
[task 2021-11-23T18:30:02.766Z] 18:30:02     INFO - SimpleTest FINISHED
[task 2021-11-23T18:30:02.857Z] 18:30:02     INFO - GECKO(18200) | JavaScript error: resource://gre/modules/AsyncShutdown.jsm, line 575: NotFoundError: No such JSWindowActor 'SpecialPowers'
[task 2021-11-23T18:30:02.947Z] 18:30:02     INFO - GECKO(18200) | 1637692202946	Marionette	TRACE	Received observer notification quit-application
[task 2021-11-23T18:30:02.949Z] 18:30:02     INFO - GECKO(18200) | 1637692202947	Marionette	INFO	Stopped listening on port 2828
[task 2021-11-23T18:30:02.949Z] 18:30:02     INFO - GECKO(18200) | 1637692202947	Marionette	DEBUG	Marionette stopped listening
[task 2021-11-23T18:30:03.082Z] 18:30:03     INFO - GECKO(18200) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-11-23T18:30:03.084Z] 18:30:03     INFO - GECKO(18200) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-11-23T18:30:03.091Z] 18:30:03     INFO - GECKO(18200) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-11-23T18:30:03.091Z] 18:30:03     INFO - GECKO(18200) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-11-23T18:30:03.098Z] 18:30:03     INFO - GECKO(18200) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-11-23T18:30:03.828Z] 18:30:03     INFO - GECKO(18200) | *** WIFI GEO: shutdown called
[task 2021-11-23T18:30:03.906Z] 18:30:03     INFO - GECKO(18200) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-11-23T18:30:15.239Z] 18:30:15     INFO - GECKO(18200) | Waiting in WillDestroyCurrentMessageLoop for pid 22174
[task 2021-11-23T18:31:06.885Z] 18:31:06     INFO - GECKO(18200) | RunWatchdog: Mainthread nested event loops during hang:
[task 2021-11-23T18:31:06.886Z] 18:31:06     INFO - GECKO(18200) |  --- (no nested event loop active)
[task 2021-11-23T18:31:07.889Z] 18:31:07     INFO - GECKO(18200) | ExceptionHandler::GenerateDump cloned child 22280
[task 2021-11-23T18:31:07.889Z] 18:31:07     INFO - GECKO(18200) | ExceptionHandler::SendContinueSignalToChild sent continue signal to child
[task 2021-11-23T18:31:07.890Z] 18:31:07     INFO - GECKO(18200) | ExceptionHandler::WaitForContinueSignal waiting for continue signal...
[task 2021-11-23T18:37:17.901Z] 18:37:17     INFO - Buffered messages finished
[task 2021-11-23T18:37:17.902Z] 18:37:17    ERROR - TEST-UNEXPECTED-TIMEOUT | Last test finished | application timed out after 370 seconds with no output
[task 2021-11-23T18:37:17.902Z] 18:37:17    ERROR - Force-terminating active process(es).
[task 2021-11-23T18:37:17.903Z] 18:37:17     INFO - Determining child pids from psutil...
[task 2021-11-23T18:37:17.916Z] 18:37:17     INFO - []
[task 2021-11-23T18:37:17.917Z] 18:37:17     INFO - ==> process 18200 launched child process 18222
[task 2021-11-23T18:37:17.917Z] 18:37:17     INFO - ==> process 18200 launched child process 18282
[task 2021-11-23T18:37:17.918Z] 18:37:17     INFO - ==> process 18200 launched child process 18285
[task 2021-11-23T18:37:17.918Z] 18:37:17     INFO - ==> process 18200 launched child process 18327

[task 2021-11-23T18:37:24.478Z] 18:37:24     INFO - PROCESS-CRASH | Main app process exited normally | application crashed [@ mozilla::(anonymous namespace)::RunWatchdog(void*)]
[task 2021-11-23T18:37:24.478Z] 18:37:24     INFO - Mozilla crash reason: MOZ_CRASH(Shutdown hanging after all known phases and workers finished.)
[task 2021-11-23T18:37:24.478Z] 18:37:24     INFO - Crash dump filename: /tmp/tmppjavdlov.mozrunner/minidumps/4a41bae3-da26-cd59-7075-0628887c8250.dmp
[task 2021-11-23T18:37:24.478Z] 18:37:24     INFO - Operating system: Linux
[task 2021-11-23T18:37:24.478Z] 18:37:24     INFO -                   0.0.0 Linux 4.4.0-1014-aws #14taskcluster1-Ubuntu SMP Tue Apr 3 10:27:00 UTC 2018 x86_64
[task 2021-11-23T18:37:24.478Z] 18:37:24     INFO - CPU: amd64
[task 2021-11-23T18:37:24.478Z] 18:37:24     INFO -      family 6 model 85 stepping 4
[task 2021-11-23T18:37:24.478Z] 18:37:24     INFO -      4 CPUs
[task 2021-11-23T18:37:24.478Z] 18:37:24     INFO - Linux Ubuntu 18.04 - bionic (Ubuntu 18.04.6 LTS)
[task 2021-11-23T18:37:24.478Z] 18:37:24     INFO - 
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO - Crash reason:  SIGSEGV / SEGV_MAPERR
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO - Crash address: 0x0
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO - Process uptime: not available
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO - 
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO - Thread 27  (crashed)
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -  0  libxul.so!mozilla::(anonymous namespace)::RunWatchdog(void*) [nsTerminator.cpp:9cd4e2e23e4062375c3d55d8f42f4d05349a2510 : 256 + 0x19]
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     rax = 0x00007f77c8cd22b7   rdx = 0x00007f77e795c240
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     rcx = 0x00005620aebfb230   rbx = 0x00007f77994fee40
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     rsi = 0x0000000000000000   rdi = 0x00007f77e795c240
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     rbp = 0x00007f77994fee60   rsp = 0x00007f77994fee30
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -      r8 = 0x0000000000000000    r9 = 0x0000000000000000
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     r10 = 0x00007f77e7d3c8f0   r11 = 0x0000000000000022
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     r12 = 0x00007f778e5575e0   r13 = 0x0000000000000007
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     r14 = 0x00007f77883efc40   r15 = 0x00000000000056f5
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     rip = 0x00007f77d4db67ca
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     Found by: given as instruction pointer in context
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -  1  libnspr4.so!_pt_root [ptthread.c:9cd4e2e23e4062375c3d55d8f42f4d05349a2510 : 201 + 0x9]
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     rbx = 0x00007f77e795c450   rbp = 0x00007f77994feeb0
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     rsp = 0x00007f77994fee70   r12 = 0x00007f778e5575e0
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     r13 = 0x0000000000000007   r14 = 0x00007f77994ff700
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     r15 = 0x00000000000056f5   rip = 0x00007f77e8e7254f
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     Found by: call frame info
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -  2  libpthread.so.0!start_thread [pthread_create.c : 463 + 0xc]
[task 2021-11-23T18:37:24.479Z] 18:37:24     INFO -     rbx = 0x0000000000000000   rbp = 0x0000000000000000
[task 2021-11-23T18:37:24.480Z] 18:37:24     INFO -     rsp = 0x00007f77994feec0   r12 = 0x00007f77994fef80
[task 2021-11-23T18:37:24.480Z] 18:37:24     INFO -     r13 = 0x0000000000000000   r14 = 0x00007f778e5575e0
[task 2021-11-23T18:37:24.480Z] 18:37:24     INFO -     r15 = 0x00007ffcac15c568   rip = 0x00007f77e8af26db
[task 2021-11-23T18:37:24.480Z] 18:37:24     INFO -     Found by: call frame info
[task 2021-11-23T18:37:24.480Z] 18:37:24     INFO -  3  libc.so.6!__GI___clone + 0x3e
[task 2021-11-23T18:37:24.480Z] 18:37:24     INFO -     rbx = 0x00007f77994ff700   rbp = 0x0000000000000000
[task 2021-11-23T18:37:24.480Z] 18:37:24     INFO -     rsp = 0x00007f77994fef80   r12 = 0x00007f77994fef80
[task 2021-11-23T18:37:24.480Z] 18:37:24     INFO -     r13 = 0x0000000000000000   r14 = 0x00007f778e5575e0
[task 2021-11-23T18:37:24.480Z] 18:37:24     INFO -     r15 = 0x00007ffcac15c568   rip = 0x00007f77e7cd8a3f
[task 2021-11-23T18:37:24.480Z] 18:37:24     INFO -     Found by: call frame info

Comment 1

[Intermittent Failures Robot]

15 failures in 562 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 8
• autoland: 7

Platform and build breakdown:

• linux1804-64-tsan-qr: 4
  • opt: 4
• linux1804-64-qr: 7
  • debug: 7
• linux1804-64-ccov-qr: 3
  • opt: 3
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-11-25&endday=2021-11-25&tree=all

Comment 2

[Alexandru Michis [:malexandru]]

Jens, isn't this a duplicate of Bug 1358898 just like Bug 1685912?

Comment 3

[Narcis Beleuzu [:NarcisB]]

There are 37 failures in the last 5 days.
Most of them (34) are on linux1804-64-qr and 2 of them are on macosx1015-64-qr

Comment 4

[Intermittent Failures Robot]

41 failures in 2819 pushes (0.015 failures/push) were associated with this bug in the last 7 days.

This is the #26 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 21
• autoland: 19
• try: 1

Platform and build breakdown:

• linux1804-64-ccov-qr: 10
  • opt: 10
• linux1804-64-qr: 21
  • debug: 21
• linux1804-64-tsan-qr: 7
  • opt: 7
• macosx1015-64-qr: 2
  • debug: 2
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-11-22&endday=2021-11-28&tree=all

Comment 5

[Jens Stutte [:jstutte]]

(In reply to Alexandru Michis [:malexandru] from comment #2)

Jens, isn't this a duplicate of Bug 1358898 just like Bug 1685912?

It is a shutdown hang, but I think it is more the special case of bug 1730374.

Comment 6

[Intermittent Failures Robot]

32 failures in 590 pushes (0.054 failures/push) were associated with this bug yesterday.

Repository breakdown:

• try: 3
• autoland: 23
• mozilla-central: 6

Platform and build breakdown:

• macosx1015-64-qr: 3
  • opt: 1
  • debug: 2
• linux1804-64-qr: 25
  • debug: 25
• linux1804-64-ccov-qr: 3
  • opt: 3
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-11-30&endday=2021-11-30&tree=all

Comment 7

[Intermittent Failures Robot]

28 failures in 670 pushes (0.042 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• try: 4
• mozilla-central: 11

Platform and build breakdown:

• linux1804-64-qr: 14
  • debug: 14
• macosx1015-64-qr: 6
  • debug: 6
• linux1804-64-ccov-qr: 4
  • opt: 4
• linux1804-64-tsan-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-12-01&endday=2021-12-01&tree=all

Comment 8

[Andreea Pavel [:apavel]]

There are 92 total failures in the last 7 days on

• linux1804-64-ccov-qr opt
• linux1804-64-qr debug
• linux1804-64-tsan-qr opt
• macosx1015-64-qr debug

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=360175244&repo=autoland&lineNumber=5466

task 2021-12-04T14:59:33.415Z] 14:59:33     INFO - TEST-START | toolkit/components/extensions/test/mochitest/test_startup_canary.html
[task 2021-12-04T14:59:33.927Z] 14:59:33     INFO - GECKO(5200) | MEMORY STAT | vsize 130550644MB | residentFast 673MB
[task 2021-12-04T14:59:33.972Z] 14:59:33     INFO - TEST-OK | toolkit/components/extensions/test/mochitest/test_startup_canary.html | took 557ms
[task 2021-12-04T14:59:34.179Z] 14:59:34     INFO - TEST-START | Shutdown
[task 2021-12-04T14:59:34.179Z] 14:59:34     INFO - Passed:  2089
[task 2021-12-04T14:59:34.179Z] 14:59:34     INFO - Failed:  0
[task 2021-12-04T14:59:34.180Z] 14:59:34     INFO - Todo:    1
[task 2021-12-04T14:59:34.181Z] 14:59:34     INFO - Mode:    e10s
[task 2021-12-04T14:59:34.183Z] 14:59:34     INFO - Slowest: 91289ms - /tests/toolkit/components/extensions/test/mochitest/test_ext_tabs_permissions.html
[task 2021-12-04T14:59:34.194Z] 14:59:34     INFO - SimpleTest FINISHED
[task 2021-12-04T14:59:34.195Z] 14:59:34     INFO - TEST-INFO | Ran 1 Loops
[task 2021-12-04T14:59:34.198Z] 14:59:34     INFO - SimpleTest FINISHED
[task 2021-12-04T14:59:34.613Z] 14:59:34     INFO - GECKO(5200) | JavaScript error: resource://gre/modules/AsyncShutdown.jsm, line 575: NotFoundError: No such JSWindowActor 'SpecialPowers'
[task 2021-12-04T14:59:34.900Z] 14:59:34     INFO - GECKO(5200) | JavaScript error: resource://gre/modules/AsyncShutdown.jsm, line 575: NotFoundError: No such JSWindowActor 'AppTestDelegate'
[task 2021-12-04T14:59:34.903Z] 14:59:34     INFO - GECKO(5200) | JavaScript error: resource://gre/modules/AsyncShutdown.jsm, line 575: NotFoundError: No such JSWindowActor 'AppTestDelegate'
[task 2021-12-04T14:59:35.140Z] 14:59:35     INFO - GECKO(5200) | 1638629975139	Marionette	TRACE	Received observer notification quit-application
[task 2021-12-04T14:59:35.144Z] 14:59:35     INFO - GECKO(5200) | 1638629975140	Marionette	INFO	Stopped listening on port 2828
[task 2021-12-04T14:59:35.148Z] 14:59:35     INFO - GECKO(5200) | 1638629975142	Marionette	DEBUG	Marionette stopped listening
[task 2021-12-04T14:59:35.994Z] 14:59:35     INFO - GECKO(5200) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-12-04T14:59:35.997Z] 14:59:35     INFO - GECKO(5200) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-12-04T14:59:36.058Z] 14:59:36     INFO - GECKO(5200) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-12-04T14:59:36.061Z] 14:59:36     INFO - GECKO(5200) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-12-04T14:59:38.618Z] 14:59:38     INFO - GECKO(5200) | *** WIFI GEO: shutdown called
[task 2021-12-04T14:59:38.798Z] 14:59:38     INFO - GECKO(5200) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-12-04T14:59:51.431Z] 14:59:51     INFO - GECKO(5200) | Waiting in WillDestroyCurrentMessageLoop for pid 8664
[task 2021-12-04T15:05:41.961Z] 15:05:41     INFO - GECKO(5200) | RunWatchdog: Mainthread nested event loops during hang:
[task 2021-12-04T15:05:41.962Z] 15:05:41     INFO - GECKO(5200) |  --- (no nested event loop active)
[task 2021-12-04T15:05:42.962Z] 15:05:42     INFO - GECKO(5200) | ThreadSanitizer:DEADLYSIGNAL
[task 2021-12-04T15:05:42.963Z] 15:05:42     INFO - GECKO(5200) | ==5200==ERROR: ThreadSanitizer: SEGV on unknown address 0x000000000000 (pc 0x7efdd3abbb35 bp 0x000000000e2e sp 0x7efd3cb4f1f0 T8768)
[task 2021-12-04T15:05:42.963Z] 15:05:42     INFO - GECKO(5200) | ==5200==The signal is caused by a WRITE memory access.
[task 2021-12-04T15:05:42.964Z] 15:05:42     INFO - GECKO(5200) | ==5200==Hint: address points to the zero page.
[task 2021-12-04T15:05:43.009Z] 15:05:43     INFO - GECKO(5200) |     #0 mozilla::(anonymous namespace)::RunWatchdog(void*) /builds/worker/checkouts/gecko/toolkit/components/terminator/nsTerminator.cpp:256:5 (libxul.so+0x6fc2b35)
[task 2021-12-04T15:05:43.010Z] 15:05:43     INFO - GECKO(5200) |     #1 _pt_root /builds/worker/checkouts/gecko/nsprpub/pr/src/pthreads/ptthread.c:201:5 (libnspr4.so+0x44fbd)
[task 2021-12-04T15:05:43.011Z] 15:05:43     INFO - GECKO(5200) |     #2 __tsan_thread_start_func /builds/worker/fetches/llvm-project/llvm/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:967:15 (firefox+0x590fc)
[task 2021-12-04T15:05:43.013Z] 15:05:43     INFO - GECKO(5200) |     #3 start_thread /tmp/glibc/nptl/pthread_create.c:463 (libpthread.so.0+0x76da)
[task 2021-12-04T15:05:43.014Z] 15:05:43     INFO - GECKO(5200) |     #4 __clone /tmp/glibc/misc/../sysdeps/unix/sysv/linux/x86_64/clone.S:95 (libc.so.6+0x121a3e)
[task 2021-12-04T15:05:43.015Z] 15:05:43     INFO - GECKO(5200) | ThreadSanitizer can not provide additional info.
[task 2021-12-04T15:05:43.016Z] 15:05:43     INFO - GECKO(5200) | SUMMARY: ThreadSanitizer: SEGV /builds/worker/checkouts/gecko/toolkit/components/terminator/nsTerminator.cpp:256:5 in mozilla::(anonymous namespace)::RunWatchdog(void*)
[task 2021-12-04T15:05:43.018Z] 15:05:43     INFO - GECKO(5200) | ==5200==ABORTING
[task 2021-12-04T15:11:53.024Z] 15:11:53     INFO - Buffered messages finished
[task 2021-12-04T15:11:53.026Z] 15:11:53    ERROR - TEST-UNEXPECTED-TIMEOUT | Last test finished | application timed out after 370 seconds with no output
[task 2021-12-04T15:11:53.026Z] 15:11:53    ERROR - Force-terminating active process(es).
[task 2021-12-04T15:11:53.027Z] 15:11:53     INFO - Determining child pids from psutil...
[task 2021-12-04T15:11:53.036Z] 15:11:53     INFO - []
[task 2021-12-04T15:11:53.037Z] 15:11:53     INFO - ==> process 5200 launched child process 5215

[task 2021-12-04T15:12:23.558Z] 15:12:23     INFO - Error: Failed to kill process 6653: psutil.NoSuchProcess no process found with pid 6653
[task 2021-12-04T15:12:23.558Z] 15:12:23     INFO - Killing process: 5200
[task 2021-12-04T15:12:23.559Z] 15:12:23     INFO - Not taking screenshot here: see the one that was previously logged
[task 2021-12-04T15:12:23.559Z] 15:12:23     INFO - Can't trigger Breakpad, just killing process
[task 2021-12-04T15:12:23.560Z] 15:12:23     INFO - psutil found pid 5200 dead
[task 2021-12-04T15:12:23.560Z] 15:12:23     INFO - psutil found pid 5200 dead
[task 2021-12-04T15:12:23.561Z] 15:12:23     INFO - TEST-INFO | Main app process: exit 0

Comment 9

[Intermittent Failures Robot]

91 failures in 3170 pushes (0.029 failures/push) were associated with this bug in the last 7 days.

This is the #6 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 54
• mozilla-central: 28
• try: 9

Platform and build breakdown:

• linux1804-64-qr: 55
  • debug: 55
• linux1804-64-tsan-qr: 9
  • opt: 9
• macosx1015-64-qr: 15
  • debug: 14
  • opt: 1
• linux1804-64-ccov-qr: 12
  • opt: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-11-29&endday=2021-12-05&tree=all

Comment 10

[Intermittent Failures Robot]

15 failures in 660 pushes (0.023 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 7
• autoland: 7
• try: 1

Platform and build breakdown:

• linux1804-64-ccov-qr: 3
  • opt: 3
• linux1804-64-qr: 6
  • debug: 6
• linux1804-64-tsan-qr: 3
  • opt: 3
• macosx1015-64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-12-07&endday=2021-12-07&tree=all

Comment 11

[Intermittent Failures Robot]

18 failures in 731 pushes (0.025 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 6
• mozilla-central: 6
• try: 6

Platform and build breakdown:

• linux1804-64-qr: 12
  • debug: 12
• linux1804-64-ccov-qr: 3
  • opt: 3
• macosx1015-64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-12-08&endday=2021-12-08&tree=all

Comment 12

[Intermittent Failures Robot]

15 failures in 596 pushes (0.025 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 13
• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-qr: 11
  • debug: 11
• linux1804-64-tsan-qr: 1
  • opt: 1
• macosx1015-64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-12-09&endday=2021-12-09&tree=all

Comment 13

[Intermittent Failures Robot]

20 failures in 581 pushes (0.034 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 5
• try: 1

Platform and build breakdown:

• linux1804-64-qr: 11
  • debug: 11
• linux1804-64-ccov-qr: 3
  • opt: 3
• linux1804-64-asan-qr: 1
  • opt: 1
• macosx1015-64-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-12-10&endday=2021-12-10&tree=all

Comment 14

[Intermittent Failures Robot]

83 failures in 3319 pushes (0.025 failures/push) were associated with this bug in the last 7 days.

This is the #10 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 50
• mozilla-central: 25
• try: 8

Platform and build breakdown:

• linux1804-64-qr: 51
  • debug: 51
• linux1804-64-ccov-qr: 12
  • opt: 12
• linux1804-64-tsan-qr: 4
  • opt: 4
• macosx1015-64-qr: 15
  • debug: 15
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-12-06&endday=2021-12-12&tree=all

Comment 15

[Intermittent Failures Robot]

32 failures in 682 pushes (0.047 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 19
• mozilla-central: 12
• try: 1

Platform and build breakdown:

• linux1804-64-qr: 21
  • debug: 21
• linux1804-64-ccov-qr: 5
  • opt: 5
• macosx1015-64-qr: 6
  • debug: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-12-15&endday=2021-12-15&tree=all

Comment 16

[Intermittent Failures Robot]

96 failures in 3263 pushes (0.029 failures/push) were associated with this bug in the last 7 days.

This is the #8 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 53
• try: 10
• mozilla-central: 33

Platform and build breakdown:

• macosx1015-64-qr: 25
  • debug: 24
  • opt: 1
• linux1804-64-qr: 57
  • debug: 57
• linux1804-64-asan-qr: 2
  • opt: 2
• linux1804-64-ccov-qr: 12
  • opt: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-12-13&endday=2021-12-19&tree=all

Comment 17

[Andreea Pavel [:apavel]]

There are 93 total failures in the last 7 days on

• linux1804-64-ccov-qr opt
• linux1804-64-qr debug
• macosx1015-64-qr debug

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=361980249&repo=mozilla-central&lineNumber=52187

[task 2021-12-21T10:09:20.522Z] 10:09:20     INFO - TEST-START | browser/modules/test/browser/browser_urlBar_zoom.js
[task 2021-12-21T10:09:20.563Z] 10:09:20     INFO - GECKO(9543) | [Child 12253: Main Thread]: I/DocShellAndDOMWindowLeak ++DOCSHELL 7ffa15372400 == 1 [pid = 12253] [id = 0]
[task 2021-12-21T10:09:20.563Z] 10:09:20     INFO - GECKO(9543) | [Child 12253: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 1 (7ffa2aa7d740) [pid = 12253] [serial = 1] [outer = 0]
[task 2021-12-21T10:09:20.566Z] 10:09:20     INFO - GECKO(9543) | [Child 12253: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 2 (7ffa15372800) [pid = 12253] [serial = 2] [outer = 7ffa2aa7d740]
[task 2021-12-21T10:09:20.591Z] 10:09:20     INFO - GECKO(9543) | [Child 9688: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 25 (7f5941ca0740) [pid = 9688] [serial = 59] [outer = 0] [url = about:newtab]
[task 2021-12-21T10:09:20.593Z] 10:09:20     INFO - GECKO(9543) | [Child 9688: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 24 (7f594447e740) [pid = 9688] [serial = 56] [outer = 0] [url = about:newtab]
[task 2021-12-21T10:09:20.593Z] 10:09:20     INFO - GECKO(9543) | [Child 9688: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 23 (7f5941ca0c80) [pid = 9688] [serial = 61] [outer = 0] [url = about:newtab]
[task 2021-12-21T10:09:20.594Z] 10:09:20     INFO - GECKO(9543) | [Child 9688: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 22 (7f5942a2ee40) [pid = 9688] [serial = 54] [outer = 0] [url = about:blank]
[task 2021-12-21T10:09:20.595Z] 10:09:20     INFO - GECKO(9543) | [Child 9688: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 21 (7f594447e580) [pid = 9688] [serial = 51] [outer = 0] [url = about:newtab]
[task 2021-12-21T10:09:20.627Z] 10:09:20     INFO - GECKO(9543) | Waiting for browser load
[task 2021-12-21T10:09:20.628Z] 10:09:20     INFO - GECKO(9543) | Waiting for browser state change
[task 2021-12-21T10:09:20.775Z] 10:09:20     INFO - GECKO(9543) | Saw state f0001 and status 0
[task 2021-12-21T10:09:20.990Z] 10:09:20     INFO - GECKO(9543) | [Child 12253, Main Thread] WARNING: NS_ENSURE_TRUE(info) failed: file /builds/worker/checkouts/gecko/extensions/permissions/PermissionDelegateHandler.cpp:348
[task 2021-12-21T10:09:20.991Z] 10:09:20     INFO - GECKO(9543) | [Child 12253, Main Thread] WARNING: NS_ENSURE_TRUE(info) failed: file /builds/worker/checkouts/gecko/extensions/permissions/PermissionDelegateHandler.cpp:348
[task 2021-12-21T10:09:20.996Z] 10:09:20     INFO - GECKO(9543) | [Child 12253: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 3 (7ffa15374c00) [pid = 12253] [serial = 3] [outer = 7ffa2aa7d740]
[task 2021-12-21T10:09:21.245Z] 10:09:21     INFO - GECKO(9543) | Saw state c0010 and status 0
[task 2021-12-21T10:09:21.246Z] 10:09:21     INFO - GECKO(9543) | Browser got expected state change https://example.com/
[task 2021-12-21T10:09:21.330Z] 10:09:21     INFO - GECKO(9543) | [Child 12253, Main Thread] WARNING: Scrolled rect smaller than scrollport?: file /builds/worker/checkouts/gecko/layout/generic/nsGfxScrollFrame.cpp:7102
[task 2021-12-21T10:09:21.618Z] 10:09:21     INFO - GECKO(9543) | [Child 12277: Main Thread]: I/DocShellAndDOMWindowLeak ++DOCSHELL 7faae5c82400 == 1 [pid = 12277] [id = 0]
[task 2021-12-21T10:09:21.620Z] 10:09:21     INFO - GECKO(9543) | [Child 12277: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 1 (7faafb37d740) [pid = 12277] [serial = 1] [outer = 0]
[task 2021-12-21T10:09:21.621Z] 10:09:21     INFO - GECKO(9543) | [Child 12277: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 2 (7faae5c82800) [pid = 12277] [serial = 2] [outer = 7faafb37d740]
[task 2021-12-21T10:09:21.705Z] 10:09:21     INFO - GECKO(9543) | Waiting for browser load
[task 2021-12-21T10:09:21.710Z] 10:09:21     INFO - GECKO(9543) | Waiting for browser state change

[task 2021-12-21T10:09:38.153Z] 10:09:38     INFO - GECKO(9543) | [RDD 11154, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp:4438
[task 2021-12-21T10:09:51.046Z] 10:09:51     INFO - GECKO(9543) | console.error: (new Error("SessionFile is closed", "resource:///modules/sessionstore/SessionFile.jsm", 446))
[task 2021-12-21T10:10:41.220Z] 10:10:41     INFO - GECKO(9543) | XPCOM_MEM_BLOAT_LOG: /tmp/tmpniabj9iq.mozrunner/runtests_leaks.log
[task 2021-12-21T10:10:41.222Z] 10:10:41     INFO - GECKO(9543) | Writing to log: /tmp/tmpniabj9iq.mozrunner/runtests_leaks.log
[task 2021-12-21T10:10:41.223Z] 10:10:41     INFO - GECKO(9543) | RunWatchdog: Mainthread nested event loops during hang:
[task 2021-12-21T10:10:41.224Z] 10:10:41     INFO - GECKO(9543) |  --- CompositorThreadHolder::Shutdown
[task 2021-12-21T10:10:42.228Z] 10:10:42     INFO - GECKO(9543) | Hit MOZ_CRASH(Shutdown hanging after all known phases and workers finished.) at /builds/worker/checkouts/gecko/toolkit/components/terminator/nsTerminator.cpp:256
[task 2021-12-21T10:10:42.236Z] 10:10:42     INFO -  Initializing stack-fixing for the first stack frame, this may take a while...
[task 2021-12-21T10:10:52.583Z] 10:10:52     INFO - GECKO(9543) | #01: mozilla::(anonymous namespace)::RunWatchdog(void*) [toolkit/components/terminator/nsTerminator.cpp:256]
[task 2021-12-21T10:10:52.599Z] 10:10:52     INFO - GECKO(9543) | #02: _pt_root [nsprpub/pr/src/pthreads/ptthread.c:204]
[task 2021-12-21T10:10:52.601Z] 10:10:52     INFO - GECKO(9543) | #03: ??? [/lib/x86_64-linux-gnu/libpthread.so.0 + 0x76db]
[task 2021-12-21T10:10:52.605Z] 10:10:52     INFO - GECKO(9543) | #04: clone [/lib/x86_64-linux-gnu/libc.so.6 + 0x121a3f]
[task 2021-12-21T10:10:52.606Z] 10:10:52     INFO - GECKO(9543) | #05: ??? (???:???)
[task 2021-12-21T10:10:52.606Z] 10:10:52     INFO - GECKO(9543) | ExceptionHandler::GenerateDump cloned child 12401
[task 2021-12-21T10:10:52.607Z] 10:10:52     INFO - GECKO(9543) | ExceptionHandler::SendContinueSignalToChild sent continue signal to child
[task 2021-12-21T10:10:52.610Z] 10:10:52     INFO - GECKO(9543) | ExceptionHandler::WaitForContinueSignal waiting for continue signal...
[task 2021-12-21T10:10:52.610Z] 10:10:52     INFO - GECKO(9543) | [Child 9980, IPC I/O Child] WARNING: [D95291CAC36F580E.F635102BAADF04E8]: Ignoring message 'EVENT_MESSAGE' to peer 1.1 due to a missing broker: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:349
[task 2021-12-21T10:10:52.610Z] 10:10:52     INFO - GECKO(9543) | [Child 9980, IPC I/O Child] WARNING: [D95291CAC36F580E.F635102BAADF04E8]: Ignoring message 'EVENT_MESSAGE' to peer 1.1 due to a missing broker: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:349
[task 2021-12-21T10:10:52.611Z] 10:10:52     INFO - GECKO(9543) | [Child 9980, IPC I/O Child] WARNING: [D95291CAC36F580E.F635102BAADF04E8]: Ignoring message 'EVENT_MESSAGE' to peer 1.1 due to a missing broker: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:349
[task 2021-12-21T10:10:52.611Z] 10:10:52     INFO - GECKO(9543) | [Child 9980, IPC I/O Child] WARNING: [D95291CAC36F580E.F635102BAADF04E8]: Ignoring message 'EVENT_MESSAGE' to peer 1.1 due to a missing broker: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:349
[task 2021-12-21T10:10:52.612Z] 10:10:52     INFO - GECKO(9543) | [Child 9980, Main Thread] WARNING: IPC message 'PContent::Msg_GraphicsError' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:523
[task 2021-12-21T10:10:52.612Z] 10:10:52     INFO - GECKO(9543) | [GFX1-]: Receive IPC close with reason=AbnormalShutdown
[task 2021-12-21T10:17:02.624Z] 10:17:02     INFO - Buffered messages finished
[task 2021-12-21T10:17:02.625Z] 10:17:02    ERROR - TEST-UNEXPECTED-TIMEOUT | Last test finished | application timed out after 370 seconds with no output
[task 2021-12-21T10:17:02.626Z] 10:17:02    ERROR - Force-terminating active process(es).
[task 2021-12-21T10:17:02.627Z] 10:17:02     INFO - Determining child pids from psutil...
[task 2021-12-21T10:17:02.631Z] 10:17:02     INFO - []
[task 2021-12-21T10:17:02.633Z] 10:17:02     INFO - ==> process 9543 launched child process 9559
[task 2021-12-21T10:17:02.634Z] 10:17:02     INFO - ==> process 9543 launched child process 9614
[task 2021-12-21T10:17:02.636Z] 10:17:02     INFO - ==> process 9543 launched child process 9633
[task 2021-12-21T10:17:02.637Z] 10:17:02     INFO - ==> process 9543 launched child process 9688
[task 2021-12-21T10:17:02.639Z] 10:17:02     INFO - ==> process 9543 launched child process 9712
[task 2021-12-21T10:17:02.640Z] 10:17:02     INFO - ==> process 9543 launched child process 9725

[task 2021-12-21T10:17:02.782Z] 10:17:02     INFO - ==> process 9543 launched child process 12344
[task 2021-12-21T10:17:02.783Z] 10:17:02     INFO - ==> process 9543 launched child process 12348
[task 2021-12-21T10:17:02.784Z] 10:17:02     INFO - Found child pids: {10754, 11268, 10246, 11782, 11277, 11283, 10778, 11814, 9770, 10284, 9774, 12341, 10808, 12344, 12348, 11838, 10306, 10826, 9810, 10330, 11866, 10332, 10335, 11366, 11370, 10859, 11889, 9853, 10880, 10881, 11921, 11412, 11416, 10915, 9901, 11953, 10425, 10939, 11462, 10440, 11980, 10446, 10964, 11990, 9943, 11486, 11487, 10482, 11510, 11002, 9980, 12028, 10505, 9996, 11024, 11540, 12059, 11044, 10022, 10538, 10543, 11572, 11067, 11582, 11076, 10058, 9559, 12119, 10586, 11620, 10092, 12144, 12146, 11126, 10618, 11137, 10120, 10634, 11661, 9614, 10126, 11154, 12187, 9633, 11685, 10664, 11693, 11696, 10162, 10678, 12221, 11199, 10181, 10186, 9688, 10712, 12253, 10730, 11242, 11759, 9712, 12277, 9725, 12286}
[task 2021-12-21T10:17:02.785Z] 10:17:02     INFO - Failed to get child procs
[task 2021-12-21T10:17:02.786Z] 10:17:02     INFO - Killing process: 10754
[task 2021-12-21T10:17:02.787Z] 10:17:02     INFO - TEST-INFO | started process screentopng
[task 2021-12-21T10:17:03.060Z] 10:17:03     INFO - TEST-INFO | screentopng: exit 0

Shane, can you please take a look? Thank you.

Comment 18

[Shane Caraveo (:mixedpuppy)]

Tom, from comment 16, it looks like it is all fission related, though not all the failures in there have extension tests. Can you get a look at this?

Comment 19

[Tomislav Jovanovic :zombie]

This doesn't look like an issue in extensions framework code, I looked at a few dozen logs and less than half of them are related to extensions (like the last one linked), and of those that are failing after extension tests, they're all over the place, not specific to a single test/module/API/functionality or anything else in common.

Very likely an issue in lower level code, and I have nothing to go on from these logs. Probably a dupe/special case of one of these:

(In reply to Jens Stutte [:jstutte] from comment #5)

(In reply to Alexandru Michis [:malexandru] from comment #2)

Jens, isn't this a duplicate of Bug 1358898 just like Bug 1685912?

It is a shutdown hang, but I think it is more the special case of bug 1730374.

Comment 20

[Intermittent Failures Robot]

57 failures in 2286 pushes (0.025 failures/push) were associated with this bug in the last 7 days.

This is the #7 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 39
• mozilla-central: 17
• try: 1

Platform and build breakdown:

• macosx1015-64-qr: 14
  • debug: 14
• linux1804-64-qr: 34
  • debug: 34
• linux1804-64-ccov-qr: 9
  • opt: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-12-20&endday=2021-12-26&tree=all

Comment 21

[Intermittent Failures Robot]

15 failures in 128 pushes (0.117 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 12
• mozilla-central: 3

Platform and build breakdown:

• macosx1015-64-qr: 7
  • debug: 7
• linux1804-64-qr: 8
  • debug: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-12-27&endday=2021-12-27&tree=all

Comment 22

[Intermittent Failures Robot]

55 failures in 1011 pushes (0.054 failures/push) were associated with this bug in the last 7 days.

This is the #9 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 31
• mozilla-central: 24

Platform and build breakdown:

• macosx1015-64-qr: 14
  • debug: 14
• linux1804-64-qr: 29
  • debug: 29
• linux1804-64-ccov-qr: 11
  • opt: 11
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2021-12-27&endday=2022-01-02&tree=all

Comment 23

[Intermittent Failures Robot]

15 failures in 568 pushes (0.026 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 10
• mozilla-central: 5

Platform and build breakdown:

• linux1804-64-qr: 10
  • debug: 10
• macosx1015-64-qr: 3
  • debug: 3
• linux1804-64-ccov-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-01-04&endday=2022-01-04&tree=all

Comment 24

[Intermittent Failures Robot]

19 failures in 586 pushes (0.032 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 10
• try: 3
• mozilla-central: 6

Platform and build breakdown:

• linux1804-64-qr: 11
  • debug: 11
• macosx1015-64-qr: 6
  • debug: 6
• linux1804-64-ccov-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-01-06&endday=2022-01-06&tree=all

Comment 25

[Intermittent Failures Robot]

77 failures in 2801 pushes (0.027 failures/push) were associated with this bug in the last 7 days.

This is the #6 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• try: 5
• autoland: 39
• mozilla-central: 32
• mozilla-esr91: 1

Platform and build breakdown:

• linux1804-64-qr: 43
  • debug: 43
• macosx1015-64-qr: 21
  • debug: 21
• linux1804-64-ccov-qr: 12
  • opt: 12
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-01-03&endday=2022-01-09&tree=all

Comment 26

[Intermittent Failures Robot]

4 failures in 3060 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4

Platform and build breakdown:

• linux1804-64-qr: 2
  • debug: 2
• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-01-10&endday=2022-01-16&tree=all

Comment 27

[Intermittent Failures Robot]

2 failures in 3444 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-01-17&endday=2022-01-23&tree=all

Comment 28

[Intermittent Failures Robot]

5 failures in 3445 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 5

Platform and build breakdown:

• linux1804-64-ccov-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-01-24&endday=2022-01-30&tree=all

Comment 29

[Intermittent Failures Robot]

8 failures in 3165 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• autoland: 4

Platform and build breakdown:

• linux1804-64-ccov-qr: 2
  • opt: 2
• macosx1015-64-shippable-qr: 3
  • opt: 3
• macosx1015-64-qr: 1
  • opt: 1
• macosx1100-64-shippable-qr: 1
  • opt: 1
• windows7-32-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-01-31&endday=2022-02-06&tree=all

Comment 30

[Intermittent Failures Robot]

2 failures in 3711 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1
• windows7-32-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-02-07&endday=2022-02-13&tree=all

Comment 31

[Intermittent Failures Robot]

3 failures in 3281 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-qr: 2
  • opt: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-02-14&endday=2022-02-20&tree=all

Comment 32

[Intermittent Failures Robot]

3 failures in 2992 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 1
• mozilla-central: 1
• autoland: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1
• linux1804-64-ccov-qr: 1
  • opt: 1
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-02-21&endday=2022-02-27&tree=all

Comment 33

[Intermittent Failures Robot]

4 failures in 3063 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 1

Platform and build breakdown:

• linux1804-64-ccov-qr: 3
  • opt: 3
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-02-28&endday=2022-03-06&tree=all

Comment 34

[Intermittent Failures Robot]

5 failures in 2837 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-qr: 2
  • debug: 1
  • opt: 1
• windows10-64-2004-qr: 1
  • opt: 1
• windows10-32-2004-qr: 1
  • opt: 1
• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-03-07&endday=2022-03-13&tree=all

Comment 35

[Intermittent Failures Robot]

6 failures in 3304 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 1

Platform and build breakdown:

• windows7-32-qr: 2
  • opt: 2
• macosx1015-64-qr: 2
  • opt: 2
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-domstreams-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-03-14&endday=2022-03-20&tree=all

Comment 36

[Intermittent Failures Robot]

4 failures in 3341 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 2

Platform and build breakdown:

• linux1804-64-ccov-qr: 2
  • opt: 2
• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-03-21&endday=2022-03-27&tree=all

Comment 37

[Intermittent Failures Robot]

7 failures in 3323 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• autoland: 3

Platform and build breakdown:

• linux1804-64-ccov-qr: 3
  • opt: 3
• macosx1015-64-qr: 1
  • debug: 1
• windows7-32-shippable-qr: 1
  • opt: 1
• linux1804-64-tsan-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-03-28&endday=2022-04-03&tree=all

Comment 38

[Intermittent Failures Robot]

8 failures in 2922 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• mozilla-esr91: 1
• autoland: 4

Platform and build breakdown:

• windows7-32-shippable-qr: 2
  • opt: 2
• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-qr: 4
  • debug: 4
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-04-04&endday=2022-04-10&tree=all

Comment 39

[Intermittent Failures Robot]

2 failures in 2948 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1
• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-04-11&endday=2022-04-17&tree=all

Comment 40

[Jens Stutte [:jstutte]]

Here I read:

FATAL ERROR: AsyncShutdown timeout in profile-before-change Conditions: [
 {"name":"ContentParent: id=7f25d516f900","state":{"remoteTypePrefix":"prealloc"},
  "filename":"/builds/worker/checkouts/gecko/dom/ipc/ContentParent.cpp","lineNumber":3589,
  "stack":["resource://gre/modules/nsAsyncShutdown.jsm:addBlocker:162"]},
 {"name":"ContentParent: id=7f25d2f95500",
  "state":{"remoteTypePrefix":"prealloc"},
  "filename":"/builds/worker/checkouts/gecko/dom/ipc/ContentParent.cpp","lineNumber":3589,
  "stack":["resource://gre/modules/nsAsyncShutdown.jsm:addBlocker:162"]}
] 
At least one completion condition failed to complete within a reasonable amount of time. Causing a crash to ensure that we do not leave the user with an unresponsive process draining resources.

This is a manifestation of a double shutdown blocker for the same ContentParent. That alone should not cause hangs, but there are also some possible races around the shutdown blockers. Bug 1764251 might help here to some extent.

Comment 41

[Intermittent Failures Robot]

7 failures in 3159 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• try: 1
• autoland: 2

Platform and build breakdown:

• linux1804-64-ccov-qr: 4
  • opt: 4
• windows10-64-2004-qr: 1
  • opt: 1
• linux1804-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-04-18&endday=2022-04-24&tree=all

Comment 42

[Intermittent Failures Robot]

2 failures in 3289 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-tsan-qr: 1
  • opt: 1
• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-04-25&endday=2022-05-01&tree=all

Comment 43

[Intermittent Failures Robot]

5 failures in 3540 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-qr: 1
  • debug: 1
• linux1804-64-asan-qr: 2
  • opt: 2
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-05-02&endday=2022-05-08&tree=all

Comment 44

[Intermittent Failures Robot]

5 failures in 3317 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5

Platform and build breakdown:

• windows10-64-2004-qr: 2
  • opt: 2
• macosx1015-64-shippable-qr: 1
  • opt: 1
• linux1804-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-05-09&endday=2022-05-15&tree=all

Comment 45

[Intermittent Failures Robot]

7 failures in 2694 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 4
• mozilla-esr91: 1

Platform and build breakdown:

• windows7-32-shippable-qr: 1
  • opt: 1
• linux1804-64-ccov-qr: 1
  • opt: 1
• linux1804-64-qr: 4
  • debug: 4
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-05-16&endday=2022-05-22&tree=all

Comment 46

[Intermittent Failures Robot]

4 failures in 2624 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 3

Platform and build breakdown:

• windows7-32-shippable-qr: 1
  • opt: 1
• linux1804-64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-05-23&endday=2022-05-29&tree=all

Comment 47

[Intermittent Failures Robot]

11 failures in 2917 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 9
  • debug: 9
• linux1804-64-tsan-qr: 1
  • opt: 1
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-05-30&endday=2022-06-05&tree=all

Comment 48

[Intermittent Failures Robot]

10 failures in 3336 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 4

Platform and build breakdown:

• linux1804-64-qr: 6
  • debug: 6
• linux1804-64-tsan-qr: 2
  • opt: 2
• windows7-32-qr: 1
  • opt: 1
• windows10-32-2004-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-06-06&endday=2022-06-12&tree=all

Comment 49

[Intermittent Failures Robot]

15 failures in 3170 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 12
• mozilla-central: 3

Platform and build breakdown:

• linux1804-64-qr: 9
  • debug: 9
• macosx1015-64-qr: 3
  • debug: 3
• linux1804-64-asan-qr: 1
  • opt: 1
• windows7-32-qr: 1
  • opt: 1
• windows7-32-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-06-13&endday=2022-06-19&tree=all

Comment 50

[Intermittent Failures Robot]

6 failures in 3075 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr102: 1
• mozilla-central: 1
• autoland: 4

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1
• windows7-32-shippable-qr: 1
  • opt: 1
• linux1804-64-qr: 2
  • debug: 2
• linux1804-64-tsan-qr: 1
  • opt: 1
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-06-20&endday=2022-06-26&tree=all

Comment 51

[Intermittent Failures Robot]

6 failures in 3312 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 5

Platform and build breakdown:

• linux1804-64-qr: 4
  • debug: 4
• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-06-27&endday=2022-07-03&tree=all

Comment 52

[Intermittent Failures Robot]

16 failures in 3072 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 5
• mozilla-beta: 3

Platform and build breakdown:

• linux1804-64-asan-qr: 2
  • opt: 2
• linux1804-64-qr: 10
  • debug: 9
  • opt: 1
• linux1804-64-ccov-qr: 2
  • opt: 2
• macosx1015-64-qr: 1
  • debug: 1
• windows7-32-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-07-04&endday=2022-07-10&tree=all

Comment 53

[Intermittent Failures Robot]

13 failures in 3341 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• mozilla-central: 3
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-qr: 5
  • debug: 5
• linux1804-64-tsan-qr: 3
  • opt: 3
• linux1804-64-ccov-qr: 2
  • opt: 2
• macosx1015-64-qr: 2
  • debug: 2
• windows10-32-2004-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-07-11&endday=2022-07-17&tree=all

Comment 54

[Intermittent Failures Robot]

6 failures in 3497 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-tsan-qr: 1
  • opt: 1
• linux1804-64-ccov-qr: 2
  • opt: 2
• linux1804-64-qr: 2
  • debug: 2
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-07-18&endday=2022-07-24&tree=all

Comment 55

[Intermittent Failures Robot]

8 failures in 3245 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8

Platform and build breakdown:

• macosx1015-64-qr: 2
  • debug: 2
• windows7-32-qr: 2
  • opt: 2
• linux1804-64-qr: 4
  • debug: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-07-25&endday=2022-07-31&tree=all

Comment 56

[Intermittent Failures Robot]

17 failures in 3057 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11
• try: 2
• mozilla-esr91: 1
• mozilla-central: 1
• mozilla-beta: 2

Platform and build breakdown:

• linux1804-64-qr: 11
  • debug: 11
• macosx1015-64-qr: 5
  • debug: 3
  • opt: 2
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-08-01&endday=2022-08-07&tree=all

Comment 57

[Intermittent Failures Robot]

14 failures in 3339 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 3
• mozilla-esr102: 1
• mozilla-beta: 2

Platform and build breakdown:

• macosx1015-64-qr: 3
  • opt: 1
  • debug: 2
• linux1804-64-asan-qr: 3
  • opt: 3
• linux1804-64-ccov-qr: 2
  • opt: 2
• linux1804-64-qr: 5
  • debug: 5
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-08-08&endday=2022-08-14&tree=all

Comment 58

[Intermittent Failures Robot]

7 failures in 2916 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 5

Platform and build breakdown:

• linux1804-64-qr: 4
  • debug: 4
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-ccov-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-08-15&endday=2022-08-21&tree=all

Comment 59

[Intermittent Failures Robot]

14 failures in 3293 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• mozilla-central: 4
• try: 1

Platform and build breakdown:

• linux1804-64-qr: 9
  • debug: 9
• linux1804-64-ccov-qr: 3
  • opt: 3
• linux1804-64-asan-qr: 1
  • opt: 1
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-08-22&endday=2022-08-28&tree=all

Comment 60

[Intermittent Failures Robot]

8 failures in 3537 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 2
• mozilla-beta: 1
• mozilla-release: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 2
  • opt: 2
• linux1804-64-ccov-qr: 2
  • opt: 2
• linux1804-64-qr: 1
  • debug: 1
• windows10-64-2004-qr: 1
  • opt: 1
• linux1804-64-tsan-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-08-29&endday=2022-09-04&tree=all

Comment 61

[Intermittent Failures Robot]

5 failures in 3616 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• autoland: 1

Platform and build breakdown:

• linux1804-64-qr: 3
  • debug: 3
• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-09-05&endday=2022-09-11&tree=all

Comment 62

[Intermittent Failures Robot]

8 failures in 3023 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 5

Platform and build breakdown:

• linux1804-64-ccov-qr: 3
  • opt: 3
• linux1804-64-qr: 4
  • debug: 4
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-09-12&endday=2022-09-18&tree=all

Comment 63

[Intermittent Failures Robot]

7 failures in 2909 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 4
  • debug: 4
• macosx1015-64-qr: 2
  • opt: 2
• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-09-19&endday=2022-09-25&tree=all

Comment 64

[Intermittent Failures Robot]

4 failures in 2041 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 1
• try: 1

Platform and build breakdown:

• linux1804-64-ccov-qr: 1
  • opt: 1
• linux1804-64-qr: 2
  • debug: 2
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-09-26&endday=2022-10-02&tree=all

Comment 65

[Intermittent Failures Robot]

14 failures in 2449 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 6
• try: 3

Platform and build breakdown:

• linux1804-64-qr: 13
  • debug: 13
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-10-03&endday=2022-10-09&tree=all

Comment 66

[Intermittent Failures Robot]

9 failures in 3034 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 5
• try: 1

Platform and build breakdown:

• linux1804-64-qr: 6
  • debug: 6
• linux1804-64-ccov-qr: 2
  • opt: 2
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-10-10&endday=2022-10-16&tree=all

Comment 67

[Intermittent Failures Robot]

9 failures in 2793 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 2
• try: 1

Platform and build breakdown:

• linux1804-64-qr: 9
  • debug: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-10-17&endday=2022-10-23&tree=all

Comment 68

[Intermittent Failures Robot]

8 failures in 3743 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• try: 1
• mozilla-beta: 2

Platform and build breakdown:

• linux1804-64-qr: 7
  • debug: 7
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-10-24&endday=2022-10-30&tree=all

Comment 69

[Intermittent Failures Robot]

5 failures in 3626 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 2
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-qr: 2
  • debug: 2
• linux1804-64-ccov-qr: 1
  • opt: 1
• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-10-31&endday=2022-11-06&tree=all

Comment 70

[Intermittent Failures Robot]

6 failures in 3445 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 3

Platform and build breakdown:

• linux1804-64-qr: 4
  • debug: 4
• linux1804-64-ccov-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-11-07&endday=2022-11-13&tree=all

Comment 71

[Intermittent Failures Robot]

8 failures in 3589 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2
• mozilla-central: 1
• autoland: 4
• try: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 2
  • opt: 2
• linux1804-64-qr: 5
  • debug: 5
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-11-14&endday=2022-11-20&tree=all

Comment 72

[Intermittent Failures Robot]

8 failures in 3888 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• try: 2
• autoland: 2
• mozilla-central: 3

Platform and build breakdown:

• linux1804-64-qr: 4
  • debug: 4
• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-ccov-qr: 2
  • opt: 2
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-11-21&endday=2022-11-27&tree=all

Comment 73

[Intermittent Failures Robot]

6 failures in 3938 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• mozilla-esr102: 1
• autoland: 3

Platform and build breakdown:

• linux1804-64-qr: 5
  • debug: 5
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-11-28&endday=2022-12-04&tree=all

Comment 74

[Intermittent Failures Robot]

6 failures in 3510 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 4

Platform and build breakdown:

• linux1804-64-qr: 5
  • debug: 5
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-12-05&endday=2022-12-11&tree=all

Comment 75

[Intermittent Failures Robot]

2 failures in 2999 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2022-12-19&endday=2022-12-25&tree=all

Comment 76

[Intermittent Failures Robot]

1 failures in 2607 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-01-02&endday=2023-01-08&tree=all

Comment 77

[Intermittent Failures Robot]

2 failures in 3717 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-release: 1

Platform and build breakdown:

• linux1804-64-tsan-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-01-16&endday=2023-01-22&tree=all

Comment 78

[Intermittent Failures Robot]

1 failures in 3914 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-01-23&endday=2023-01-29&tree=all

Comment 79

[Intermittent Failures Robot]

1 failures in 3606 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-01-30&endday=2023-02-05&tree=all

Comment 80

[Intermittent Failures Robot]

10 failures in 3766 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• comm-central: 10

Platform and build breakdown:

• windows10-64-2004-qr: 2
  • opt: 1
  • debug: 1
• macosx1015-64-qr: 2
  • opt: 2
• windows10-32-2004-qr: 3
  • opt: 2
  • debug: 1
• linux1804-64-shippable-qr: 1
  • opt: 1
• windows10-32-2004-shippable-qr: 1
  • opt: 1
• windows10-64-2004-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-02-06&endday=2023-02-12&tree=all

Comment 81

[Intermittent Failures Robot]

6 failures in 3856 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 4

Platform and build breakdown:

• macosx1015-64-shippable-qr: 2
  • opt: 2
• macosx1100-64-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-02-13&endday=2023-02-19&tree=all

Comment 82

[Intermittent Failures Robot]

13 failures in 3643 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 10

Platform and build breakdown:

• macosx1100-64-shippable-qr: 13
  • opt: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-02-20&endday=2023-02-26&tree=all

Comment 83

[Intermittent Failures Robot]

12 failures in 3752 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 4

Platform and build breakdown:

• macosx1100-64-shippable-qr: 9
  • opt: 9
• windows11-64-2009-qr: 1
  • opt: 1
• windows10-64-2004-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-02-27&endday=2023-03-05&tree=all

Comment 84

[Intermittent Failures Robot]

5 failures in 3966 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 2

Platform and build breakdown:

• macosx1100-64-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-03-06&endday=2023-03-12&tree=all

Comment 85

[Intermittent Failures Robot]

2 failures in 3761 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform and build breakdown:

• linux1804-64-ccov-qr: 1
  • opt: 1
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-03-13&endday=2023-03-19&tree=all

Comment 86

[Intermittent Failures Robot]

1 failures in 4161 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-03-20&endday=2023-03-26&tree=all

Comment 87

[Intermittent Failures Robot]

2 failures in 3386 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr102: 1
• autoland: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-04-03&endday=2023-04-09&tree=all

Comment 88

[Intermittent Failures Robot]

3 failures in 3206 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• try: 1

Platform and build breakdown:

• windows7-32-shippable-qr: 1
  • opt: 1
• linux1804-64-ccov-qr: 1
  • opt: 1
• linux1804-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-04-10&endday=2023-04-16&tree=all

Comment 89

[Intermittent Failures Robot]

3 failures in 4004 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr102: 1
• autoland: 1
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1
• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-04-17&endday=2023-04-23&tree=all

Comment 90

[Intermittent Failures Robot]

1 failures in 3177 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-04-24&endday=2023-04-30&tree=all

Comment 91

[Intermittent Failures Robot]

3 failures in 3411 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 1

Platform and build breakdown:

• linux1804-64-ccov-qr: 2
  • opt: 2
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-05-01&endday=2023-05-07&tree=all

Comment 92

[Intermittent Failures Robot]

1 failures in 4077 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-05-08&endday=2023-05-14&tree=all

Comment 93

[Intermittent Failures Robot]

1 failures in 3578 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1742677&startday=2023-05-15&endday=2023-05-21&tree=all

Comment 94

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.