1639850 - Intermittent testing/xpcshell/example/unit/[test_name] | application crashed [@ NS_DebugBreak]

Status: REOPENED

(Testing :: XPCShell Harness, defect, P3)

Description

[Treeherder Bug Filer]

Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=303215930&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/LU6-H2TqRX-43LetxIHn3w/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-05-21T10:50:39.260Z] 10:50:39 INFO - TEST-START | xpcshell-remote.ini:toolkit/components/extensions/test/xpcshell/test_ext_contentscript_exporthelpers.js
[task 2020-05-21T10:50:39.463Z] 10:50:39 INFO - mozcrash Saved minidump as Z:\task_1590056808\build\blobber_upload_dir\071f8da1-13db-4f02-8762-26577a04d1dc.dmp
[task 2020-05-21T10:50:39.463Z] 10:50:39 INFO - mozcrash Saved app info as Z:\task_1590056808\build\blobber_upload_dir\071f8da1-13db-4f02-8762-26577a04d1dc.extra
[task 2020-05-21T10:50:39.463Z] 10:50:39 WARNING - PROCESS-CRASH | testing/xpcshell/example/unit/test_do_check_matches_failing.js | application crashed [@ NS_DebugBreak(unsigned int, char const*, char const*, char const*, int)]
[task 2020-05-21T10:50:39.464Z] 10:50:39 INFO - Mozilla crash reason: MOZ_CRASH()
[task 2020-05-21T10:50:39.464Z] 10:50:39 INFO - Crash dump filename: c:\users\task_1590056808\appdata\local\temp\xpc-other-n53uqi\071f8da1-13db-4f02-8762-26577a04d1dc.dmp
[task 2020-05-21T10:50:39.464Z] 10:50:39 INFO - Operating system: Windows NT
[task 2020-05-21T10:50:39.464Z] 10:50:39 INFO - 10.0.17134
[task 2020-05-21T10:50:39.464Z] 10:50:39 INFO - CPU: amd64
[task 2020-05-21T10:50:39.465Z] 10:50:39 INFO - family 6 model 85 stepping 7
[task 2020-05-21T10:50:39.465Z] 10:50:39 INFO - 8 CPUs
[task 2020-05-21T10:50:39.465Z] 10:50:39 INFO - GPU: UNKNOWN
[task 2020-05-21T10:50:39.465Z] 10:50:39 INFO - Crash reason: EXCEPTION_BREAKPOINT
[task 2020-05-21T10:50:39.465Z] 10:50:39 INFO - Crash address: 0x32cc752a
[task 2020-05-21T10:50:39.465Z] 10:50:39 INFO - Process uptime: 4 seconds
[task 2020-05-21T10:50:39.465Z] 10:50:39 INFO - Thread 6 (crashed)
[task 2020-05-21T10:50:39.465Z] 10:50:39 INFO - 0 mozglue.dll!mozalloc_abort(char const* const) [mozalloc_abort.cpp:63e434e9fec084b475d7b6e57ee07e881ab8ad46 : 33 + 0x0]
[task 2020-05-21T10:50:39.465Z] 10:50:39 INFO - rax = 0x00007ff832d5de37 rdx = 0x00007ff84708a640
[task 2020-05-21T10:50:39.466Z] 10:50:39 INFO - rcx = 0x0000000000000000 rbx = 0x000000001c2c7500
[task 2020-05-21T10:50:39.466Z] 10:50:39 INFO - rsi = 0x0000002b844ff358 rdi = 0x00007ff846fb07b0
[task 2020-05-21T10:50:39.466Z] 10:50:39 INFO - rbp = 0x00007ff832c86200 rsp = 0x0000002b844ff2c0
[task 2020-05-21T10:50:39.466Z] 10:50:39 INFO - r8 = 0x0000002b844fd4a8 r9 = 0x00007ff80a6524a0
[task 2020-05-21T10:50:39.466Z] 10:50:39 INFO - r10 = 0x0000000000000000 r11 = 0x0000002b844ff170
[task 2020-05-21T10:50:39.466Z] 10:50:39 INFO - r12 = 0x00007ff80a59c9ac r13 = 0x00007ff80a606528
[task 2020-05-21T10:50:39.466Z] 10:50:39 INFO - r14 = 0x0000000000000001 r15 = 0x0000002b844ff560
[task 2020-05-21T10:50:39.466Z] 10:50:39 INFO - rip = 0x00007ff832cc752a
[task 2020-05-21T10:50:39.467Z] 10:50:39 INFO - Found by: given as instruction pointer in context
[task 2020-05-21T10:50:39.467Z] 10:50:39 INFO - 1 xul.dll!NS_DebugBreak(unsigned int, char const*, char const*, char const*, int) [nsDebugImpl.cpp:63e434e9fec084b475d7b6e57ee07e881ab8ad46 : 0 + 0x29]
[task 2020-05-21T10:50:39.467Z] 10:50:39 INFO - rbx = 0x000000001c2c7500 rbp = 0x00007ff832c86200
[task 2020-05-21T10:50:39.467Z] 10:50:39 INFO - rsp = 0x0000002b844ff300 r12 = 0x00007ff80a59c9ac
[task 2020-05-21T10:50:39.467Z] 10:50:39 INFO - r13 = 0x00007ff80a606528 r14 = 0x0000000000000001
[task 2020-05-21T10:50:39.467Z] 10:50:39 INFO - r15 = 0x0000002b844ff560 rip = 0x00007ff801b9d1a8
[task 2020-05-21T10:50:39.467Z] 10:50:39 INFO - Found by: call frame info
[task 2020-05-21T10:50:39.467Z] 10:50:39 INFO - 2 xul.dll!NS_DispatchToMainThread(already_AddRefed<nsIRunnable>&&, unsigned int) [nsThreadUtils.cpp:63e434e9fec084b475d7b6e57ee07e881ab8ad46 : 255 + 0x23]
[task 2020-05-21T10:50:39.467Z] 10:50:39 INFO - rbx = 0x000000001c2c7500 rbp = 0x00007ff832c86200
[task 2020-05-21T10:50:39.468Z] 10:50:39 INFO - rsp = 0x0000002b844ff7a0 r12 = 0x00007ff80a59c9ac
[task 2020-05-21T10:50:39.468Z] 10:50:39 INFO - r13 = 0x00007ff80a606528 r14 = 0x0000000000000001
[task 2020-05-21T10:50:39.468Z] 10:50:39 INFO - r15 = 0x0000002b844ff560 rip = 0x00007ff801ccbedc
[task 2020-05-21T10:50:39.468Z] 10:50:39 INFO - Found by: call frame info
[task 2020-05-21T10:50:39.468Z] 10:50:39 INFO - 3 xul.dll!static mozilla::SchedulerGroup::LabeledDispatch(mozilla::TaskCategory, already_AddRefed<nsIRunnable>&&, mozilla::dom::DocGroup*) [SchedulerGroup.cpp:63e434e9fec084b475d7b6e57ee07e881ab8ad46 : 85 + 0x2a]
[task 2020-05-21T10:50:39.468Z] 10:50:39 INFO - rbx = 0x000000001c2c7500 rbp = 0x00007ff832c86200
[task 2020-05-21T10:50:39.468Z] 10:50:39 INFO - rsp = 0x0000002b844ff810 r12 = 0x00007ff80a59c9ac
[task 2020-05-21T10:50:39.468Z] 10:50:39 INFO - r13 = 0x00007ff80a606528 r14 = 0x0000000000000001
[task 2020-05-21T10:50:39.468Z] 10:50:39 INFO - r15 = 0x0000002b844ff560 rip = 0x00007ff801cb7b1b
[task 2020-05-21T10:50:39.469Z] 10:50:39 INFO - Found by: call frame info
[task 2020-05-21T10:50:39.469Z] 10:50:39 INFO - 4 xul.dll!static nsThread::ThreadFunc(void*) [nsThread.cpp:63e434e9fec084b475d7b6e57ee07e881ab8ad46 : 481 + 0xa]
[task 2020-05-21T10:50:39.469Z] 10:50:39 INFO - rbx = 0x000000001c2c7500 rbp = 0x00007ff832c86200
[task 2020-05-21T10:50:39.469Z] 10:50:39 INFO - rsp = 0x0000002b844ff860 r12 = 0x00007ff80a59c9ac
[task 2020-05-21T10:50:39.470Z] 10:50:39 INFO - r13 = 0x00007ff80a606528 r14 = 0x0000000000000001
[task 2020-05-21T10:50:39.470Z] 10:50:39 INFO - r15 = 0x0000002b844ff560 rip = 0x00007ff801cce88d
[task 2020-05-21T10:50:39.470Z] 10:50:39 INFO - Found by: call frame info
[task 2020-05-21T10:50:39.470Z] 10:50:39 INFO - 5 nss3.dll!PR_NativeRunThread(void*) [pruthr.c:63e434e9fec084b475d7b6e57ee07e881ab8ad46 : 399 + 0x7]
[task 2020-05-21T10:50:39.470Z] 10:50:39 INFO - rbx = 0x000000001c2c7500 rbp = 0x00007ff832c86200
[task 2020-05-21T10:50:39.471Z] 10:50:39 INFO - rsp = 0x0000002b844ffa30 r12 = 0x00007ff80a59c9ac
[task 2020-05-21T10:50:39.471Z] 10:50:39 INFO - r13 = 0x00007ff80a606528 r14 = 0x0000000000000001
[task 2020-05-21T10:50:39.471Z] 10:50:39 INFO - r15 = 0x0000002b844ff560 rip = 0x00007ff832aecf3b
[task 2020-05-21T10:50:39.471Z] 10:50:39 INFO - Found by: call frame info
[task 2020-05-21T10:50:39.471Z] 10:50:39 INFO - 6 nss3.dll!pr_root(void*) [w95thred.c:63e434e9fec084b475d7b6e57ee07e881ab8ad46 : 139 + 0x6]
[task 2020-05-21T10:50:39.471Z] 10:50:39 INFO - rbx = 0x000000001c2c7500 rbp = 0x00007ff832c86200
[task 2020-05-21T10:50:39.471Z] 10:50:39 INFO - rsp = 0x0000002b844ffab0 r12 = 0x00007ff80a59c9ac
[task 2020-05-21T10:50:39.471Z] 10:50:39 INFO - r13 = 0x00007ff80a606528 r14 = 0x0000000000000001
[task 2020-05-21T10:50:39.472Z] 10:50:39 INFO - r15 = 0x0000002b844ff560 rip = 0x00007ff832add8aa
[task 2020-05-21T10:50:39.472Z] 10:50:39 INFO - Found by: call frame info
[task 2020-05-21T10:50:39.472Z] 10:50:39 INFO - 7 ucrtbase.dll!RtlpHpSegPageRangeShrink + 0xda
[task 2020-05-21T10:50:39.472Z] 10:50:39 INFO - rbx = 0x000000001c2c7500 rbp = 0x00007ff832c86200
[task 2020-05-21T10:50:39.472Z] 10:50:39 INFO - rsp = 0x0000002b844ffae0 r12 = 0x00007ff80a59c9ac
[task 2020-05-21T10:50:39.472Z] 10:50:39 INFO - r13 = 0x00007ff80a606528 r14 = 0x0000000000000001
[task 2020-05-21T10:50:39.472Z] 10:50:39 INFO - r15 = 0x0000002b844ff560 rip = 0x00007ff846fbc4be
[task 2020-05-21T10:50:39.472Z] 10:50:39 INFO - Found by: call frame info

Comment 2

[Geoff Brown [:gbrown] (pto Apr 11-18)]

:florian -- Any chance this is related to bug 1637637?

https://searchfox.org/mozilla-central/rev/a40ef31fc9af34a99ceda6d65cdc4573d52b83d2/xpcom/threads/nsThreadUtils.cpp#255

Comment 3

[Intermittent Failures Robot]

2 failures in 4727 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• comm-central: 2

Platform breakdown:

• windows10-64: 1
• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1639850&startday=2020-05-18&endday=2020-05-24&tree=all

Comment 4

[Florian Quèze [:florian]]

(In reply to Geoff Brown [:gbrown] from comment #2)

:florian -- Any chance this is related to bug 1637637?

Seems very unlikely, this failure was on a "test-windows10-64/debug-xpcshell-e10s-1" job, ie. debug, and my fast shutdown doesn't apply to debug builds.

The failures in comment 3 are unrelated/misclassified.

Comment 7

[Intermittent Failures Robot]

8 failures in 5458 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8

Platform breakdown:

• windows10-64: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1639850&startday=2020-05-25&endday=2020-05-31&tree=all

Comment 8

[Intermittent Failures Robot]

7 failures in 4949 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 1

Platform breakdown:

• windows10-64: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1639850&startday=2020-06-01&endday=2020-06-07&tree=all

Comment 9

[Intermittent Failures Robot]

4 failures in 5252 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform breakdown:

• windows10-64: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1639850&startday=2020-06-22&endday=2020-06-28&tree=all

Comment 10

[Intermittent Failures Robot]

3 failures in 5265 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr78: 2
• autoland: 1

Platform breakdown:

• windows10-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1639850&startday=2020-07-06&endday=2020-07-12&tree=all

Comment 11

[Intermittent Failures Robot]

3 failures in 4014 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• windows10-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1639850&startday=2020-07-13&endday=2020-07-19&tree=all

Comment 12

[Intermittent Failures Robot]

3 failures in 3601 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• comm-central: 2

Platform breakdown:

• windows10-64: 2
• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1639850&startday=2020-08-10&endday=2020-08-16&tree=all

Comment 13

[Intermittent Failures Robot]

2 failures in 4100 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• windows10-64: 1
• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1639850&startday=2020-08-17&endday=2020-08-23&tree=all

Comment 14

[Intermittent Failures Robot]

1 failures in 4046 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1639850&startday=2020-08-24&endday=2020-08-30&tree=all

Comment 15

[Intermittent Failures Robot]

1 failures in 4195 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr78: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1639850&startday=2020-09-28&endday=2020-10-04&tree=all

Comment 16

[Intermittent Failures Robot]

1 failures in 3421 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr78: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2020-12-14&endday=2020-12-20&tree=all

Comment 17

[Intermittent Failures Robot]

4 failures in 3891 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform and build breakdown:

• windows10-64: 4
  • debug: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-01-25&endday=2021-01-31&tree=all

Comment 18

[Intermittent Failures Robot]

2 failures in 3966 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform and build breakdown:

• windows10-64: 1
  • debug: 1
• windows7-32: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-02-01&endday=2021-02-07&tree=all

Comment 19

[Intermittent Failures Robot]

3 failures in 4322 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 1

Platform and build breakdown:

• windows10-64: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-02-08&endday=2021-02-14&tree=all

Comment 20

[Intermittent Failures Robot]

1 failures in 3737 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows10-64: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-02-15&endday=2021-02-21&tree=all

Comment 21

[Intermittent Failures Robot]

2 failures in 4622 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform and build breakdown:

• windows10-64: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-03-08&endday=2021-03-14&tree=all

Comment 22

[Intermittent Failures Robot]

2 failures in 3125 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr78: 1
• autoland: 1

Platform and build breakdown:

• windows10-64: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-03-29&endday=2021-04-04&tree=all

Comment 23

[Intermittent Failures Robot]

7 failures in 3061 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 1

Platform and build breakdown:

• windows10-64: 2
  • debug: 2
• windows7-32: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-05-17&endday=2021-05-23&tree=all

Comment 24

[Intermittent Failures Robot]

20 failures in 2908 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 15
• mozilla-central: 3
• try: 1
• comm-central: 1

Platform and build breakdown:

• windows10-64: 10
  • debug: 10
• windows10-32: 10
  • debug: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-05-24&endday=2021-05-30&tree=all

Comment 25

[Geoff Brown [:gbrown] (pto Apr 11-18)]

(In reply to Intermittent Failures Robot from comment #24)

20 failures in 2908 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

These stopped after the recent backout in bug 1708125.

Comment 26

[Intermittent Failures Robot]

25 failures in 3065 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 17
• mozilla-central: 6
• comm-central: 1
• try: 1

Platform and build breakdown:

• windows10-32: 11
  • debug: 11
• windows10-64: 14
  • debug: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-05-31&endday=2021-06-06&tree=all

Comment 27

[Intermittent Failures Robot]

19 failures in 3502 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 13
• mozilla-central: 6

Platform and build breakdown:

• windows10-32: 10
  • debug: 10
• windows10-64: 9
  • debug: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-06-07&endday=2021-06-13&tree=all

Comment 28

[Natalia Csoregi [:nataliaCs]]

Update:

There have been 31 failures within the last 7 days:

• 8 failures on Windows 10 x64 debug
• 23 failures on Windows 10 x86 debug

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=343261520&repo=mozilla-central&lineNumber=4867

[task 2021-06-19T09:15:41.303Z] 09:15:41     INFO -  TEST-START | xpcshell-e10s.ini:toolkit/components/extensions/test/xpcshell/test_ext_shadowdom.js
[task 2021-06-19T09:15:41.577Z] 09:15:41     INFO -  TEST-PASS | toolkit/components/backgroundtasks/tests/xpcshell/test_backgroundtask_specific_pref.js | took 16984ms
[task 2021-06-19T09:15:42.244Z] 09:15:42     INFO -  TEST-START | xpcshell-e10s.ini:toolkit/components/extensions/test/xpcshell/test_ext_web_accessible_resources.js
[task 2021-06-19T09:15:44.833Z] 09:15:44  WARNING -  PROCESS-CRASH | testing/xpcshell/example/unit/test_do_check_null_failing.js | application crashed [@ NS_DebugBreak(unsigned int, char const*, char const*, char const*, int)]
[task 2021-06-19T09:15:44.833Z] 09:15:44     INFO -  Mozilla crash reason: MOZ_CRASH()
[task 2021-06-19T09:15:44.833Z] 09:15:44     INFO -  Crash dump filename: C:\Users\task_1624093585\AppData\Local\Temp\xpc-other-dydaoxg4\89bb4fcd-0717-4ce1-916f-fb0db406d284.dmp
[task 2021-06-19T09:15:44.833Z] 09:15:44     INFO -  Operating system: Windows NT
[task 2021-06-19T09:15:44.833Z] 09:15:44     INFO -                    10.0.17134
[task 2021-06-19T09:15:44.833Z] 09:15:44     INFO -  CPU: amd64
[task 2021-06-19T09:15:44.833Z] 09:15:44     INFO -       family 6 model 85 stepping 7
[task 2021-06-19T09:15:44.834Z] 09:15:44     INFO -       8 CPUs
[task 2021-06-19T09:15:44.834Z] 09:15:44     INFO -  GPU: UNKNOWN
[task 2021-06-19T09:15:44.834Z] 09:15:44     INFO -  Crash reason:  EXCEPTION_BREAKPOINT
[task 2021-06-19T09:15:44.834Z] 09:15:44     INFO -  Crash address: 0xf48d7b7a
[task 2021-06-19T09:15:44.834Z] 09:15:44     INFO -  Process uptime: 3 seconds
[task 2021-06-19T09:15:44.834Z] 09:15:44     INFO -  Thread 19 (crashed)
[task 2021-06-19T09:15:44.834Z] 09:15:44     INFO -   0  mozglue.dll!mozalloc_abort(char const* const) [mozalloc_abort.cpp:668013f3e2015d408903d31f55d2ffdd08137bfd : 33 + 0x0]
[task 2021-06-19T09:15:44.835Z] 09:15:44     INFO -      rax = 0x00007ffbf4987e2b   rdx = 0x0000000000000000
[task 2021-06-19T09:15:44.835Z] 09:15:44     INFO -      rcx = 0x0000000000000000   rbx = 0x0000000023e78300
[task 2021-06-19T09:15:44.835Z] 09:15:44     INFO -      rsi = 0x0000009f3e60ea18   rdi = 0x00007ffc09b907b0
[task 2021-06-19T09:15:44.835Z] 09:15:44     INFO -      rbp = 0x0000000000000000   rsp = 0x0000009f3e60e980
[task 2021-06-19T09:15:44.835Z] 09:15:44     INFO -       r8 = 0x0000009f3e60fb60    r9 = 0x0000000000000021
[task 2021-06-19T09:15:44.835Z] 09:15:44     INFO -      r10 = 0x0000009f3e60fb10   r11 = 0x00007ffc0d150000
[task 2021-06-19T09:15:44.836Z] 09:15:44     INFO -      r12 = 0x00007ffbd0dc68bc   r13 = 0x0000009f3e60f2f8
[task 2021-06-19T09:15:44.836Z] 09:15:44     INFO -      r14 = 0x0000000000000001   r15 = 0x0000009f3e60ed28
[task 2021-06-19T09:15:44.836Z] 09:15:44     INFO -      rip = 0x00007ffbf48d7b7a
[task 2021-06-19T09:15:44.836Z] 09:15:44     INFO -      Found by: given as instruction pointer in context
[task 2021-06-19T09:15:44.836Z] 09:15:44     INFO -   1  xul.dll!NS_DebugBreak(unsigned int, char const*, char const*, char const*, int) [nsDebugImpl.cpp:668013f3e2015d408903d31f55d2ffdd08137bfd : 398 + 0x52]
[task 2021-06-19T09:15:44.836Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.836Z] 09:15:44     INFO -      rsp = 0x0000009f3e60e9c0   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.837Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.837Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffbc7fda8b7
[task 2021-06-19T09:15:44.837Z] 09:15:44     INFO -      Found by: call frame info
[task 2021-06-19T09:15:44.838Z] 09:15:44     INFO -   2  xul.dll!mozilla::ThreadEventTarget::Dispatch(already_AddRefed<nsIRunnable>, unsigned int) [ThreadEventTarget.cpp:668013f3e2015d408903d31f55d2ffdd08137bfd : 59 + 0x27]
[task 2021-06-19T09:15:44.838Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.838Z] 09:15:44     INFO -      rsp = 0x0000009f3e60f070   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.838Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.838Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffbc811ea1e
[task 2021-06-19T09:15:44.839Z] 09:15:44     INFO -      Found by: call frame info
[task 2021-06-19T09:15:44.839Z] 09:15:44     INFO -   3  xul.dll!nsThread::Dispatch(already_AddRefed<nsIRunnable>, unsigned int) [nsThread.cpp:668013f3e2015d408903d31f55d2ffdd08137bfd : 654 + 0x8]
[task 2021-06-19T09:15:44.839Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.839Z] 09:15:44     INFO -      rsp = 0x0000009f3e60f0f0   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.839Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.839Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffbc8129b68
[task 2021-06-19T09:15:44.839Z] 09:15:44     INFO -      Found by: call frame info
[task 2021-06-19T09:15:44.839Z] 09:15:44     INFO -   4  xul.dll!nsIEventTarget::Dispatch(nsIRunnable*, unsigned int) [nsIEventTarget.h: : 41 + 0x18]
[task 2021-06-19T09:15:44.839Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.839Z] 09:15:44     INFO -      rsp = 0x0000009f3e60f150   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.839Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.840Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffbc80918c5
[task 2021-06-19T09:15:44.840Z] 09:15:44     INFO -      Found by: call frame info
[task 2021-06-19T09:15:44.840Z] 09:15:44     INFO -   5  xul.dll!mozilla::detail::RunnableFunction<`lambda at /builds/worker/checkouts/gecko/ipc/glue/IdleSchedulerParent.cpp:58:51'>::Run() [nsThreadUtils.h:668013f3e2015d408903d31f55d2ffdd08137bfd : 534 + 0x155]
[task 2021-06-19T09:15:44.840Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.840Z] 09:15:44     INFO -      rsp = 0x0000009f3e60f1b0   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.840Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.841Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffbc8a19f61
[task 2021-06-19T09:15:44.841Z] 09:15:44     INFO -      Found by: call frame info
[task 2021-06-19T09:15:44.841Z] 09:15:44     INFO -   6  xul.dll!nsThreadPool::Run() [nsThreadPool.cpp:668013f3e2015d408903d31f55d2ffdd08137bfd : 303 + 0xd]
[task 2021-06-19T09:15:44.841Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.841Z] 09:15:44     INFO -      rsp = 0x0000009f3e60f250   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.842Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.842Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffbc8135d29
[task 2021-06-19T09:15:44.843Z] 09:15:44     INFO -      Found by: call frame info
[task 2021-06-19T09:15:44.843Z] 09:15:44     INFO -   7  xul.dll!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:668013f3e2015d408903d31f55d2ffdd08137bfd : 1146 + 0xd]
[task 2021-06-19T09:15:44.843Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.843Z] 09:15:44     INFO -      rsp = 0x0000009f3e60f460   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.843Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.843Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffbc812bdac
[task 2021-06-19T09:15:44.844Z] 09:15:44     INFO -      Found by: call frame info
[task 2021-06-19T09:15:44.844Z] 09:15:44     INFO -   8  xul.dll!NS_ProcessNextEvent(nsIThread*, bool) [nsThreadUtils.cpp:668013f3e2015d408903d31f55d2ffdd08137bfd : 548 + 0x14]
[task 2021-06-19T09:15:44.844Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.844Z] 09:15:44     INFO -      rsp = 0x0000009f3e60f640   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.844Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.844Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffbc81334d2
[task 2021-06-19T09:15:44.844Z] 09:15:44     INFO -      Found by: call frame info
[task 2021-06-19T09:15:44.844Z] 09:15:44     INFO -   9  xul.dll!mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) [MessagePump.cpp:668013f3e2015d408903d31f55d2ffdd08137bfd : 300 + 0xa]
[task 2021-06-19T09:15:44.844Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.844Z] 09:15:44     INFO -      rsp = 0x0000009f3e60f690   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.844Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.844Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffbc8a0e567
[task 2021-06-19T09:15:44.845Z] 09:15:44     INFO -      Found by: call frame info
[task 2021-06-19T09:15:44.845Z] 09:15:44     INFO -  10  xul.dll!MessageLoop::RunHandler() [message_loop.cc:668013f3e2015d408903d31f55d2ffdd08137bfd : 324 + 0x8]
[task 2021-06-19T09:15:44.845Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.845Z] 09:15:44     INFO -      rsp = 0x0000009f3e60f700   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.846Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.846Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffbc89a2d20
[task 2021-06-19T09:15:44.846Z] 09:15:44     INFO -      Found by: call frame info
[task 2021-06-19T09:15:44.846Z] 09:15:44     INFO -  11  xul.dll!MessageLoop::Run() [message_loop.cc:668013f3e2015d408903d31f55d2ffdd08137bfd : 306 + 0x5]
[task 2021-06-19T09:15:44.846Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.846Z] 09:15:44     INFO -      rsp = 0x0000009f3e60f750   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.846Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.847Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffbc89a2bdd
[task 2021-06-19T09:15:44.847Z] 09:15:44     INFO -      Found by: call frame info
[task 2021-06-19T09:15:44.847Z] 09:15:44     INFO -  12  xul.dll!static nsThread::ThreadFunc(void*) [nsThread.cpp:668013f3e2015d408903d31f55d2ffdd08137bfd : 392 + 0x8]
[task 2021-06-19T09:15:44.847Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.847Z] 09:15:44     INFO -      rsp = 0x0000009f3e60f7a0   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.848Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.849Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffbc8128137
[task 2021-06-19T09:15:44.849Z] 09:15:44     INFO -      Found by: call frame info
[task 2021-06-19T09:15:44.849Z] 09:15:44     INFO -  13  nss3.dll!PR_NativeRunThread(void*) [pruthr.c:668013f3e2015d408903d31f55d2ffdd08137bfd : 399 + 0xe]
[task 2021-06-19T09:15:44.850Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.850Z] 09:15:44     INFO -      rsp = 0x0000009f3e60f990   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.850Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.850Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffbf4b15b62
[task 2021-06-19T09:15:44.850Z] 09:15:44     INFO -      Found by: call frame info
[task 2021-06-19T09:15:44.850Z] 09:15:44     INFO -  14  nss3.dll!pr_root(void*) [w95thred.c:668013f3e2015d408903d31f55d2ffdd08137bfd : 139 + 0xd]
[task 2021-06-19T09:15:44.850Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.850Z] 09:15:44     INFO -      rsp = 0x0000009f3e60fa10   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.850Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.851Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffbf4b06541
[task 2021-06-19T09:15:44.851Z] 09:15:44     INFO -      Found by: call frame info
[task 2021-06-19T09:15:44.851Z] 09:15:44     INFO -  15  ucrtbase.dll!RtlpHpSegPageRangeShrink + 0xda
[task 2021-06-19T09:15:44.851Z] 09:15:44     INFO -      rbx = 0x0000000023e78300   rbp = 0x0000000000000000
[task 2021-06-19T09:15:44.851Z] 09:15:44     INFO -      rsp = 0x0000009f3e60fa40   r12 = 0x00007ffbd0dc68bc
[task 2021-06-19T09:15:44.851Z] 09:15:44     INFO -      r13 = 0x0000009f3e60f2f8   r14 = 0x0000000000000001
[task 2021-06-19T09:15:44.851Z] 09:15:44     INFO -      r15 = 0x0000009f3e60ed28   rip = 0x00007ffc09b9c4be
[task 2021-06-19T09:15:44.852Z] 09:15:44     INFO -      Found by: call frame info

Comment 29

[Natalia Csoregi [:nataliaCs]]

Joel, as the owner of this component could you assign this to someone?
Thank you.

Comment 30

[Intermittent Failures Robot]

28 failures in 2888 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 21
• comm-central: 1
• mozilla-central: 6

Platform and build breakdown:

• windows10-32: 19
  • debug: 19
• windows7-32: 1
  • debug: 1
• windows10-64: 8
  • debug: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-06-14&endday=2021-06-20&tree=all

Comment 31

[Joel Maher ( :jmaher ) (UTC -8)]

I looked into this, it appears to be failing about 10% of the time on windows/debug (windows7 == windows10 w/32bit firefox). I even went back a few days from when this was increasing and it seems to follow the 10% rule- so finding a root cause patch that caused this doesn't seem straightforward.

We are in the process of updating windows10 from version 1803 -> 2004; I doubt this will change much, but maybe something will help. I don't like to kick the can down the road, but this isn't a straightforward fix from my skillset.

Comment 32

[Intermittent Failures Robot]

36 failures in 3115 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 12
• autoland: 22
• try: 2

Platform and build breakdown:

• windows10-64: 13
  • debug: 13
• windows10-32-qr: 23
  • debug: 23

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-06-21&endday=2021-06-27&tree=all

Comment 33

[Intermittent Failures Robot]

17 failures in 723 pushes (0.024 failures/push) were associated with this bug in the last 7 days.

This is the #47 most frequent failure this week.

Repository breakdown:

• mozilla-central: 5
• autoland: 12

Platform and build breakdown:

• windows10-64: 5
  • debug: 5
• windows10-32-qr: 12
  • debug: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-06-28&endday=2021-07-04&tree=all

Comment 34

[Alexandru Michis [:malexandru]]

There have been 49 total failures in the last 7 days (recent failure log).
Affected platforms are:

• windows10-64-qr debug & windows10-64 debug
• windows10-32-qr debug

Comment 35

[Intermittent Failures Robot]

68 failures in 2387 pushes (0.028 failures/push) were associated with this bug in the last 7 days.

This is the #10 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 40
• try: 1
• mozilla-central: 27

Platform and build breakdown:

• windows10-32-qr: 30
  • debug: 30
• windows10-64: 10
  • debug: 10
• windows10-64-qr: 28
  • debug: 28

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-07-05&endday=2021-07-11&tree=all

Comment 36

[Geoff Brown [:gbrown] (pto Apr 11-18)]

These are assertion failures at
https://searchfox.org/mozilla-central/rev/04b41051dd2b08df2a06f86f8bf9230c0848fc51/xpcom/threads/ThreadEventTarget.cpp#59
happening on windows/debug only.

It looks like the affected tests are particularly short (fast executing) tests: Is a thread started at the start of an xpcshell test that sometimes isn't dispatched until after shutdown starts?

Comment 38

[Iulian Moraru]

Update:
There have been 46 failures within the last 7 days:
• 27 failures on Windows 10 x64 WebRender debug
• 19 failures on Windows 10 x86 WebRender debug
Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=345540296&repo=mozilla-central&lineNumber=5215

[task 2021-07-18T09:47:55.271Z] 09:47:55     INFO -  TEST-START | xpcshell.ini:toolkit/components/extensions/test/xpcshell/test_ext_manifest_incognito.js
[task 2021-07-18T09:47:55.412Z] 09:47:55     INFO -  TEST-PASS | xpcshell.ini:toolkit/components/extensions/test/xpcshell/test_csp_validator.js | took 1313ms
[task 2021-07-18T09:47:55.433Z] 09:47:55  WARNING -  PROCESS-CRASH | testing/xpcshell/example/unit/test_check_nsIException_failing.js | application crashed [@ NS_DebugBreak(unsigned int, char const*, char const*, char const*, int)]
[task 2021-07-18T09:47:55.433Z] 09:47:55     INFO -  Mozilla crash reason: MOZ_CRASH()
[task 2021-07-18T09:47:55.433Z] 09:47:55     INFO -  Crash dump filename: C:\Users\task_1626601107\AppData\Local\Temp\xpc-other-9wcnslfx\d2bcc895-8fc3-469e-bd05-0805dc3059da.dmp
[task 2021-07-18T09:47:55.434Z] 09:47:55     INFO -  Operating system: Windows NT
[task 2021-07-18T09:47:55.435Z] 09:47:55     INFO -                    10.0.17134
[task 2021-07-18T09:47:55.435Z] 09:47:55     INFO -  CPU: amd64
[task 2021-07-18T09:47:55.435Z] 09:47:55     INFO -       family 6 model 85 stepping 7
[task 2021-07-18T09:47:55.435Z] 09:47:55     INFO -       8 CPUs
[task 2021-07-18T09:47:55.435Z] 09:47:55     INFO -  GPU: UNKNOWN
[task 2021-07-18T09:47:55.435Z] 09:47:55     INFO -  Crash reason:  EXCEPTION_BREAKPOINT
[task 2021-07-18T09:47:55.436Z] 09:47:55     INFO -  Crash address: 0xc0ce7b7a
[task 2021-07-18T09:47:55.436Z] 09:47:55     INFO -  Process uptime: 2 seconds
[task 2021-07-18T09:47:55.436Z] 09:47:55     INFO -  Thread 20 (crashed) - BgIOThreadPool #1 0  mozglue.dll!mozalloc_abort(char const* const) [mozalloc_abort.cpp:cc4e5ea0c9863a8c4f65a49cd51852f7f38dd2fe : 33 + 0x0]
[task 2021-07-18T09:47:55.436Z] 09:47:55     INFO -      rax = 0x00007fffc0d9ae2b   rdx = 0x0000000000000000
[task 2021-07-18T09:47:55.436Z] 09:47:55     INFO -      rcx = 0x0000000000000000   rbx = 0x00000000aaee3300
[task 2021-07-18T09:47:55.436Z] 09:47:55     INFO -      rsi = 0x000000d9e9bbeb98   rdi = 0x00007fffd61307b0
[task 2021-07-18T09:47:55.436Z] 09:47:55     INFO -      rbp = 0x0000000000000000   rsp = 0x000000d9e9bbeb00
[task 2021-07-18T09:47:55.436Z] 09:47:55     INFO -       r8 = 0x000000d9e9bbfce0    r9 = 0x0000000000000021
[task 2021-07-18T09:47:55.436Z] 09:47:55     INFO -      r10 = 0x000000d9e9bbfc90   r11 = 0x00007fffd9c80000
[task 2021-07-18T09:47:55.438Z] 09:47:55     INFO -      r12 = 0x00007fff9e07d8bc   r13 = 0x000000d9e9bbf478
[task 2021-07-18T09:47:55.438Z] 09:47:55     INFO -      r14 = 0x0000000000000001   r15 = 0x000000d9e9bbeea8
[task 2021-07-18T09:47:55.438Z] 09:47:55     INFO -      rip = 0x00007fffc0ce7b7a
[task 2021-07-18T09:47:55.438Z] 09:47:55     INFO -      Found by: given as instruction pointer in context
[task 2021-07-18T09:47:55.439Z] 09:47:55     INFO -   1  xul.dll!NS_DebugBreak(unsigned int, char const*, char const*, char const*, int) [nsDebugImpl.cpp:cc4e5ea0c9863a8c4f65a49cd51852f7f38dd2fe : 398 + 0x52]
[task 2021-07-18T09:47:55.439Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.439Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbeb40   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.439Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.439Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fff953a2817
[task 2021-07-18T09:47:55.439Z] 09:47:55     INFO -      Found by: call frame info
[task 2021-07-18T09:47:55.440Z] 09:47:55     INFO -   2  xul.dll!mozilla::ThreadEventTarget::Dispatch(already_AddRefed<nsIRunnable>, unsigned int) [ThreadEventTarget.cpp:cc4e5ea0c9863a8c4f65a49cd51852f7f38dd2fe : 59 + 0x27]
[task 2021-07-18T09:47:55.440Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.440Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbf1f0   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.440Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.440Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fff954e8fae
[task 2021-07-18T09:47:55.441Z] 09:47:55     INFO -      Found by: call frame info
[task 2021-07-18T09:47:55.441Z] 09:47:55     INFO -   3  xul.dll!nsThread::Dispatch(already_AddRefed<nsIRunnable>, unsigned int) [nsThread.cpp:cc4e5ea0c9863a8c4f65a49cd51852f7f38dd2fe : 650 + 0x8]
[task 2021-07-18T09:47:55.441Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.441Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbf270   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.441Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.441Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fff954f41f8
[task 2021-07-18T09:47:55.441Z] 09:47:55     INFO -      Found by: call frame info
[task 2021-07-18T09:47:55.442Z] 09:47:55     INFO -   4  xul.dll!nsIEventTarget::Dispatch(nsIRunnable*, unsigned int) [nsIEventTarget.h: : 41 + 0x18]
[task 2021-07-18T09:47:55.442Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.442Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbf2d0   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.442Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.442Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fff9545bff5
[task 2021-07-18T09:47:55.442Z] 09:47:55     INFO -      Found by: call frame info
[task 2021-07-18T09:47:55.443Z] 09:47:55     INFO -   5  xul.dll!mozilla::detail::RunnableFunction<`lambda at /builds/worker/checkouts/gecko/ipc/glue/IdleSchedulerParent.cpp:58:51'>::Run() [nsThreadUtils.h:cc4e5ea0c9863a8c4f65a49cd51852f7f38dd2fe : 532 + 0x155]
[task 2021-07-18T09:47:55.443Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.443Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbf330   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.444Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.444Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fff95e01b41
[task 2021-07-18T09:47:55.444Z] 09:47:55     INFO -      Found by: call frame info
[task 2021-07-18T09:47:55.444Z] 09:47:55     INFO -   6  xul.dll!nsThreadPool::Run() [nsThreadPool.cpp:cc4e5ea0c9863a8c4f65a49cd51852f7f38dd2fe : 303 + 0xd]
[task 2021-07-18T09:47:55.445Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.445Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbf3d0   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.445Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.445Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fff95500099
[task 2021-07-18T09:47:55.446Z] 09:47:55     INFO -      Found by: call frame info
[task 2021-07-18T09:47:55.446Z] 09:47:55     INFO -   7  xul.dll!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:cc4e5ea0c9863a8c4f65a49cd51852f7f38dd2fe : 1142 + 0xd]
[task 2021-07-18T09:47:55.446Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.447Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbf5e0   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.447Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.447Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fff954f6435
[task 2021-07-18T09:47:55.447Z] 09:47:55     INFO -      Found by: call frame info
[task 2021-07-18T09:47:55.448Z] 09:47:55     INFO -   8  xul.dll!NS_ProcessNextEvent(nsIThread*, bool) [nsThreadUtils.cpp:cc4e5ea0c9863a8c4f65a49cd51852f7f38dd2fe : 466 + 0x14]
[task 2021-07-18T09:47:55.448Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.448Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbf7c0   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.448Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.449Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fff954fd852
[task 2021-07-18T09:47:55.449Z] 09:47:55     INFO -      Found by: call frame info
[task 2021-07-18T09:47:55.449Z] 09:47:55     INFO -   9  xul.dll!mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) [MessagePump.cpp:cc4e5ea0c9863a8c4f65a49cd51852f7f38dd2fe : 300 + 0xa]
[task 2021-07-18T09:47:55.450Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.450Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbf810   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.450Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.450Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fff95dedf17
[task 2021-07-18T09:47:55.451Z] 09:47:55     INFO -      Found by: call frame info
[task 2021-07-18T09:47:55.451Z] 09:47:55     INFO -  10  xul.dll!MessageLoop::RunHandler() [message_loop.cc:cc4e5ea0c9863a8c4f65a49cd51852f7f38dd2fe : 324 + 0x8]
[task 2021-07-18T09:47:55.451Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.451Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbf880   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.452Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.452Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fff95d710f0
[task 2021-07-18T09:47:55.452Z] 09:47:55     INFO -      Found by: call frame info
[task 2021-07-18T09:47:55.452Z] 09:47:55     INFO -  11  xul.dll!MessageLoop::Run() [message_loop.cc:cc4e5ea0c9863a8c4f65a49cd51852f7f38dd2fe : 306 + 0x5]
[task 2021-07-18T09:47:55.453Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.453Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbf8d0   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.453Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.453Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fff95d70fad
[task 2021-07-18T09:47:55.454Z] 09:47:55     INFO -      Found by: call frame info
[task 2021-07-18T09:47:55.454Z] 09:47:55     INFO -  12  xul.dll!static nsThread::ThreadFunc(void*) [nsThread.cpp:cc4e5ea0c9863a8c4f65a49cd51852f7f38dd2fe : 390 + 0x8]
[task 2021-07-18T09:47:55.454Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.455Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbf920   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.455Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.455Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fff954f27c7
[task 2021-07-18T09:47:55.455Z] 09:47:55     INFO -      Found by: call frame info
[task 2021-07-18T09:47:55.456Z] 09:47:55     INFO -  13  nss3.dll!PR_NativeRunThread(void*) [pruthr.c:cc4e5ea0c9863a8c4f65a49cd51852f7f38dd2fe : 399 + 0xe]
[task 2021-07-18T09:47:55.456Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.456Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbfb10   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.456Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.457Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fffc0f39462
[task 2021-07-18T09:47:55.457Z] 09:47:55     INFO -      Found by: call frame info
[task 2021-07-18T09:47:55.457Z] 09:47:55     INFO -  14  nss3.dll!pr_root(void*) [w95thred.c:cc4e5ea0c9863a8c4f65a49cd51852f7f38dd2fe : 139 + 0xd]
[task 2021-07-18T09:47:55.457Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.458Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbfb90   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.458Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.458Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fffc0f29e41
[task 2021-07-18T09:47:55.458Z] 09:47:55     INFO -      Found by: call frame info
[task 2021-07-18T09:47:55.459Z] 09:47:55     INFO -  15  ucrtbase.dll!RtlpHpSegPageRangeShrink + 0xda
[task 2021-07-18T09:47:55.459Z] 09:47:55     INFO -      rbx = 0x00000000aaee3300   rbp = 0x0000000000000000
[task 2021-07-18T09:47:55.459Z] 09:47:55     INFO -      rsp = 0x000000d9e9bbfbc0   r12 = 0x00007fff9e07d8bc
[task 2021-07-18T09:47:55.460Z] 09:47:55     INFO -      r13 = 0x000000d9e9bbf478   r14 = 0x0000000000000001
[task 2021-07-18T09:47:55.460Z] 09:47:55     INFO -      r15 = 0x000000d9e9bbeea8   rip = 0x00007fffd613c4be
[task 2021-07-18T09:47:55.460Z] 09:47:55     INFO -      Found by: call frame info

Comment 39

[Intermittent Failures Robot]

48 failures in 2224 pushes (0.022 failures/push) were associated with this bug in the last 7 days.

This is the #21 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 28
• mozilla-central: 18
• mozilla-esr91: 1
• try: 1

Platform and build breakdown:

• windows10-64-qr: 28
  • debug: 28
• windows10-32-qr: 20
  • debug: 20

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-07-12&endday=2021-07-18&tree=all

Comment 40

[Intermittent Failures Robot]

42 failures in 2940 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

This is the #24 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 31
• mozilla-central: 10
• mozilla-esr91: 1

Platform and build breakdown:

• windows10-64-qr: 21
  • debug: 21
• windows10-32-qr: 21
  • debug: 21

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-07-19&endday=2021-07-25&tree=all

Comment 41

[Natalia Csoregi [:nataliaCs]]

Update:

There have been 35 failures within the last 7 days:

• 17 failures on Windows 10 x86 WebRender debug
• 18 failures on Windows 10 x64 WebRender debug

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=347031859&repo=mozilla-central&lineNumber=5711

[task 2021-08-01T10:26:07.737Z] 10:26:07  WARNING -  PROCESS-CRASH | testing/xpcshell/example/unit/test_do_check_null_failing.js | application crashed [@ NS_DebugBreak(unsigned int, char const*, char const*, char const*, int)]
[task 2021-08-01T10:26:07.738Z] 10:26:07     INFO -  Mozilla crash reason: MOZ_CRASH()
[task 2021-08-01T10:26:07.738Z] 10:26:07     INFO -  Crash dump filename: C:\Users\task_1627812925\AppData\Local\Temp\xpc-other-lukzh8e2\551ff450-4b54-444f-9726-05ccdac637c6.dmp
[task 2021-08-01T10:26:07.738Z] 10:26:07     INFO -  Operating system: Windows NT
[task 2021-08-01T10:26:07.739Z] 10:26:07     INFO -                    10.0.17134
[task 2021-08-01T10:26:07.739Z] 10:26:07     INFO -  CPU: x86
[task 2021-08-01T10:26:07.739Z] 10:26:07     INFO -       GenuineIntel family 6 model 85 stepping 4
[task 2021-08-01T10:26:07.739Z] 10:26:07     INFO -       8 CPUs
[task 2021-08-01T10:26:07.739Z] 10:26:07     INFO -  GPU: UNKNOWN
[task 2021-08-01T10:26:07.740Z] 10:26:07     INFO -  Crash reason:  EXCEPTION_BREAKPOINT
[task 2021-08-01T10:26:07.740Z] 10:26:07     INFO -  Crash address: 0x6ac00731
[task 2021-08-01T10:26:07.740Z] 10:26:07     INFO -  Process uptime: 2 seconds
[task 2021-08-01T10:26:07.741Z] 10:26:07     INFO -  Thread 20 (crashed) - BgIOThreadPool #1 0  mozglue.dll!mozalloc_abort(char const* const) [mozalloc_abort.cpp:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 33 + 0x0]
[task 2021-08-01T10:26:07.741Z] 10:26:07     INFO -      eip = 0x6ac00731   esp = 0x10bdf314   ebp = 0x10bdf31c   ebx = 0x10bdf354
[task 2021-08-01T10:26:07.741Z] 10:26:07     INFO -      esi = 0x10bdf354   edi = 0x75c0fd90   eax = 0x00000000   ecx = 0x00000000
[task 2021-08-01T10:26:07.741Z] 10:26:07     INFO -      edx = 0x00000048   efl = 0x00000216
[task 2021-08-01T10:26:07.742Z] 10:26:07     INFO -      Found by: given as instruction pointer in context
[task 2021-08-01T10:26:07.742Z] 10:26:07     INFO -   1  xul.dll!NS_DebugBreak(unsigned int, char const*, char const*, char const*, int) [nsDebugImpl.cpp:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 398 + 0x4d]
[task 2021-08-01T10:26:07.742Z] 10:26:07     INFO -      eip = 0x5fbc76fb   esp = 0x10bdf324   ebp = 0x10bdf96c   esi = 0x75c0fd90
[task 2021-08-01T10:26:07.742Z] 10:26:07     INFO -      edi = 0x00bb7ff2
[task 2021-08-01T10:26:07.743Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.743Z] 10:26:07     INFO -   2  xul.dll!mozilla::ThreadEventTarget::Dispatch(already_AddRefed<nsIRunnable>, unsigned int) [ThreadEventTarget.cpp:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 59 + 0x18]
[task 2021-08-01T10:26:07.743Z] 10:26:07     INFO -      eip = 0x5fce4128   esp = 0x10bdf974   ebp = 0x10bdf9ac   ebx = 0x052ca380
[task 2021-08-01T10:26:07.744Z] 10:26:07     INFO -      esi = 0x10bdf9b4   edi = 0x052caa40
[task 2021-08-01T10:26:07.744Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.744Z] 10:26:07     INFO -   3  xul.dll!nsThread::Dispatch(already_AddRefed<nsIRunnable>, unsigned int) [nsThread.cpp:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 650 + 0xa]
[task 2021-08-01T10:26:07.744Z] 10:26:07     INFO -      eip = 0x5fced94f   esp = 0x10bdf9b4   ebp = 0x10bdf9d0   ebx = 0x10bdf9c0
[task 2021-08-01T10:26:07.745Z] 10:26:07     INFO -      esi = 0x00000000   edi = 0x10bdf9d8
[task 2021-08-01T10:26:07.745Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.745Z] 10:26:07     INFO -   4  xul.dll!nsIEventTarget::Dispatch(nsIRunnable*, unsigned int) [nsIEventTarget.h: : 41 + 0x12]
[task 2021-08-01T10:26:07.745Z] 10:26:07     INFO -      eip = 0x5fc67a92   esp = 0x10bdf9d8   ebp = 0x10bdfa00   ebx = 0x10bdf9d8
[task 2021-08-01T10:26:07.746Z] 10:26:07     INFO -      esi = 0x05268e30   edi = 0x052ca380
[task 2021-08-01T10:26:07.746Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.746Z] 10:26:07     INFO -   5  xul.dll!mozilla::detail::RunnableFunction<`lambda at /builds/worker/checkouts/gecko/ipc/glue/IdleSchedulerParent.cpp:58:51'>::Run() [nsThreadUtils.h:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 532 + 0x105]
[task 2021-08-01T10:26:07.747Z] 10:26:07     INFO -      eip = 0x605042fb   esp = 0x10bdfa08   ebp = 0x10bdfa74   ebx = 0x0f52e0c0
[task 2021-08-01T10:26:07.747Z] 10:26:07     INFO -      esi = 0x052ca380   edi = 0x10bdfa1c
[task 2021-08-01T10:26:07.747Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.747Z] 10:26:07     INFO -   6  xul.dll!nsThreadPool::Run() [nsThreadPool.cpp:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 303 + 0xe]
[task 2021-08-01T10:26:07.748Z] 10:26:07     INFO -      eip = 0x5fcf841d   esp = 0x10bdfa7c   ebp = 0x10bdfbb4   esi = 0x10bdfb30
[task 2021-08-01T10:26:07.748Z] 10:26:07     INFO -      edi = 0x10bdfb30
[task 2021-08-01T10:26:07.748Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.748Z] 10:26:07     INFO -   7  xul.dll!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 1142 + 0xe]
[task 2021-08-01T10:26:07.749Z] 10:26:07     INFO -      eip = 0x5fcef8d0   esp = 0x10bdfbbc   ebp = 0x10bdfce0   ebx = 0x05267a00
[task 2021-08-01T10:26:07.749Z] 10:26:07     INFO -      esi = 0x05211460   edi = 0x05267ab0
[task 2021-08-01T10:26:07.749Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.749Z] 10:26:07     INFO -   8  xul.dll!NS_ProcessNextEvent(nsIThread*, bool) [nsThreadUtils.cpp:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 466 + 0x16]
[task 2021-08-01T10:26:07.750Z] 10:26:07     INFO -      eip = 0x5fcf6021   esp = 0x10bdfce8   ebp = 0x10bdfd04   ebx = 0x60486b00
[task 2021-08-01T10:26:07.750Z] 10:26:07     INFO -      esi = 0x05267a00   edi = 0x10bdfdd0
[task 2021-08-01T10:26:07.750Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.750Z] 10:26:07     INFO -   9  xul.dll!mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) [MessagePump.cpp:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 300 + 0xa]
[task 2021-08-01T10:26:07.751Z] 10:26:07     INFO -      eip = 0x604f36b1   esp = 0x10bdfd0c   ebp = 0x10bdfd38   ebx = 0x60486bc0
[task 2021-08-01T10:26:07.751Z] 10:26:07     INFO -      esi = 0x05201850
[task 2021-08-01T10:26:07.751Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.752Z] 10:26:07     INFO -  10  xul.dll!MessageLoop::RunInternal() [message_loop.cc:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 331 + 0x11]
[task 2021-08-01T10:26:07.752Z] 10:26:07     INFO -      eip = 0x60485d03   esp = 0x10bdfd40   ebp = 0x10bdfd64   ebx = 0x604f35f0
[task 2021-08-01T10:26:07.752Z] 10:26:07     INFO -      esi = 0x10bdfdd0   edi = 0x05201850
[task 2021-08-01T10:26:07.752Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.753Z] 10:26:07     INFO -  11  xul.dll!MessageLoop::RunHandler() [message_loop.cc:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 324 + 0x7]
[task 2021-08-01T10:26:07.753Z] 10:26:07     INFO -      eip = 0x60485c03   esp = 0x10bdfd6c   ebp = 0x10bdfd98   ebx = 0x00c24e38
[task 2021-08-01T10:26:07.753Z] 10:26:07     INFO -      esi = 0x10bdfdd0   edi = 0x10bdfdd0
[task 2021-08-01T10:26:07.753Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.754Z] 10:26:07     INFO -  12  xul.dll!MessageLoop::Run() [message_loop.cc:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 306 + 0x5]
[task 2021-08-01T10:26:07.754Z] 10:26:07     INFO -      eip = 0x60485ab6   esp = 0x10bdfda0   ebp = 0x10bdfdb8   ebx = 0x00c24e38
[task 2021-08-01T10:26:07.754Z] 10:26:07     INFO -      esi = 0x05267a00   edi = 0x10bdfdd0
[task 2021-08-01T10:26:07.754Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.755Z] 10:26:07     INFO -  13  xul.dll!static nsThread::ThreadFunc(void*) [nsThread.cpp:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 390 + 0x7]
[task 2021-08-01T10:26:07.755Z] 10:26:07     INFO -      eip = 0x5fcec2f7   esp = 0x10bdfdc0   ebp = 0x10bdfebc
[task 2021-08-01T10:26:07.755Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.755Z] 10:26:07     INFO -  14  nss3.dll!_PR_NativeRunThread(void*) [pruthr.c:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 399 + 0xf]
[task 2021-08-01T10:26:07.756Z] 10:26:07     INFO -      eip = 0x6a6bb758   esp = 0x10bdfec4   ebp = 0x10bdfee4   ebx = 0x00c24e38
[task 2021-08-01T10:26:07.756Z] 10:26:07     INFO -      esi = 0x052ccb70   edi = 0x0f512970
[task 2021-08-01T10:26:07.756Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.756Z] 10:26:07     INFO -  15  nss3.dll!pr_root(void*) [w95thred.c:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 139 + 0xf]
[task 2021-08-01T10:26:07.757Z] 10:26:07     INFO -      eip = 0x6a6ad026   esp = 0x10bdfeec   ebp = 0x10bdfef4   ebx = 0x00c24e38
[task 2021-08-01T10:26:07.757Z] 10:26:07     INFO -      esi = 0x0f512970   edi = 0x00c24e38
[task 2021-08-01T10:26:07.757Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.757Z] 10:26:07     INFO -  16  ucrtbase.dll!SortGetHashCode + 0xebf
[task 2021-08-01T10:26:07.758Z] 10:26:07     INFO -      eip = 0x75c1e8af   esp = 0x10bdfefc   ebp = 0x10bdff30   esi = 0x6a6ad010
[task 2021-08-01T10:26:07.758Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.758Z] 10:26:07     INFO -  17  kernel32.dll!BaseThreadInitThunk + 0x24
[task 2021-08-01T10:26:07.758Z] 10:26:07     INFO -      eip = 0x77868484   esp = 0x10bdff38   ebp = 0x10bdff44
[task 2021-08-01T10:26:07.759Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.759Z] 10:26:07     INFO -  18  mozglue.dll!patched_BaseThreadInitThunk(int, void*, void*) [WindowsDllBlocklist.cpp:c59236b26192d1299ae1353fefbdb9c147e01aa8 : 588 + 0x14]
[task 2021-08-01T10:26:07.759Z] 10:26:07     INFO -      eip = 0x6ac019b2   esp = 0x10bdff4c   ebp = 0x10bdff7c
[task 2021-08-01T10:26:07.759Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.760Z] 10:26:07     INFO -  19  ntdll.dll!AslPathWildcardFindFirst + 0x218
[task 2021-08-01T10:26:07.760Z] 10:26:07     INFO -      eip = 0x77c0305a   esp = 0x10bdff84   ebp = 0x10bdffc4   ebx = 0x00c24e38
[task 2021-08-01T10:26:07.760Z] 10:26:07     INFO -      esi = 0x77868460   edi = 0x75c1e870
[task 2021-08-01T10:26:07.760Z] 10:26:07     INFO -      Found by: call frame info
[task 2021-08-01T10:26:07.761Z] 10:26:07     INFO -  20  ntdll.dll!AslPathWildcardFindFirst + 0x1e8
[task 2021-08-01T10:26:07.761Z] 10:26:07     INFO -      eip = 0x77c0302a   esp = 0x10bdffcc   ebp = 0x10bdffd4
[task 2021-08-01T10:26:07.761Z] 10:26:07     INFO -      Found by: call frame info

Joel, could you help us assign this to someone?
Thank you.

Comment 42

[Intermittent Failures Robot]

45 failures in 3131 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

This is the #26 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 33
• try: 3
• mozilla-central: 9

Platform and build breakdown:

• windows10-64-qr: 20
  • debug: 20
• windows10-32-qr: 25
  • debug: 25

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-07-26&endday=2021-08-01&tree=all

Comment 43

[Joel Maher ( :jmaher ) (UTC -8)]

hmm, most of these are failing in the testing/xpcshell/example/unit/ directory- why these fail on win10-qr xpcshell debug only I don't know.

A few thoughts:

1. figure out why this is a problem and fix it in the product
2. disable these tests on debug

As we don't have a lot of time and are short staffed, I am voting for #2.

Comment 44

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: Bug 1639850 - disable many testing/xpcshell/example/unit xpcshell tests on windows debug. r=#intermittent-reviewers

Comment 45

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/4fadaf727b41
disable many testing/xpcshell/example/unit xpcshell tests on windows debug. r=intermittent-reviewers,bhearsum

Comment 46

[Marian-Vasile Laza]

https://hg.mozilla.org/mozilla-central/rev/4fadaf727b41

Comment 47

[Intermittent Failures Robot]

30 failures in 2829 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 18
• mozilla-central: 9
• mozilla-esr91: 3

Platform and build breakdown:

• windows10-64-2004-qr: 15
  • debug: 15
• windows10-64-qr: 2
  • debug: 2
• windows10-32-qr: 13
  • debug: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-08-02&endday=2021-08-08&tree=all

Comment 48

[Intermittent Failures Robot]

12 failures in 3025 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-esr91: 7
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 1
  • debug: 1
• windows10-64-qr: 2
  • debug: 2
• windows10-32-qr: 7
  • debug: 7
• windows10-64-2004-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-08-09&endday=2021-08-15&tree=all

Comment 49

[Intermittent Failures Robot]

3 failures in 2899 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 1
• autoland: 1
• mozilla-central: 1

Platform and build breakdown:

• windows10-32-qr: 1
  • debug: 1
• windows10-64-2004-qr: 1
  • debug: 1
• android-em-7-0-x86_64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-08-16&endday=2021-08-22&tree=all

Comment 50

[Intermittent Failures Robot]

4 failures in 2580 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 3
• autoland: 1

Platform and build breakdown:

• windows10-32-qr: 2
  • debug: 2
• windows10-64-qr: 1
  • debug: 1
• windows10-64-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-08-23&endday=2021-08-29&tree=all

Comment 51

[Intermittent Failures Robot]

7 failures in 3084 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-esr91: 1

Platform and build breakdown:

• windows10-32-qr: 4
  • debug: 4
• windows10-64-2004-qr: 2
  • debug: 2
• android-em-7-0-x86_64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-08-30&endday=2021-09-05&tree=all

Comment 52

[Intermittent Failures Robot]

1 failures in 3266 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 1

Platform and build breakdown:

• windows10-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-09-06&endday=2021-09-12&tree=all

Comment 53

[Intermittent Failures Robot]

11 failures in 3375 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 5
• mozilla-esr78: 1
• autoland: 4
• mozilla-central: 1

Platform and build breakdown:

• windows10-64-qr: 3
  • debug: 3
• windows10-64: 1
  • debug: 1
• windows10-32-qr: 2
  • debug: 2
• windows10-32-2004-qr: 4
  • debug: 4
• windows10-64-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-09-13&endday=2021-09-19&tree=all

Comment 54

[Intermittent Failures Robot]

15 failures in 2873 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 7
• mozilla-esr91: 2
• autoland: 6

Platform and build breakdown:

• windows10-64-2004-qr: 7
  • debug: 7
• windows10-32-2004-qr: 7
  • debug: 7
• windows10-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-09-20&endday=2021-09-26&tree=all

Comment 55

[Intermittent Failures Robot]

12 failures in 3376 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 2
• mozilla-central: 4
• autoland: 6

Platform and build breakdown:

• windows10-64-2004-qr: 6
  • debug: 6
• windows10-32-2004-qr: 6
  • debug: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-09-27&endday=2021-10-03&tree=all

Comment 56

[Intermittent Failures Robot]

5 failures in 3626 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• mozilla-esr91: 1
• autoland: 1

Platform and build breakdown:

• windows10-32-2004-qr: 3
  • debug: 3
• windows10-64-2004-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-10-04&endday=2021-10-10&tree=all

Comment 57

[Intermittent Failures Robot]

11 failures in 3315 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 8
• mozilla-central: 1
• autoland: 2

Platform and build breakdown:

• windows10-64-2004-qr: 4
  • debug: 4
• windows10-32-2004-qr: 7
  • debug: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-10-11&endday=2021-10-17&tree=all

Comment 60

[Intermittent Failures Robot]

21 failures in 3186 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• elm: 2
• mozilla-esr91: 5
• autoland: 9
• mozilla-central: 5

Platform and build breakdown:

• windows10-32-2004-qr: 11
  • debug: 11
• windows10-64-2004-qr: 10
  • debug: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-10-18&endday=2021-10-24&tree=all

Comment 61

[Intermittent Failures Robot]

11 failures in 2845 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 3
• mozilla-central: 4
• autoland: 4

Platform and build breakdown:

• windows10-64-2004-qr: 4
  • debug: 4
• windows10-32-2004-qr: 7
  • debug: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-10-25&endday=2021-10-31&tree=all

Comment 62

[Intermittent Failures Robot]

15 failures in 3030 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-esr91: 5
• mozilla-central: 3

Platform and build breakdown:

• windows10-32-2004-qr: 4
  • debug: 4
• windows10-64-2004-qr: 11
  • debug: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-11-01&endday=2021-11-07&tree=all

Comment 63

[Intermittent Failures Robot]

12 failures in 2723 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• mozilla-esr91: 4
• autoland: 5

Platform and build breakdown:

• windows10-32-2004-qr: 7
  • debug: 7
• windows10-64-2004-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-11-08&endday=2021-11-14&tree=all

Comment 64

[Intermittent Failures Robot]

15 failures in 3259 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 3
• autoland: 9
• mozilla-central: 3

Platform and build breakdown:

• windows10-64-2004-qr: 8
  • debug: 8
• windows10-32-2004-qr: 7
  • debug: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-11-15&endday=2021-11-21&tree=all

Comment 66

[Intermittent Failures Robot]

36 failures in 2819 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #31 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 19
• mozilla-central: 14
• mozilla-esr91: 3

Platform and build breakdown:

• windows10-32-2004-qr: 21
  • debug: 21
• windows10-64-2004-qr: 15
  • debug: 15

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-11-22&endday=2021-11-28&tree=all

Comment 67

[Andreea Pavel [:apavel]]

There are 38 total failures in the last 7 days on windows10-32-2004-qr debug
Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=359730870&repo=autoland&lineNumber=2000

[task 2021-11-30T19:51:32.650Z] 19:51:32     INFO -  TEST-START | xpcshell.ini:toolkit/components/extensions/test/xpcshell/test_MatchPattern.js
[task 2021-11-30T19:51:33.012Z] 19:51:33  WARNING -  PROCESS-CRASH | testing/xpcshell/example/unit/test_fail.js | application crashed [@ NS_DebugBreak(unsigned int, char const*, char const*, char const*, int)]
[task 2021-11-30T19:51:33.013Z] 19:51:33     INFO -  Mozilla crash reason: [Parent 11208, BgIOThreadPool #1] ###!!! ASSERTION: Failed Dispatch after xpcom-shutdown-threads: 'false', file /builds/worker/checkouts/gecko/xpcom/threads/ThreadEventTarget.cpp:59
[task 2021-11-30T19:51:33.014Z] 19:51:33     INFO -  Crash dump filename: C:\Users\task_163830083525395\AppData\Local\Temp\xpc-other-nnldprmo\61d6f3c2-2bd3-4d30-8694-c79ae2113c0f.dmp
[task 2021-11-30T19:51:33.014Z] 19:51:33     INFO -  Operating system: Windows NT
[task 2021-11-30T19:51:33.014Z] 19:51:33     INFO -                    10.0.19041
[task 2021-11-30T19:51:33.014Z] 19:51:33     INFO -  CPU: x86
[task 2021-11-30T19:51:33.015Z] 19:51:33     INFO -       GenuineIntel family 6 model 85 stepping 4
[task 2021-11-30T19:51:33.015Z] 19:51:33     INFO -       8 CPUs
[task 2021-11-30T19:51:33.015Z] 19:51:33     INFO -  Crash reason:  EXCEPTION_BREAKPOINT
[task 2021-11-30T19:51:33.015Z] 19:51:33     INFO -  Crash address: 0x6657f0fb
[task 2021-11-30T19:51:33.016Z] 19:51:33     INFO -  Process uptime: 2 seconds
[task 2021-11-30T19:51:33.016Z] 19:51:33     INFO -  Thread 13 BgIOThreadPool #1 (crashed)
[task 2021-11-30T19:51:33.016Z] 19:51:33     INFO -   0  xul.dll!NS_DebugBreak(unsigned int, char const*, char const*, char const*, int) [nsDebugImpl.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 396 + 0x5d]
[task 2021-11-30T19:51:33.017Z] 19:51:33     INFO -      eip = 0x6657f0fb   esp = 0x0fffeb30   ebp = 0x0ffff174   ebx = 0x0fffeb5c
[task 2021-11-30T19:51:33.017Z] 19:51:33     INFO -      esi = 0x76647170   edi = 0x04cff9a2   eax = 0x711a0748   ecx = 0x00002002
[task 2021-11-30T19:51:33.017Z] 19:51:33     INFO -      edx = 0x0fff0000   efl = 0x00000202
[task 2021-11-30T19:51:33.018Z] 19:51:33     INFO -      Found by: given as instruction pointer in context
[task 2021-11-30T19:51:33.018Z] 19:51:33     INFO -   1  xul.dll!mozilla::ThreadEventTarget::Dispatch(already_AddRefed<nsIRunnable>, unsigned int) [ThreadEventTarget.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 59 + 0x17]
[task 2021-11-30T19:51:33.018Z] 19:51:33     INFO -      eip = 0x6669e24f   esp = 0x0ffff17c   ebp = 0x0ffff30c   ebx = 0x0e51e720
[task 2021-11-30T19:51:33.019Z] 19:51:33     INFO -      esi = 0x0ffff190   edi = 0x0ffff314
[task 2021-11-30T19:51:33.019Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.019Z] 19:51:33     INFO -   2  xul.dll!nsThread::Dispatch(already_AddRefed<nsIRunnable>, unsigned int) [nsThread.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 673 + 0x9]
[task 2021-11-30T19:51:33.020Z] 19:51:33     INFO -      eip = 0x666a979f   esp = 0x0ffff314   ebp = 0x0ffff330   ebx = 0x0ffff320
[task 2021-11-30T19:51:33.020Z] 19:51:33     INFO -      esi = 0x00000000   edi = 0x0ffff338
[task 2021-11-30T19:51:33.020Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.021Z] 19:51:33     INFO -   3  xul.dll!nsIEventTarget::Dispatch(nsIRunnable*, unsigned int) [nsIEventTarget.h: : 41 + 0x11]
[task 2021-11-30T19:51:33.021Z] 19:51:33     INFO -      eip = 0x66556dd2   esp = 0x0ffff338   ebp = 0x0ffff360   ebx = 0x0ffff338
[task 2021-11-30T19:51:33.021Z] 19:51:33     INFO -      esi = 0x0e832030   edi = 0x0e51e720
[task 2021-11-30T19:51:33.021Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.022Z] 19:51:33     INFO -   4  xul.dll!mozilla::detail::RunnableFunction<`lambda at /builds/worker/checkouts/gecko/ipc/glue/IdleSchedulerParent.cpp:58:51'>::Run() [nsThreadUtils.h:950a11eb5af31583c98e138a36380d1ecc0609f8 : 531 + 0x13e]
[task 2021-11-30T19:51:33.022Z] 19:51:33     INFO -      eip = 0x66f07655   esp = 0x0ffff368   ebp = 0x0ffff3d4   ebx = 0x0ffff490
[task 2021-11-30T19:51:33.023Z] 19:51:33     INFO -      esi = 0x0e51e720   edi = 0x0ffff37c
[task 2021-11-30T19:51:33.023Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.023Z] 19:51:33     INFO -   5  xul.dll!nsThreadPool::Run() [nsThreadPool.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 305 + 0xd]
[task 2021-11-30T19:51:33.023Z] 19:51:33     INFO -      eip = 0x666b4db2   esp = 0x0ffff3dc   ebp = 0x0ffff514   ebx = 0x0ffff490
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      esi = 0x0e8315e0   edi = 0x00000000
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -   6  xul.dll!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 1177 + 0xd]
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      eip = 0x666abc45   esp = 0x0ffff51c   ebp = 0x0ffff650   ebx = 0x0e832bb0
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      esi = 0x06c13870   edi = 0x0e832c98
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -   7  xul.dll!NS_ProcessNextEvent(nsIThread*, bool) [nsThreadUtils.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 467 + 0x15]
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      eip = 0x666b2981   esp = 0x0ffff658   ebp = 0x0ffff674   ebx = 0x66e87500
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      esi = 0x0e832bb0   edi = 0x0ffff740
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -   8  xul.dll!mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) [MessagePump.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 300 + 0x9]
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      eip = 0x66ef3901   esp = 0x0ffff67c   ebp = 0x0ffff6a8   ebx = 0x66e87590
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      esi = 0x06c02bb0   edi = 0x0ffff740
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -   9  xul.dll!MessageLoop::RunInternal() [message_loop.cc:950a11eb5af31583c98e138a36380d1ecc0609f8 : 331 + 0x10]
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      eip = 0x66e866e3   esp = 0x0ffff6b0   ebp = 0x0ffff6d4   ebx = 0x66ef3840
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      esi = 0x0ffff740   edi = 0x06c02bb0
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -  10  xul.dll!MessageLoop::RunHandler() [message_loop.cc:950a11eb5af31583c98e138a36380d1ecc0609f8 : 324 + 0x6]
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      eip = 0x66e865e3   esp = 0x0ffff6dc   ebp = 0x0ffff708   ebx = 0x0e821830
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      esi = 0x0ffff740   edi = 0x0ffff740
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -  11  xul.dll!MessageLoop::Run() [message_loop.cc:950a11eb5af31583c98e138a36380d1ecc0609f8 : 306 + 0x4]
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      eip = 0x66e86496   esp = 0x0ffff710   ebp = 0x0ffff728   ebx = 0x0e821830
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      esi = 0x0e832bb0   edi = 0x0ffff740
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -  12  xul.dll!static nsThread::ThreadFunc(void*) [nsThread.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 391 + 0x6]
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      eip = 0x666a7cc7   esp = 0x0ffff730   ebp = 0x0ffff834   ebx = 0x0e821830
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      esi = 0x0e832bb0   edi = 0x0ffff740
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -  13  nss3.dll!_PR_NativeRunThread(void*) [pruthr.c:950a11eb5af31583c98e138a36380d1ecc0609f8 : 399 + 0xe]
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      eip = 0x712fbff8   esp = 0x0ffff83c   ebp = 0x0ffff85c   ebx = 0x04cff228
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      esi = 0x0e821830   edi = 0x06c50eb0
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -  14  nss3.dll!pr_root(void*) [w95thred.c:950a11eb5af31583c98e138a36380d1ecc0609f8 : 139 + 0xe]
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      eip = 0x712ed8b6   esp = 0x0ffff864   ebp = 0x0ffff86c   ebx = 0x04cff228
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      esi = 0x06c50eb0   edi = 0x04cff228
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -  15  ucrtbase.dll!thread_start<unsigned int (__stdcall*)(void *),1> + 0x3e
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      eip = 0x76664f9f   esp = 0x0ffff874   ebp = 0x0ffff8a4   ebx = 0x04cff228
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      esi = 0x712ed8a0   edi = 0x04cff228
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -  16  kernel32.dll!BaseThreadInitThunk + 0x18
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      eip = 0x7511fa29   esp = 0x0ffff8ac   ebp = 0x0ffff8b4   ebx = 0x04cff228
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      esi = 0x712ed8a0   edi = 0x04cff228
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -  17  mozglue.dll!patched_BaseThreadInitThunk(int, void*, void*) [WindowsDllBlocklist.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 574 + 0xa]
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      eip = 0x7112b498   esp = 0x0ffff8bc   ebp = 0x0ffff8f0   ebx = 0x04cff228
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      esi = 0x712ed8a0   edi = 0x04cff228
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -  18  ntdll.dll!_RtlUserThreadStart + 0x2e
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      eip = 0x772a7a9e   esp = 0x0ffff8f8   ebp = 0x0ffff94c   ebx = 0x04cff228
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      esi = 0x7511fa10   edi = 0x76664f60
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.087Z] 19:51:33     INFO -  19  ntdll.dll!_RtlUserThreadStart + 0x1a
[task 2021-11-30T19:51:33.088Z] 19:51:33     INFO -      eip = 0x772a7a6e   esp = 0x0ffff954   ebp = 0x0ffff95c   ebx = 0x04cff228
[task 2021-11-30T19:51:33.088Z] 19:51:33     INFO -      esi = 0x7511fa10   edi = 0x76664f60
[task 2021-11-30T19:51:33.088Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.088Z] 19:51:33     INFO -  Thread 0 GeckoMain
[task 2021-11-30T19:51:33.088Z] 19:51:33     INFO -   0  ntdll.dll!NtWaitForAlertByThreadId + 0xc
[task 2021-11-30T19:51:33.088Z] 19:51:33     INFO -      eip = 0x772b46dc   esp = 0x04a6e944   ebp = 0x04a6e99c   ebx = 0x04a6ea18
[task 2021-11-30T19:51:33.088Z] 19:51:33     INFO -      esi = 0x00000000   edi = 0x06c6ce00   eax = 0x00000001   ecx = 0x00000000
[task 2021-11-30T19:51:33.088Z] 19:51:33     INFO -      edx = 0x00000000   efl = 0x00000206
[task 2021-11-30T19:51:33.088Z] 19:51:33     INFO -      Found by: given as instruction pointer in context
[task 2021-11-30T19:51:33.088Z] 19:51:33     INFO -   1  ntdll.dll!RtlSleepConditionVariableSRW + 0x11c
[task 2021-11-30T19:51:33.088Z] 19:51:33     INFO -      eip = 0x772822fd   esp = 0x04a6e948   ebp = 0x04a6e99c   ebx = 0x04a6ea18
[task 2021-11-30T19:51:33.088Z] 19:51:33     INFO -      esi = 0x00000000   edi = 0x06c6ce00
[task 2021-11-30T19:51:33.089Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.089Z] 19:51:33     INFO -   2  KERNELBASE.dll!SleepConditionVariableSRW + 0x22
[task 2021-11-30T19:51:33.089Z] 19:51:33     INFO -      eip = 0x75af48e3   esp = 0x04a6e9a4   ebp = 0x04a6e9c0   ebx = 0x04a6ea18
[task 2021-11-30T19:51:33.089Z] 19:51:33     INFO -      esi = 0x00000000   edi = 0x06c6ce00
[task 2021-11-30T19:51:33.089Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.089Z] 19:51:33     INFO -   3  mozglue.dll!mozilla::detail::ConditionVariableImpl::wait_for(mozilla::detail::MutexImpl&, mozilla::BaseTimeDuration<mozilla::TimeDurationValueCalculator> const&) [ConditionVariable_windows.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 58 + 0xe]
[task 2021-11-30T19:51:33.089Z] 19:51:33     INFO -      eip = 0x71113609   esp = 0x04a6e9c8   ebp = 0x04a6ea00   ebx = 0x04a6ea18
[task 2021-11-30T19:51:33.089Z] 19:51:33     INFO -      esi = 0x00000000   edi = 0x06c6ce00
[task 2021-11-30T19:51:33.089Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.089Z] 19:51:33     INFO -   4  xul.dll!mozilla::OffTheBooksCondVar::Wait(mozilla::BaseTimeDuration<mozilla::TimeDurationValueCalculator>) [BlockingResourceBase.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 534 + 0x10]
[task 2021-11-30T19:51:33.089Z] 19:51:33     INFO -      eip = 0x66686c64   esp = 0x04a6ea08   ebp = 0x04a6ea34   ebx = 0x00000000
[task 2021-11-30T19:51:33.090Z] 19:51:33     INFO -      esi = 0x06c6ce7c   edi = 0x06c50040
[task 2021-11-30T19:51:33.090Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.090Z] 19:51:33     INFO -   5  xul.dll!mozilla::OffTheBooksCondVar::Wait() [BlockingResourceBase.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 514 + 0xb]
[task 2021-11-30T19:51:33.090Z] 19:51:33     INFO -      eip = 0x66686b9f   esp = 0x04a6ea3c   ebp = 0x04a6ea44   ebx = 0x06c08558
[task 2021-11-30T19:51:33.090Z] 19:51:33     INFO -      esi = 0x06c6ce00   edi = 0x06c6ce7c
[task 2021-11-30T19:51:33.090Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.090Z] 19:51:33     INFO -   6  xul.dll!mozilla::TaskController::GetRunnableForMTTask(bool) [TaskController.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 516 + 0x6]
[task 2021-11-30T19:51:33.090Z] 19:51:33     INFO -      eip = 0x6669848f   esp = 0x04a6ea4c   ebp = 0x04a6ea64   ebx = 0x06c08558
[task 2021-11-30T19:51:33.090Z] 19:51:33     INFO -      esi = 0x06c6ce00   edi = 0x06c6ce7c
[task 2021-11-30T19:51:33.090Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.090Z] 19:51:33     INFO -   7  xul.dll!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 1117 + 0xa]
[task 2021-11-30T19:51:33.090Z] 19:51:33     INFO -      eip = 0x666ab76c   esp = 0x04a6ea6c   ebp = 0x04a6eb9c   ebx = 0x06c00101
[task 2021-11-30T19:51:33.090Z] 19:51:33     INFO -      esi = 0x06c0cd20   edi = 0x06c08844
[task 2021-11-30T19:51:33.090Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.091Z] 19:51:33     INFO -   8  xul.dll!nsThread::Shutdown() [nsThread.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 873 + 0x19b]
[task 2021-11-30T19:51:33.091Z] 19:51:33     INFO -      eip = 0x666aa831   esp = 0x04a6eba4   ebp = 0x04a6ed94   ebx = 0x06c0cd20
[task 2021-11-30T19:51:33.091Z] 19:51:33     INFO -      esi = 0x06c0cd20   edi = 0x06cab450
[task 2021-11-30T19:51:33.091Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.091Z] 19:51:33     INFO -   9  xul.dll!nsThreadPool::Shutdown() [nsThreadPool.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 408 + 0xd]
[task 2021-11-30T19:51:33.091Z] 19:51:33     INFO -      eip = 0x666b5e96   esp = 0x04a6ed9c   ebp = 0x04a6edb8   ebx = 0x06c13924
[task 2021-11-30T19:51:33.164Z] 19:51:33     INFO -      esi = 0x00000000   edi = 0x0e832bb0
[task 2021-11-30T19:51:33.164Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -  10  xul.dll!nsThreadManager::Shutdown::<lambda_7>::operator()() const [nsThreadManager.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 383 + 0x32]
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      eip = 0x666c6dab   esp = 0x04a6edc0   ebp = 0x04a6edd0   ebx = 0x06c13bc4
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      esi = 0x06c0292c   edi = 0x06c13884
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -  11  xul.dll!mozilla::MozPromise<CopyableTArray<bool>,bool,0>::ThenValue<`lambda at /builds/worker/checkouts/gecko/xpcom/threads/nsThreadManager.cpp:382:76'>::DoResolveOrRejectInternal(mozilla::MozPromise<CopyableTArray<bool>,bool,0>::ResolveOrRejectValue&) [MozPromise.h:950a11eb5af31583c98e138a36380d1ecc0609f8 : 914 + 0x15]
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      eip = 0x666c6bca   esp = 0x04a6edd8   ebp = 0x04a6eddc   ebx = 0x06ca2430
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      esi = 0x06c02910   edi = 0x06ca2430
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -  12  xul.dll!mozilla::MozPromise<CopyableTArray<bool>,bool,0>::ThenValueBase::ResolveOrRejectRunnable::Run() [MozPromise.h:950a11eb5af31583c98e138a36380d1ecc0609f8 : 487 + 0x5]
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      eip = 0x666c542c   esp = 0x04a6ede4   ebp = 0x04a6edf4   ebx = 0x06ca2430
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      esi = 0x06c111a0   edi = 0x06ca2430
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -  13  xul.dll!mozilla::RunnableTask::Run() [TaskController.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 468 + 0xd]
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      eip = 0x666b9f50   esp = 0x04a6edfc   ebp = 0x04a6f258   ebx = 0x06c11100
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      esi = 0x06c111a0   edi = 0x06ca2430
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -  14  xul.dll!mozilla::TaskController::DoExecuteNextTaskOnlyMainThreadInternal(mozilla::detail::BaseAutoLock<mozilla::Mutex &> const&) [TaskController.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 771 + 0x10]
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      eip = 0x66699205   esp = 0x04a6f260   ebp = 0x04a6f45c   ebx = 0x06c111a0
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      esi = 0x666b9e60   edi = 0x06c6cec8
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -  15  xul.dll!mozilla::TaskController::ExecuteNextTaskOnlyMainThreadInternal(mozilla::detail::BaseAutoLock<mozilla::Mutex &> const&) [TaskController.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 607 + 0x7]
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      eip = 0x66697a61   esp = 0x04a6f464   ebp = 0x04a6f4ac   ebx = 0x06c00101
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      esi = 0x06c6ce00   edi = 0x04a6f5a0
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -  16  xul.dll!mozilla::TaskController::ProcessPendingMTTask(bool) [TaskController.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 391 + 0x7]
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      eip = 0x66697d06   esp = 0x04a6f4b4   ebp = 0x04a6f4d8   ebx = 0x06c00101
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      esi = 0x06c6ce00   edi = 0x04a6f5a0
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -  17  xul.dll!mozilla::detail::RunnableFunction<`lambda at /builds/worker/checkouts/gecko/xpcom/threads/TaskController.cpp:127:7'>::Run() [nsThreadUtils.h:950a11eb5af31583c98e138a36380d1ecc0609f8 : 531 + 0x10]
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      eip = 0x666be154   esp = 0x04a6f4e0   ebp = 0x04a6f4e4   ebx = 0x06c00101
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      esi = 0x06c03740   edi = 0x04a6f5a0
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -  18  xul.dll!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 1183 + 0xd]
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      eip = 0x666abaf1   esp = 0x04a6f4ec   ebp = 0x04a6f61c   ebx = 0x06c00101
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      esi = 0x06c03740   edi = 0x04a6f5a0
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -  19  xul.dll!nsThreadManager::Shutdown() [nsThreadManager.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 392 + 0x2d4]
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      eip = 0x666b042e   esp = 0x04a6f624   ebp = 0x04a6f7c8   ebx = 0x04a6f65c
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      esi = 0x06c0cd20   edi = 0x06c0cd20
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -  20  xul.dll!mozilla::ShutdownXPCOM(nsIServiceManager*) [XPCOMInit.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 655 + 0xb]
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      eip = 0x666f28d5   esp = 0x04a6f7d0   ebp = 0x04a6f864   ebx = 0x04a6f7f0
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      esi = 0x04a6f7d0   edi = 0x06c0a890
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -  21  xul.dll!XRE_XPCShellMain(int, char**, char**, XREShellData const*) [XPCShellImpl.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 1434 + 0x6]
[task 2021-11-30T19:51:33.165Z] 19:51:33     INFO -      eip = 0x6753b23e   esp = 0x04a6f86c   ebp = 0x04a6fb20   ebx = 0x06c12700
[task 2021-11-30T19:51:33.166Z] 19:51:33     INFO -      esi = 0x04a6f870   edi = 0x00000001
[task 2021-11-30T19:51:33.166Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.166Z] 19:51:33     INFO -  22  xul.dll!mozilla::BootstrapImpl::XRE_XPCShellMain(int, char**, char**, XREShellData const*) [Bootstrap.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 54 + 0x8]
[task 2021-11-30T19:51:33.166Z] 19:51:33     INFO -      eip = 0x6be17c23   esp = 0x04a6fb28   ebp = 0x04a6fb38   ebx = 0x04cbdc78
[task 2021-11-30T19:51:33.166Z] 19:51:33     INFO -      esi = 0x06c07068   edi = 0x6be17c10
[task 2021-11-30T19:51:33.166Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.167Z] 19:51:33     INFO -  23  xpcshell.exe!NS_internal_main(int, char**, char**) [xpcshell.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 82 + 0x1e]
[task 2021-11-30T19:51:33.167Z] 19:51:33     INFO -      eip = 0x004f13be   esp = 0x04a6fb40   ebp = 0x04a6fb6c   ebx = 0x04cbdc78
[task 2021-11-30T19:51:33.167Z] 19:51:33     INFO -      esi = 0x06c07068   edi = 0x6be17c10
[task 2021-11-30T19:51:33.167Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.167Z] 19:51:33     INFO -  24  xpcshell.exe!wmain(int, wchar_t**) [nsWindowsWMain.cpp:950a11eb5af31583c98e138a36380d1ecc0609f8 : 147 + 0xe]
[task 2021-11-30T19:51:33.168Z] 19:51:33     INFO -      eip = 0x004f12d0   esp = 0x04a6fb74   ebp = 0x04a6fde0   ebx = 0x06c04980
[task 2021-11-30T19:51:33.168Z] 19:51:33     INFO -      esi = 0x0000001c   edi = 0x06c04700
[task 2021-11-30T19:51:33.168Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.168Z] 19:51:33     INFO -  25  xpcshell.exe!__scrt_common_main_seh() [exe_common.inl : 288 + 0x1b]
[task 2021-11-30T19:51:33.168Z] 19:51:33     INFO -      eip = 0x00561eb9   esp = 0x04a6fde8   ebp = 0x04a6fe28   ebx = 0x047a4000
[task 2021-11-30T19:51:33.168Z] 19:51:33     INFO -      esi = 0x767312f0   edi = 0x04cbefe8
[task 2021-11-30T19:51:33.168Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.168Z] 19:51:33     INFO -  26  kernel32.dll!BaseThreadInitThunk + 0x18
[task 2021-11-30T19:51:33.168Z] 19:51:33     INFO -      eip = 0x7511fa29   esp = 0x04a6fe30   ebp = 0x04a6fe38   ebx = 0x047a4000
[task 2021-11-30T19:51:33.168Z] 19:51:33     INFO -      esi = 0x767312f0   edi = 0x04cbefe8
[task 2021-11-30T19:51:33.169Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.169Z] 19:51:33     INFO -  27  ntdll.dll!_RtlUserThreadStart + 0x2e
[task 2021-11-30T19:51:33.169Z] 19:51:33     INFO -      eip = 0x772a7a9e   esp = 0x04a6fe40   ebp = 0x04a6fe94   ebx = 0x047a4000
[task 2021-11-30T19:51:33.169Z] 19:51:33     INFO -      esi = 0x767312f0   edi = 0x04cbefe8
[task 2021-11-30T19:51:33.169Z] 19:51:33     INFO -      Found by: call frame info
[task 2021-11-30T19:51:33.169Z] 19:51:33     INFO -  28  ntdll.dll!_RtlUserThreadStart + 0x1a
[task 2021-11-30T19:51:33.169Z] 19:51:33     INFO -      eip = 0x772a7a6e   esp = 0x04a6fe9c   ebp = 0x04a6fea4   ebx = 0x047a4000
[task 2021-11-30T19:51:33.169Z] 19:51:33     INFO -      esi = 0x767312f0   edi = 0x04cbefe8
[task 2021-11-30T19:51:33.170Z] 19:51:33     INFO -      Found by: call frame info

Joel, can you please take a look?

I checked the latest 15 failure logs

• 10 failures in testing/xpcshell/example/unit/test_fail.js
• 5 failures in testing/xpcshell/example/unit/test_do_check_matches_failing.js

Should we try disabling these 2?

Comment 68

[Joel Maher ( :jmaher ) (UTC -8)]

I am looking into this, unfortunately, these jobs are very orange:
https://treeherder.mozilla.org/jobs?repo=try&tier=1%2C2%2C3&revision=7768cad790b56949420aca0ddfd81bfaa3bd7fec

Comment 69

[Intermittent Failures Robot]

52 failures in 3170 pushes (0.016 failures/push) were associated with this bug in the last 7 days.

This is the #14 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 32
• mozilla-central: 14
• mozilla-esr91: 1
• try: 5

Platform and build breakdown:

• windows10-64-2004-qr: 27
  • debug: 27
• windows10-32-2004-qr: 25
  • debug: 25

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-11-29&endday=2021-12-05&tree=all

Comment 70

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: Bug 1639850 - adjust xpcshell on windows to remove frequent failures. r=gbrown!

Comment 71

[Joel Maher ( :jmaher ) (UTC -8)]

solving this by changing chunking and threads

Comment 72

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/8c223dc4de93
adjust xpcshell on windows to remove frequent failures. r=gbrown

Comment 73

[Cristian Tuns]

https://hg.mozilla.org/mozilla-central/rev/8c223dc4de93

Comment 74

[Intermittent Failures Robot]

19 failures in 3319 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 6
• mozilla-esr91: 5
• try: 2

Platform and build breakdown:

• windows10-64-2004-qr: 9
  • debug: 9
• windows10-32-2004-qr: 10
  • debug: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-12-06&endday=2021-12-12&tree=all

Comment 75

[Intermittent Failures Robot]

6 failures in 3263 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 6

Platform and build breakdown:

• windows10-32-2004-qr: 2
  • debug: 2
• windows10-64-2004-qr: 4
  • debug: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-12-13&endday=2021-12-19&tree=all

Comment 76

[Intermittent Failures Robot]

4 failures in 2286 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 4

Platform and build breakdown:

• windows10-32-2004-qr: 2
  • debug: 2
• windows10-64-2004-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2021-12-20&endday=2021-12-26&tree=all

Comment 77

[Ryan VanderMeulen [:RyanVM]]

Silence these on ESR91 too:
https://hg.mozilla.org/releases/mozilla-esr91/rev/52ff5fcaa9db
https://hg.mozilla.org/releases/mozilla-esr91/rev/96a5fed7ba83

Comment 78

[Intermittent Failures Robot]

8 failures in 2801 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 8

Platform and build breakdown:

• windows10-64-2004-qr: 5
  • debug: 5
• windows10-32-2004-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2022-01-03&endday=2022-01-09&tree=all

Comment 79

[Intermittent Failures Robot]

1 failures in 2992 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• comm-central: 1

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2022-02-21&endday=2022-02-27&tree=all

Comment 80

[Intermittent Failures Robot]

1 failures in 3159 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-32-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2022-04-18&endday=2022-04-24&tree=all

Comment 81

[Intermittent Failures Robot]

1 failures in 3914 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2023-01-23&endday=2023-01-29&tree=all

Comment 82

[Intermittent Failures Robot]

1 failures in 3484 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows11-64-2009-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1639850&startday=2023-10-16&endday=2023-10-22&tree=all