1789126 - Intermittent Assertion failure: false (MOZ_ASSERT_UNREACHABLE: Failure when starting actor), at /builds/worker/checkouts/gecko/ipc/glue/UtilityProcessManager.cpp:258

Status: RESOLVED FIXED

(Core :: IPC, defect)

Description

[Treeherder Bug Filer]

Filed by: mlaza [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=389411613&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/WviZOqCLTeSrcJC4AaR-PQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2022-09-04T10:11:38.772Z] 10:11:38     INFO - TEST-START | dom/canvas/test/webgl-conf/generated/test_2_conformance__textures__misc__tex-video-using-tex-unit-non-zero.html
[task 2022-09-04T10:11:38.854Z] 10:11:38     INFO - GECKO(1742) | [Parent 1742, Main Thread] WARNING: NS_ENSURE_TRUE(she && she->mInfo->mSharedState.Get()) failed: file /builds/worker/checkouts/gecko/docshell/shistory/SessionHistoryEntry.cpp:1127
[task 2022-09-04T10:11:39.006Z] 10:11:39     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: NS_ENSURE_TRUE(nsContentUtils::IsJavascriptMIMEType(type)) failed: file /builds/worker/checkouts/gecko/dom/script/ScriptLoader.cpp:876
[task 2022-09-04T10:11:39.006Z] 10:11:39     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: NS_ENSURE_TRUE(nsContentUtils::IsJavascriptMIMEType(type)) failed: file /builds/worker/checkouts/gecko/dom/script/ScriptLoader.cpp:876
[task 2022-09-04T10:11:39.113Z] 10:11:39     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: '!scrollbar', file /builds/worker/checkouts/gecko/widget/Theme.cpp:1073
[task 2022-09-04T10:11:39.274Z] 10:11:39     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: Attempt to __delete__ missing or closed actor: file /builds/worker/workspace/obj-build/ipc/ipdl/PWebGLChild.cpp:125
[task 2022-09-04T10:11:39.275Z] 10:11:39     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: Attempt to __delete__ missing or closed actor: file /builds/worker/workspace/obj-build/ipc/ipdl/PWebGLChild.cpp:125
[task 2022-09-04T10:11:39.275Z] 10:11:39     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: Attempt to __delete__ missing or closed actor: file /builds/worker/workspace/obj-build/ipc/ipdl/PWebGLChild.cpp:125
[task 2022-09-04T10:11:39.276Z] 10:11:39     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: Attempt to __delete__ missing or closed actor: file /builds/worker/workspace/obj-build/ipc/ipdl/PWebGLChild.cpp:125
[task 2022-09-04T10:11:40.408Z] 10:11:40     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: '!scrollbar', file /builds/worker/checkouts/gecko/widget/Theme.cpp:1073
[task 2022-09-04T10:11:40.458Z] 10:11:40     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: '!scrollbar', file /builds/worker/checkouts/gecko/widget/Theme.cpp:1073
[task 2022-09-04T10:11:40.509Z] 10:11:40     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: '!scrollbar', file /builds/worker/checkouts/gecko/widget/Theme.cpp:1073
[task 2022-09-04T10:11:40.599Z] 10:11:40     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: '!scrollbar', file /builds/worker/checkouts/gecko/widget/Theme.cpp:1073
[task 2022-09-04T10:11:40.641Z] 10:11:40     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: '!scrollbar', file /builds/worker/checkouts/gecko/widget/Theme.cpp:1073
[task 2022-09-04T10:11:40.734Z] 10:11:40     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: '!scrollbar', file /builds/worker/checkouts/gecko/widget/Theme.cpp:1073
[task 2022-09-04T10:11:43.739Z] 10:11:43     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: Attempt to __delete__ missing or closed actor: file /builds/worker/workspace/obj-build/ipc/ipdl/PWebGLChild.cpp:125
[task 2022-09-04T10:11:43.739Z] 10:11:43     INFO - GECKO(1742) | [Child 1760, Main Thread] WARNING: Attempt to __delete__ missing or closed actor: file /builds/worker/workspace/obj-build/ipc/ipdl/PWebGLChild.cpp:125
[task 2022-09-04T10:11:45.930Z] 10:11:45     INFO - GECKO(1742) | [Parent 1742, Main Thread] WARNING: Reject LaunchProcess() for LaunchPromise() rejection: file /builds/worker/checkouts/gecko/ipc/glue/UtilityProcessManager.cpp:205
[task 2022-09-04T10:11:45.930Z] 10:11:45     INFO - GECKO(1742) | Assertion failure: false (MOZ_ASSERT_UNREACHABLE: Failure when starting actor), at /builds/worker/checkouts/gecko/ipc/glue/UtilityProcessManager.cpp:258
[task 2022-09-04T10:11:46.018Z] 10:11:46     INFO -  Initializing stack-fixing for the first stack frame, this may take a while...

Comment 1

[:gerard-majax]

~330 more retriggers, no repro so far

Comment 2

[Intermittent Failures Robot]

1 failures in 3537 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2022-08-29&endday=2022-09-04&tree=all

Comment 3

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 4

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=396262052&repo=autoland

Comment 5

[Intermittent Failures Robot]

1 failures in 3445 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2022-11-07&endday=2022-11-13&tree=all

Comment 6

[Intermittent Failures Robot]

1 failures in 3589 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2022-11-14&endday=2022-11-20&tree=all

Comment 7

[Intermittent Failures Robot]

3 failures in 3888 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • debug: 1
• macosx1015-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2022-11-21&endday=2022-11-27&tree=all

Comment 8

[Intermittent Failures Robot]

3 failures in 3938 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-beta: 1

Platform and build breakdown:

• windows10-64-2004-qr: 2
  • debug: 2
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2022-11-28&endday=2022-12-04&tree=all

Comment 9

[Intermittent Failures Robot]

1 failures in 3510 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2022-12-05&endday=2022-12-11&tree=all

Comment 10

[Intermittent Failures Robot]

1 failures in 3558 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2022-12-12&endday=2022-12-18&tree=all

Comment 11

[Intermittent Failures Robot]

2 failures in 2999 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• try: 1

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • debug: 1
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2022-12-19&endday=2022-12-25&tree=all

Comment 12

[Intermittent Failures Robot]

2 failures in 2607 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform and build breakdown:

• macosx1015-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-01-02&endday=2023-01-08&tree=all

Comment 13

[Intermittent Failures Robot]

1 failures in 3717 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-01-16&endday=2023-01-22&tree=all

Comment 14

[Intermittent Failures Robot]

7 failures in 3914 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• try: 1
• mozilla-beta: 2
• mozilla-central: 1

Platform and build breakdown:

• windows10-64-2004-qr: 2
  • debug: 2
• macosx1015-64-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-01-23&endday=2023-01-29&tree=all

Comment 15

[Intermittent Failures Robot]

4 failures in 3606 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• mozilla-beta: 2
• autoland: 1

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • debug: 1
• macosx1015-64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-01-30&endday=2023-02-05&tree=all

Comment 16

[Intermittent Failures Robot]

13 failures in 3766 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 4
• try: 2

Platform and build breakdown:

• macosx1015-64-qr: 12
  • debug: 12
• android-em-7-0-x86_64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-02-06&endday=2023-02-12&tree=all

Comment 17

[Intermittent Failures Robot]

33 failures in 3856 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 17
• mozilla-central: 9
• mozilla-beta: 6
• try: 1

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • debug: 1
• macosx1015-64-qr: 32
  • debug: 32

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-02-13&endday=2023-02-19&tree=all

Comment 18

[Gian-Carlo Pascutto [:gcp]]

The huge spike since ~2 weeks ago correlates with bug 1812035 and bug 1812275 landing, and they're the only changes to Utility I see since. Andreas, can you take a look?

Comment 19

[Intermittent Failures Robot]

26 failures in 3643 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 3
• autoland: 18
• mozilla-central: 5

Platform and build breakdown:

• macosx1015-64-qr: 24
  • debug: 24
• windows10-64-2004-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-02-20&endday=2023-02-26&tree=all

Comment 20

[Andreas Farre [:farre]]

Those tests changes are to be able to pick up the js utility process, that we've set up to start early. The tests doesn't change anything than expectations. I think we need to ask :gerard-majax about this.

Comment 21

[:gerard-majax]

(In reply to Andreas Farre [:farre] from comment #20)

Those tests changes are to be able to pick up the js utility process, that we've set up to start early. The tests doesn't change anything than expectations. I think we need to ask :gerard-majax about this.

You start a new process early, that does not qualify for "does not change anything", it's actually a pretty invasive change. ... According to the stack:

[task 2023-02-24T19:42:18.340Z] 19:42:18     INFO - GECKO(1412) | [Parent 1412, Main Thread] WARNING: Reject LaunchProcess() for LaunchPromise() rejection: file /builds/worker/checkouts/gecko/ipc/glue/UtilityProcessManager.cpp:222
[task 2023-02-24T19:42:18.340Z] 19:42:18     INFO - GECKO(1412) | Assertion failure: false (MOZ_ASSERT_UNREACHABLE: Failure when starting actor), at /builds/worker/checkouts/gecko/ipc/glue/UtilityProcessManager.cpp:285
[task 2023-02-24T19:42:18.385Z] 19:42:18     INFO -  Initializing stack-fixing for the first stack frame, this may take a while...
[task 2023-02-24T19:42:37.707Z] 19:42:37     INFO - GECKO(1412) | #01: mozilla::ipc::UtilityProcessManager::StartUtility<mozilla::ipc::UtilityAudioDecoderChild>(RefPtr<mozilla::ipc::UtilityAudioDecoderChild>, mozilla::ipc::SandboxingKind)::{lambda(nsresult)#1}::operator()(nsresult) const [ipc/glue/UtilityProcessManager.cpp:285]
[task 2023-02-24T19:42:37.708Z] 19:42:37     INFO - GECKO(1412) | #02: mozilla::MozPromise<bool, nsresult, false>::InvokeCallbackMethod<true, mozilla::ipc::UtilityProcessManager::StartUtility<mozilla::ipc::UtilityAudioDecoderChild>(RefPtr<mozilla::ipc::UtilityAudioDecoderChild>, mozilla::ipc::SandboxingKind)::{lambda(nsresult)#1}, RefPtr<mozilla::MozPromise<bool, nsresult, false> > (mozilla::ipc::UtilityProcessManager::StartUtility<mozilla::ipc::UtilityAudioDecoderChild>(RefPtr<mozilla::ipc::UtilityAudioDecoderChild>, mozilla::ipc::SandboxingKind)::{lambda(nsresult)#1}::*)(nsresult) const, nsresult const&, RefPtr<mozilla::MozPromise<bool, nsresult, false>::Private> >(mozilla::ipc::UtilityProcessManager::StartUtility<mozilla::ipc::UtilityAudioDecoderChild>(RefPtr<mozilla::ipc::UtilityAudioDecoderChild>, mozilla::ipc::SandboxingKind)::{lambda(nsresult)#1}*, RefPtr<mozilla::MozPromise<bool, nsresult, false> > (mozilla::ipc::UtilityProcessManager::StartUtility<mozilla::ipc::UtilityAudioDecoderChild>(RefPtr<mozilla::ipc::UtilityAudioDecoderChild>, mozilla::ipc::SandboxingKind)::{lambda(nsresult)#1}::*)(nsresult) const, nsresult const&, RefPtr<mozilla::MozPromise<bool, nsresult, false>::Private>&&) [xpcom/threads/MozPromise.h:649]
[task 2023-02-24T19:42:37.709Z] 19:42:37     INFO - GECKO(1412) | #03: mozilla::MozPromise<bool, nsresult, false>::ThenValue<mozilla::ipc::UtilityProcessManager::StartUtility<mozilla::ipc::UtilityAudioDecoderChild>(RefPtr<mozilla::ipc::UtilityAudioDecoderChild>, mozilla::ipc::SandboxingKind)::{lambda()#1}, mozilla::ipc::UtilityProcessManager::StartUtility<mozilla::ipc::UtilityAudioDecoderChild>(RefPtr<mozilla::ipc::UtilityAudioDecoderChild>, mozilla::ipc::SandboxingKind)::{lambda(nsresult)#1}>::DoResolveOrRejectInternal(mozilla::MozPromise<bool, nsresult, false>::ResolveOrRejectValue&) [xpcom/threads/MozPromise.h:861]
[task 2023-02-24T19:42:37.709Z] 19:42:37     INFO - GECKO(1412) | #04: mozilla::MozPromise<bool, nsresult, false>::ThenValueBase::ResolveOrRejectRunnable::Run() [xpcom/threads/MozPromise.h:490]
[task 2023-02-24T19:42:37.710Z] 19:42:37     INFO - GECKO(1412) | #05: mozilla::RunnableTask::Run() [xpcom/threads/TaskController.cpp:540]
[task 2023-02-24T19:42:37.710Z] 19:42:37     INFO - GECKO(1412) | #06: mozilla::TaskController::DoExecuteNextTaskOnlyMainThreadInternal(mozilla::detail::BaseAutoLock<mozilla::Mutex&> const&) [xpcom/threads/TaskController.cpp:852]
[task 2023-02-24T19:42:37.710Z] 19:42:37     INFO - GECKO(1412) | #07: mozilla::TaskController::ExecuteNextTaskOnlyMainThreadInternal(mozilla::detail::BaseAutoLock<mozilla::Mutex&> const&) [xpcom/threads/TaskController.cpp:0]
[task 2023-02-24T19:42:37.711Z] 19:42:37     INFO - GECKO(1412) | #08: mozilla::TaskController::ProcessPendingMTTask(bool) [xpcom/threads/TaskController.cpp:462]
[task 2023-02-24T19:42:37.711Z] 19:42:37     INFO - GECKO(1412) | #09: mozilla::detail::RunnableFunction<mozilla::TaskController::InitializeInternal()::$_2>::Run() [xpcom/threads/nsThreadUtils.h:547]
[task 2023-02-24T19:42:37.711Z] 19:42:37     INFO - GECKO(1412) | #10: nsThread::ProcessNextEvent(bool, bool*) [xpcom/threads/nsThread.cpp:1229]
[task 2023-02-24T19:42:37.712Z] 19:42:37     INFO - GECKO(1412) | #11: NS_ProcessPendingEvents(nsIThread*, unsigned int) [xpcom/threads/nsThreadUtils.cpp:442]
[task 2023-02-24T19:42:37.712Z] 19:42:37     INFO - GECKO(1412) | #12: nsBaseAppShell::NativeEventCallback() [widget/nsBaseAppShell.cpp:88]
[task 2023-02-24T19:42:37.712Z] 19:42:37     INFO - GECKO(1412) | #13: nsAppShell::ProcessGeckoEvents(void*) [widget/cocoa/nsAppShell.mm:512]
[task 2023-02-24T19:42:37.964Z] 19:42:37     INFO - GECKO(1412) | #14: __CFRUNLOOP_IS_CALLING_OUT_TO_A_SOURCE0_PERFORM_FUNCTION__ [/System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation + 0x83d52]
[task 2023-02-24T19:42:37.964Z] 19:42:37     INFO - GECKO(1412) | #15: __CFRunLoopDoSource0 [/System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation + 0x83cf1]
[task 2023-02-24T19:42:37.965Z] 19:42:37     INFO - GECKO(1412) | #16: __CFRunLoopDoSources0 [/System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation + 0x83b0b]
[task 2023-02-24T19:42:37.965Z] 19:42:37     INFO - GECKO(1412) | #17: __CFRunLoopRun [/System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation + 0x8283a]
[task 2023-02-24T19:42:37.965Z] 19:42:37     INFO - GECKO(1412) | #18: CFRunLoopRunSpecific [/System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation + 0x81e3e]
[task 2023-02-24T19:42:38.236Z] 19:42:38     INFO - GECKO(1412) | #19: RunCurrentEventLoopInMode [/System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/HIToolbox.framework/Versions/A/HIToolbox + 0x2fabd]
[task 2023-02-24T19:42:38.236Z] 19:42:38     INFO - GECKO(1412) | #20: ReceiveNextEventCommon [/System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/HIToolbox.framework/Versions/A/HIToolbox + 0x2f7d5]
[task 2023-02-24T19:42:38.237Z] 19:42:38     INFO - GECKO(1412) | #21: _BlockUntilNextEventMatchingListInModeWithFilter [/System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/HIToolbox.framework/Versions/A/HIToolbox + 0x2f579]
[task 2023-02-24T19:42:38.496Z] 19:42:38     INFO - GECKO(1412) | #22: _DPSNextEvent [/System/Library/Frameworks/AppKit.framework/Versions/C/AppKit + 0x41039]
[task 2023-02-24T19:42:38.496Z] 19:42:38     INFO - GECKO(1412) | #23: -[NSApplication(NSEvent) _nextEventMatchingEventMask:untilDate:inMode:dequeue:] [/System/Library/Frameworks/AppKit.framework/Versions/C/AppKit + 0x3f880]
[task 2023-02-24T19:42:38.496Z] 19:42:38     INFO - GECKO(1412) | #24: -[GeckoNSApplication nextEventMatchingMask:untilDate:inMode:dequeue:] [widget/cocoa/nsAppShell.mm:175]
[task 2023-02-24T19:42:38.497Z] 19:42:38     INFO - GECKO(1412) | #25: -[NSApplication run] [/System/Library/Frameworks/AppKit.framework/Versions/C/AppKit + 0x3158e]
[task 2023-02-24T19:42:38.497Z] 19:42:38     INFO - GECKO(1412) | #26: nsAppShell::Run() [widget/cocoa/nsAppShell.mm:0]
[task 2023-02-24T19:42:38.497Z] 19:42:38     INFO - GECKO(1412) | #27: nsAppStartup::Run() [toolkit/components/startup/nsAppStartup.cpp:296]
[task 2023-02-24T19:42:38.498Z] 19:42:38     INFO - GECKO(1412) | #28: XREMain::XRE_mainRun() [toolkit/xre/nsAppRunner.cpp:5650]
[task 2023-02-24T19:42:38.498Z] 19:42:38     INFO - GECKO(1412) | #29: XREMain::XRE_main(int, char**, mozilla::BootstrapConfig const&) [toolkit/xre/nsAppRunner.cpp:5843]
[task 2023-02-24T19:42:38.498Z] 19:42:38     INFO - GECKO(1412) | #30: XRE_main(int, char**, mozilla::BootstrapConfig const&) [toolkit/xre/nsAppRunner.cpp:5899]
[task 2023-02-24T19:42:38.499Z] 19:42:38     INFO - GECKO(1412) | #31: main [browser/app/nsBrowserApp.cpp:423]

So we reject because of an error: https://searchfox.org/mozilla-central/rev/aa3ccd258b64abfd4c5ce56c1f512bc7f65b844c/ipc/glue/UtilityProcessManager.cpp#222

Comment 22

[:gerard-majax]

Likely the cause of our reject is this reject: https://searchfox.org/mozilla-central/rev/aa3ccd258b64abfd4c5ce56c1f512bc7f65b844c/ipc/glue/UtilityProcessHost.cpp#150, which means it's GeckoChildProcessHost that rejects beneath us and this could come from:

• https://searchfox.org/mozilla-central/rev/aa3ccd258b64abfd4c5ce56c1f512bc7f65b844c/ipc/glue/GeckoChildProcessHost.cpp#511: in Destroy, so we would reject because we're shutting down before we even got a chance to complete the utility audio start ?
• https://searchfox.org/mozilla-central/rev/aa3ccd258b64abfd4c5ce56c1f512bc7f65b844c/ipc/glue/GeckoChildProcessHost.cpp#785: in AsyncLaunch promise error handler, but I think we would see some IPC Chromium level log matching, which we dont ?
• https://searchfox.org/mozilla-central/rev/aa3ccd258b64abfd4c5ce56c1f512bc7f65b844c/ipc/glue/GeckoChildProcessHost.cpp#1285: in DoLaunch because of base::LaunchApp failure within https://searchfox.org/mozilla-central/rev/aa3ccd258b64abfd4c5ce56c1f512bc7f65b844c/ipc/chromium/src/base/process_util_mac.mm#40-176

Given the issue at least reproduces on mac and Windows, and is much more present on macOS debug builds, I'd suspect the first one, race at shutdown, especially since this is something we already hit, the mochitest-gl suites ends up starting some audio/video decoders for reasons I cannot remember about, and races because it shutdowns quite quickly.

Comment 23

[Gabriele Svelto [:gsvelto]]

In the crash I can see that both the RDDProcessStatus and UtilityProcess status annotations contain the value Destroyed, could this be a case where we're spinning up a process too late during shutdown?

Comment 24

[Intermittent Failures Robot]

26 failures in 3752 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3
• elm: 1
• autoland: 13
• mozilla-central: 6
• mozilla-beta: 3

Platform and build breakdown:

• macosx1015-64-qr: 24
  • debug: 24
• windows11-32-2009-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-02-27&endday=2023-03-05&tree=all

Comment 25

[:gerard-majax]

Utility process startup failure because of IPC mismatch are also one reason why we can hit this issue.

Comment 26

[Intermittent Failures Robot]

17 failures in 3966 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 15
• mozilla-central: 2

Platform and build breakdown:

• macosx1015-64-qr: 17
  • debug: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-03-06&endday=2023-03-12&tree=all

Comment 27

[Gian-Carlo Pascutto [:gcp]]

We're not working on this until bug 1819311 makes it easier to diagnose, if this is an issue then at worst the regressing bugs can always be backed out.

Comment 28

[Intermittent Failures Robot]

20 failures in 3761 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 17
• try: 1
• mozilla-beta: 1
• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-qr: 19
  • debug: 19
• windows11-64-2009-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-03-13&endday=2023-03-19&tree=all

Comment 29

[Intermittent Failures Robot]

33 failures in 4161 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #47 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 6
• try: 6
• mozilla-beta: 6
• autoland: 15

Platform and build breakdown:

• macosx1015-64-qr: 33
  • debug: 33

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-03-20&endday=2023-03-26&tree=all

Comment 30

[Intermittent Failures Robot]

38 failures in 3863 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #22 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• try: 5
• autoland: 17
• mozilla-central: 14
• mozilla-beta: 2

Platform and build breakdown:

• macosx1015-64-qr: 36
  • debug: 36
• windows11-64-2009-qr: 1
  • debug: 1
• windows11-32-2009-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-03-27&endday=2023-04-02&tree=all

Comment 31

[Intermittent Failures Robot]

21 failures in 3386 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

This is the #43 most frequent failure this week.

Repository breakdown:

• autoland: 10
• try: 5
• mozilla-central: 6

Platform and build breakdown:

• macosx1015-64-qr: 19
  • debug: 19
• windows11-64-2009-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-04-03&endday=2023-04-09&tree=all

Comment 32

[:gerard-majax]

So we have bug 1819311 that is landing, this will remove the assertion, so we should not get anymore of those errors. We will rather monitor telemetry and address the issues there, so I'm going to close that as FIXED.

Comment 33

[Intermittent Failures Robot]

17 failures in 3206 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• mozilla-central: 4
• try: 2
• mozilla-beta: 1

Platform and build breakdown:

• windows11-64-2009-qr: 2
  • debug: 2
• macosx1015-64-qr: 15
  • debug: 15

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-04-10&endday=2023-04-16&tree=all

Comment 34

[Intermittent Failures Robot]

2 failures in 4004 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2

Platform and build breakdown:

• macosx1015-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-04-17&endday=2023-04-23&tree=all

Comment 35

[Intermittent Failures Robot]

3 failures in 3177 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 3

Platform and build breakdown:

• macosx1015-64-qr: 2
  • debug: 2
• windows11-64-2009-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1789126&startday=2023-04-24&endday=2023-04-30&tree=all