1756880 - some individual tests cause MOZ_CRASH to trigger on shutdown (possibly a shutdown hang?)

Status: NEW

(Core :: Audio/Video: Playback, task)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

in Bug 1755075 we are splitting some of the mochitest media manifests- this makes it easier to see some failures and easier to run specific tests.

In running on try, I found that macosx/debug would have a freqent MOZ_CRASH after the last test was run and completed- this is usually a sign of a shutdown hang or failure to cleanup in the right order.

one example of this is a log here (won't live forever):
https://firefoxci.taskcluster-artifacts.net/MIV0QKFMTUGSISzHAtmbQw/0/public/logs/live_backing.log

task 2022-02-13T03:07:55.901Z] 03:07:55     INFO - GECKO(7540) | MEMORY STAT vsizeMaxContiguous not supported in this build configuration.
[task 2022-02-13T03:07:55.901Z] 03:07:55     INFO - GECKO(7540) | MEMORY STAT | vsize 14824MB | residentFast 90MB | heapAllocated 13MB
[task 2022-02-13T03:07:55.925Z] 03:07:55     INFO - TEST-OK | dom/media/test/test_streams_individual_pause.html | took 5861ms
[task 2022-02-13T03:07:55.933Z] 03:07:55     INFO - TEST-START | Shutdown
[task 2022-02-13T03:07:55.933Z] 03:07:55     INFO - Passed:  4
[task 2022-02-13T03:07:55.934Z] 03:07:55     INFO - Failed:  0
[task 2022-02-13T03:07:55.934Z] 03:07:55     INFO - Todo:    0
[task 2022-02-13T03:07:55.935Z] 03:07:55     INFO - Mode:    e10s
[task 2022-02-13T03:07:55.935Z] 03:07:55     INFO - Slowest: 5861ms - /tests/dom/media/test/test_streams_individual_pause.html
[task 2022-02-13T03:07:55.935Z] 03:07:55     INFO - SimpleTest FINISHED
[task 2022-02-13T03:07:55.936Z] 03:07:55     INFO - TEST-INFO | Ran 1 Loops
[task 2022-02-13T03:07:55.936Z] 03:07:55     INFO - SimpleTest FINISHED
[task 2022-02-13T03:07:55.976Z] 03:07:55     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:44
[task 2022-02-13T03:07:55.976Z] 03:07:55     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:44
[task 2022-02-13T03:07:55.980Z] 03:07:55     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:44
[task 2022-02-13T03:07:55.981Z] 03:07:55     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:44
[task 2022-02-13T03:07:55.986Z] 03:07:55     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:44
[task 2022-02-13T03:07:55.987Z] 03:07:55     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:44
[task 2022-02-13T03:07:55.997Z] 03:07:55     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:44
[task 2022-02-13T03:07:56.002Z] 03:07:56     INFO - GECKO(7540) | JavaScript error: resource://gre/modules/AsyncShutdown.jsm, line 575: NotFoundError: No such JSWindowActor 'SpecialPowers'
[task 2022-02-13T03:07:56.061Z] 03:07:56     INFO - GECKO(7540) | 1644721676060	Marionette	TRACE	Received observer notification quit-application
[task 2022-02-13T03:07:56.061Z] 03:07:56     INFO - GECKO(7540) | 1644721676060	Marionette	INFO	Stopped listening on port 2828
[task 2022-02-13T03:07:56.062Z] 03:07:56     INFO - GECKO(7540) | 1644721676061	Marionette	DEBUG	Marionette stopped listening
[task 2022-02-13T03:07:56.105Z] 03:07:56     INFO - GECKO(7540) | JavaScript error: resource://gre/modules/URLQueryStrippingListService.jsm, line 90: TypeError: can't access property "removeEventListener", Services.cpmm.sharedData is null
[task 2022-02-13T03:07:56.105Z] 03:07:56     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: nsAppShell::Exit() called redundantly: file /builds/worker/checkouts/gecko/widget/cocoa/nsAppShell.mm:820
[task 2022-02-13T03:07:56.109Z] 03:07:56     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.111Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, Compositor] WARNING: Possibly dropping task posted to updater thread: file /builds/worker/checkouts/gecko/gfx/layers/apz/src/APZUpdater.cpp:362
[task 2022-02-13T03:07:56.114Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, Socket Thread] WARNING: cannot post event if not initialized: file /builds/worker/checkouts/gecko/netwerk/protocol/http/nsHttpConnectionMgr.cpp:198
[task 2022-02-13T03:07:56.115Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, Socket Thread] WARNING: cannot post event if not initialized: file /builds/worker/checkouts/gecko/netwerk/protocol/http/nsHttpConnectionMgr.cpp:198
[task 2022-02-13T03:07:56.115Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, Socket Thread] WARNING: cannot post event if not initialized: file /builds/worker/checkouts/gecko/netwerk/protocol/http/nsHttpConnectionMgr.cpp:198
[task 2022-02-13T03:07:56.153Z] 03:07:56     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.153Z] 03:07:56     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.190Z] 03:07:56     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.246Z] 03:07:56     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.259Z] 03:07:56     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.262Z] 03:07:56     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp:3354
[task 2022-02-13T03:07:56.264Z] 03:07:56     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.266Z] 03:07:56     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.266Z] 03:07:56     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.267Z] 03:07:56     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.270Z] 03:07:56     INFO - GECKO(7540) | [Child 7543, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp:4460
[task 2022-02-13T03:07:56.381Z] 03:07:56     INFO - GECKO(7540) | [2022-02-13T03:07:56Z WARN  xulstore::persist] tried to remove key that isn't in the store
[task 2022-02-13T03:07:56.381Z] 03:07:56     INFO - GECKO(7540) | [2022-02-13T03:07:56Z WARN  xulstore::persist] tried to remove key that isn't in the store
[task 2022-02-13T03:07:56.400Z] 03:07:56     INFO - GECKO(7540) | JavaScript error: resource://gre/modules/URLQueryStrippingListService.jsm, line 90: TypeError: can't access property "removeEventListener", Services.cpmm.sharedData is null
[task 2022-02-13T03:07:56.401Z] 03:07:56     INFO - GECKO(7540) | [Child 7545, Main Thread] WARNING: nsAppShell::Exit() called redundantly: file /builds/worker/checkouts/gecko/widget/cocoa/nsAppShell.mm:820
[task 2022-02-13T03:07:56.401Z] 03:07:56     INFO - GECKO(7540) | [Child 7541, Main Thread] WARNING: nsAppShell::Exit() called redundantly: file /builds/worker/checkouts/gecko/widget/cocoa/nsAppShell.mm:820
[task 2022-02-13T03:07:56.402Z] 03:07:56     INFO - GECKO(7540) | [Child 7546, Main Thread] WARNING: nsAppShell::Exit() called redundantly: file /builds/worker/checkouts/gecko/widget/cocoa/nsAppShell.mm:820
[task 2022-02-13T03:07:56.403Z] 03:07:56     INFO - GECKO(7540) | [Child 7547, Main Thread] WARNING: nsAppShell::Exit() called redundantly: file /builds/worker/checkouts/gecko/widget/cocoa/nsAppShell.mm:820
[task 2022-02-13T03:07:56.404Z] 03:07:56     INFO - GECKO(7540) | ###!!! [Parent][PImageBridgeParent] Error: RunMessage(msgname=PImageBridge::Msg_WillClose) Channel closing: too late to send/recv, messages will be lost
[task 2022-02-13T03:07:56.412Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: idb: '0.000002s: starting', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.413Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: cache: '0.000450s: starting', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.414Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, Main Thread] WARNING: 'NS_FAILED(queryStatus)', file /builds/worker/checkouts/gecko/toolkit/components/places/History.cpp:2131
[task 2022-02-13T03:07:56.415Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: sdb: '0.000473s: starting', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.415Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: ls: '0.000679s: starting', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.418Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: idb: '0.000756s: Live database entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.418Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: idb: '0.000767s: gLiveDatabaseHashtable entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.418Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: idb: '0.000983s: Live database entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.418Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: idb: '0.000995s: gLiveDatabaseHashtable entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.418Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: idb: '0.001482s: Live database entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.419Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: idb: '0.001494s: gLiveDatabaseHashtable entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.420Z] 03:07:56     INFO - GECKO(7540) | [Child 7545, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp:3354
[task 2022-02-13T03:07:56.421Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: idb: '0.002228s: Live database entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.421Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: idb: '0.002285s: Live database entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.422Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: idb: '0.002294s: gLiveDatabaseHashtable entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.423Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: idb: '0.002333s: completed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.423Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: cache: '0.002366s: completed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.424Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: sdb: '0.002373s: completed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.425Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, IPDL Background] WARNING: ls: '0.002381s: completed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3789
[task 2022-02-13T03:07:56.425Z] 03:07:56     INFO - GECKO(7540) | [Child 7546, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp:3354
[task 2022-02-13T03:07:56.426Z] 03:07:56     INFO - GECKO(7540) | [Child 7547, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp:3354
[task 2022-02-13T03:07:56.426Z] 03:07:56     INFO - GECKO(7540) | [Child 7546, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp:4460
[task 2022-02-13T03:07:56.427Z] 03:07:56     INFO - GECKO(7540) | [Child 7545, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp:4460
[task 2022-02-13T03:07:56.427Z] 03:07:56     INFO - GECKO(7540) | [Child 7547, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp:4460
[task 2022-02-13T03:07:56.446Z] 03:07:56     INFO - GECKO(7540) | [Child 7541, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.446Z] 03:07:56     INFO - GECKO(7540) | [Child 7541, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.483Z] 03:07:56     INFO - GECKO(7540) | [Child 7541, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.541Z] 03:07:56     INFO - GECKO(7540) | [Child 7541, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.552Z] 03:07:56     INFO - GECKO(7540) | [Child 7541, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.555Z] 03:07:56     INFO - GECKO(7540) | [Child 7541, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp:3354
[task 2022-02-13T03:07:56.558Z] 03:07:56     INFO - GECKO(7540) | [Child 7541, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.560Z] 03:07:56     INFO - GECKO(7540) | [Child 7541, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.561Z] 03:07:56     INFO - GECKO(7540) | [Child 7541, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.562Z] 03:07:56     INFO - GECKO(7540) | [Child 7541, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:498
[task 2022-02-13T03:07:56.564Z] 03:07:56     INFO - GECKO(7540) | [Child 7541, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp:4460
[task 2022-02-13T03:07:56.661Z] 03:07:56     INFO - GECKO(7540) | [Parent 7540, Main Thread] WARNING: nsAppShell::Exit() called redundantly: file /builds/worker/checkouts/gecko/widget/cocoa/nsAppShell.mm:820
[task 2022-02-13T03:08:11.242Z] 03:08:11     INFO - GECKO(7540) | console.error: (new Error("SessionFile is closed", "resource:///modules/sessionstore/SessionFile.jsm", 443))
[task 2022-02-13T03:08:43.759Z] 03:08:43     INFO - GECKO(7540) | JavaScript error: resource://gre/modules/CrashManager.jsm, line 898: AbortError: IOUtils: Shutting down and refusing additional I/O tasks
[task 2022-02-13T03:09:52.342Z] 03:09:52     INFO - GECKO(7540) | XPCOM_MEM_BLOAT_LOG: /var/folders/14/2_qpfkwn6s91ybykcsrmr3_8000014/T/tmpmu9vkm4e.mozrunner/runtests_leaks.log
[task 2022-02-13T03:09:52.342Z] 03:09:52     INFO - GECKO(7540) | Writing to log: /var/folders/14/2_qpfkwn6s91ybykcsrmr3_8000014/T/tmpmu9vkm4e.mozrunner/runtests_leaks.log
[task 2022-02-13T03:09:52.343Z] 03:09:52     INFO - GECKO(7540) | RunWatchdog: Mainthread nested event loops during hang:
[task 2022-02-13T03:09:52.343Z] 03:09:52     INFO - GECKO(7540) |  --- CompositorThreadHolder::Shutdown
[task 2022-02-13T03:09:53.394Z] 03:09:53     INFO - GECKO(7540) | Hit MOZ_CRASH(Shutdown hanging after all known phases and workers finished.) at /builds/worker/checkouts/gecko/toolkit/components/terminator/nsTerminator.cpp:256
[task 2022-02-13T03:09:53.397Z] 03:09:53     INFO -  Initializing stack-fixing for the first stack frame, this may take a while...
[task 2022-02-13T03:10:02.509Z] 03:10:02     INFO - GECKO(7540) | #01: mozilla::(anonymous namespace)::RunWatchdog(void*) [toolkit/components/terminator/nsTerminator.cpp:256]
[task 2022-02-13T03:10:02.732Z] 03:10:02     INFO - GECKO(7540) | #02: _pt_root [nsprpub/pr/src/pthreads/ptthread.c:204]
[task 2022-02-13T03:10:02.734Z] 03:10:02     INFO - GECKO(7540) | #03: _pthread_start [/usr/lib/system/libsystem_pthread.dylib + 0x6109]

This was narrowed down to a few tests:
test_streams_srcObject.html - high frequency of hitting this
test_streams_individual_pause.html - lower frequency of hitting this
test_mediaStreamAudioSourceNodeNoGC.html - lower frequency of hitting this

by disabling these 3 tests for macosx/debug, I am able to run the mda job with --rebuild 10 on try server and almost all the time get green for macosx/debug, if orange it is usually a specific test case, not a MOZ_CRASH.