1738987 - Intermittent Assertion failure: ok (corrupt optimized wasm cache file), at /builds/worker/checkouts/gecko/dom/fetch/FetchUtil.cpp:542 | application crashed [@ mozilla::(anonymous namespace)::InputStreamCallbackRunnable::Run()]

Status: RESOLVED FIXED

(Core :: JavaScript: WebAssembly, defect, P2)

Description

[Treeherder Bug Filer]

Filed by: csabou [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=356785612&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/BF-TQCrVSHm11ynBk8Z64g/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-11-02T20:35:23.793Z] 20:35:23     INFO - GECKO(3897) | Assertion failure: ok (corrupt optimized wasm cache file), at /builds/worker/checkouts/gecko/dom/fetch/FetchUtil.cpp:542
[task 2021-11-02T20:35:23.795Z] 20:35:23     INFO - GECKO(3897) | #01: mozilla::dom::JSStreamConsumer::OnInputStreamReady(nsIAsyncInputStream*) [dom/fetch/FetchUtil.cpp:542]
[task 2021-11-02T20:35:23.796Z] 20:35:23     INFO - GECKO(3897) | #02: mozilla::(anonymous namespace)::InputStreamCallbackRunnable::Run() [dom/file/ipc/RemoteLazyInputStream.cpp:55]
[task 2021-11-02T20:35:23.797Z] 20:35:23     INFO - GECKO(3897) | #03: mozilla::(anonymous namespace)::InputStreamCallbackRunnable::Execute(nsIInputStreamCallback*, nsIEventTarget*, mozilla::RemoteLazyInputStream*) [dom/file/ipc/RemoteLazyInputStream.cpp:48]
[task 2021-11-02T20:35:23.798Z] 20:35:23     INFO - GECKO(3897) | #04: mozilla::RemoteLazyInputStream::Close() [dom/file/ipc/RemoteLazyInputStream.cpp:315]
[task 2021-11-02T20:35:23.801Z] 20:35:23     INFO - GECKO(3897) | #05: std::_Function_handler<void (), mozilla::dom::WorkerStreamOwner::Create(nsIAsyncInputStream*, mozilla::dom::WorkerPrivate*, nsCOMPtr<nsIEventTarget>&&)::{lambda()#1}>::_M_invoke(std::_Any_data const&) [/builds/worker/fetches/sysroot-x86_64-linux-gnu/usr/include/c++/7/bits/std_function.h:316]
[task 2021-11-02T20:35:23.802Z] 20:35:23     INFO - GECKO(3897) | #06: mozilla::dom::WorkerRef::Notify() [dom/workers/WorkerRef.cpp:99]
[task 2021-11-02T20:35:23.803Z] 20:35:23     INFO - GECKO(3897) | #07: mozilla::dom::WeakWorkerRef::Notify() [dom/workers/WorkerRef.cpp:134]
[task 2021-11-02T20:35:23.803Z] 20:35:23     INFO - GECKO(3897) | #08: mozilla::dom::WorkerPrivate::NotifyWorkerRefs(mozilla::dom::WorkerStatus) [dom/workers/WorkerPrivate.cpp:3867]
[task 2021-11-02T20:35:23.803Z] 20:35:23     INFO - GECKO(3897) | #09: mozilla::dom::WorkerPrivate::NotifyInternal(mozilla::dom::WorkerStatus) [dom/workers/WorkerPrivate.cpp:4470]
[task 2021-11-02T20:35:23.804Z] 20:35:23     INFO - GECKO(3897) | #10: mozilla::dom::WorkerRunnable::Run() [dom/workers/WorkerRunnable.cpp:378]
[task 2021-11-02T20:35:23.807Z] 20:35:23     INFO - GECKO(3897) | #11: mozilla::dom::WorkerPrivate::ProcessAllControlRunnablesLocked() [dom/workers/WorkerPrivate.cpp:3625]
[task 2021-11-02T20:35:23.807Z] 20:35:23     INFO - GECKO(3897) | #12: mozilla::dom::WorkerPrivate::DoRunLoop(JSContext*) [dom/workers/WorkerPrivate.cpp:2977]
[task 2021-11-02T20:35:23.808Z] 20:35:23     INFO - GECKO(3897) | #13: mozilla::dom::workerinternals::(anonymous namespace)::WorkerThreadPrimaryRunnable::Run() [dom/workers/RuntimeService.cpp:2247]
[task 2021-11-02T20:35:23.808Z] 20:35:23     INFO - GECKO(3897) | #14: nsThread::ProcessNextEvent(bool, bool*) [xpcom/threads/nsThread.cpp:1170]
[task 2021-11-02T20:35:23.808Z] 20:35:23     INFO - GECKO(3897) | #15: NS_ProcessNextEvent(nsIThread*, bool) [xpcom/threads/nsThreadUtils.cpp:467]
[task 2021-11-02T20:35:23.809Z] 20:35:23     INFO - GECKO(3897) | #16: mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) [ipc/glue/MessagePump.cpp:301]
[task 2021-11-02T20:35:23.809Z] 20:35:23     INFO - GECKO(3897) | #17: MessageLoop::RunInternal() [ipc/chromium/src/base/message_loop.cc:331]
[task 2021-11-02T20:35:23.809Z] 20:35:23     INFO - GECKO(3897) | #18: MessageLoop::Run() [ipc/chromium/src/base/message_loop.cc:307]
[task 2021-11-02T20:35:23.809Z] 20:35:23     INFO - GECKO(3897) | #19: nsThread::ThreadFunc(void*) [xpcom/threads/nsThread.cpp:393]
[task 2021-11-02T20:35:23.864Z] 20:35:23     INFO - GECKO(3897) | #20: _pt_root [nsprpub/pr/src/pthreads/ptthread.c:204]
[task 2021-11-02T20:35:23.867Z] 20:35:23     INFO - GECKO(3897) | #21: ??? [/lib/x86_64-linux-gnu/libpthread.so.0 + 0x76db]
[task 2021-11-02T20:35:23.868Z] 20:35:23     INFO - GECKO(3897) | #22: clone [/lib/x86_64-linux-gnu/libc.so.6 + 0x121a3f]
[task 2021-11-02T20:35:23.868Z] 20:35:23     INFO - GECKO(3897) | #23: ??? (???:???)
[task 2021-11-02T20:35:23.956Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer CCE5F0F8A0C649D6.CF1D9DCB53C5E8E8: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:289
[task 2021-11-02T20:35:23.958Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer CCE5F0F8A0C649D6.CF1D9DCB53C5E8E8: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:289
[task 2021-11-02T20:35:23.959Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer CCE5F0F8A0C649D6.CF1D9DCB53C5E8E8: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:289
[task 2021-11-02T20:35:23.959Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer CCE5F0F8A0C649D6.CF1D9DCB53C5E8E8: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:289
[task 2021-11-02T20:35:23.960Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer CCE5F0F8A0C649D6.CF1D9DCB53C5E8E8: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:289
[task 2021-11-02T20:35:23.960Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer CCE5F0F8A0C649D6.CF1D9DCB53C5E8E8: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:289
[task 2021-11-02T20:35:23.960Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer CCE5F0F8A0C649D6.CF1D9DCB53C5E8E8: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:289
[task 2021-11-02T20:35:23.961Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer CCE5F0F8A0C649D6.CF1D9DCB53C5E8E8: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:289
[task 2021-11-02T20:35:23.961Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer CCE5F0F8A0C649D6.CF1D9DCB53C5E8E8: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:289
[task 2021-11-02T20:35:23.963Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer CCE5F0F8A0C649D6.CF1D9DCB53C5E8E8: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:289
[task 2021-11-02T20:35:23.967Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer CCE5F0F8A0C649D6.CF1D9DCB53C5E8E8: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:289
[task 2021-11-02T20:35:23.967Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer CCE5F0F8A0C649D6.CF1D9DCB53C5E8E8: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:289
[task 2021-11-02T20:35:23.967Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer CCE5F0F8A0C649D6.CF1D9DCB53C5E8E8: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:289
[task 2021-11-02T20:35:23.969Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:23.970Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:23.971Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, Main Thread] WARNING: No build ID mismatch: file /builds/worker/checkouts/gecko/dom/base/nsFrameLoader.cpp:3827
[task 2021-11-02T20:35:23.986Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:23.986Z] 20:35:23     INFO - GECKO(3897) | [Parent 3897, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/workspace/obj-build/dist/include/mozilla/ipc/ProtocolUtils.h:317
[task 2021-11-02T20:35:24.034Z] 20:35:24    ERROR - GECKO(3897) | A content process crashed and MOZ_CRASHREPORTER_SHUTDOWN is set, shutting down
[task 2021-11-02T20:35:24.095Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:44
[task 2021-11-02T20:35:24.098Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:44
[task 2021-11-02T20:35:24.114Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:44
[task 2021-11-02T20:35:24.131Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:44
[task 2021-11-02T20:35:24.150Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:44
[task 2021-11-02T20:35:24.152Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:44
[task 2021-11-02T20:35:24.184Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:44
[task 2021-11-02T20:35:24.363Z] 20:35:24     INFO - GECKO(3897) | 1635885324362	Marionette	TRACE	Received observer notification quit-application
[task 2021-11-02T20:35:24.366Z] 20:35:24     INFO - GECKO(3897) | 1635885324363	Marionette	INFO	Stopped listening on port 2828
[task 2021-11-02T20:35:24.368Z] 20:35:24     INFO - GECKO(3897) | 1635885324363	Marionette	DEBUG	Marionette stopped listening
[task 2021-11-02T20:35:24.373Z] 20:35:24     INFO - GECKO(3897) | [Parent 3897, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/workspace/obj-build/dist/include/mozilla/ipc/ProtocolUtils.h:317
[task 2021-11-02T20:35:24.458Z] 20:35:24     INFO - GECKO(3897) | [Parent 3897, Main Thread] WARNING: '!inner', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorProtocol.cpp:184
[task 2021-11-02T20:35:24.460Z] 20:35:24     INFO - GECKO(3897) | [Parent 3897, Main Thread] WARNING: '!inner', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorProtocol.cpp:184
[task 2021-11-02T20:35:24.467Z] 20:35:24     INFO - GECKO(3897) | [Parent 3897, Compositor] WARNING: Possibly dropping task posted to updater thread: file /builds/worker/checkouts/gecko/gfx/layers/apz/src/APZUpdater.cpp:361
[task 2021-11-02T20:35:24.481Z] 20:35:24     INFO - GECKO(3897) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-11-02T20:35:24.487Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:24.521Z] 20:35:24     INFO - GECKO(3897) | [Parent 3897, Main Thread] WARNING: 'aOwner->IsDiscarded()', file /builds/worker/workspace/obj-build/dist/include/mozilla/dom/SyncedContextInlines.h:92
[task 2021-11-02T20:35:24.583Z] 20:35:24     INFO - GECKO(3897) | [Parent 3897, Socket Thread] WARNING: cannot post event if not initialized: file /builds/worker/checkouts/gecko/netwerk/protocol/http/nsHttpConnectionMgr.cpp:197
[task 2021-11-02T20:35:24.583Z] 20:35:24     INFO - GECKO(3897) | [Parent 3897, Socket Thread] WARNING: cannot post event if not initialized: file /builds/worker/checkouts/gecko/netwerk/protocol/http/nsHttpConnectionMgr.cpp:197
[task 2021-11-02T20:35:24.583Z] 20:35:24     INFO - GECKO(3897) | [Parent 3897, Socket Thread] WARNING: cannot post event if not initialized: file /builds/worker/checkouts/gecko/netwerk/protocol/http/nsHttpConnectionMgr.cpp:197
[task 2021-11-02T20:35:24.624Z] 20:35:24     INFO - GECKO(3897) | [2021-11-02T20:35:24Z WARN  xulstore::persist] tried to remove key that isn't in the store
[task 2021-11-02T20:35:24.624Z] 20:35:24     INFO - GECKO(3897) | [2021-11-02T20:35:24Z WARN  xulstore::persist] tried to remove key that isn't in the store
[task 2021-11-02T20:35:24.624Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:24.723Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:24.742Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:24.750Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp:3353
[task 2021-11-02T20:35:24.754Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:24.759Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:24.760Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:24.764Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:24.769Z] 20:35:24     INFO - GECKO(3897) | [Child 3984, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp:4439
[task 2021-11-02T20:35:25.017Z] 20:35:25     INFO - GECKO(3897) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-11-02T20:35:25.021Z] 20:35:25     INFO - GECKO(3897) | [Child 4078, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.045Z] 20:35:25     INFO - GECKO(3897) | [Child 4078, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.052Z] 20:35:25     INFO - GECKO(3897) | [Child 4078, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.058Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: idb: '0.000001s: starting', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.061Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: idb: '0.000088s: Live database entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.061Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: idb: '0.000101s: gLiveDatabaseHashtable entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.062Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: idb: '0.000292s: Live database entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.062Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: idb: '0.000300s: gLiveDatabaseHashtable entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.062Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: cache: '0.000337s: starting', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.062Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: sdb: '0.000344s: starting', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.062Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: ls: '0.000350s: starting', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.064Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: idb: '0.003678s: Live database entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.066Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: idb: '0.003700s: gLiveDatabaseHashtable entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.066Z] 20:35:25     INFO - GECKO(3897) | [Child 4078, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.066Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: idb: '0.009219s: Live database entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.066Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: idb: '0.009286s: Live database entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.068Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: idb: '0.009295s: gLiveDatabaseHashtable entry removed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.069Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: idb: '0.009337s: completed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.070Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: cache: '0.009368s: completed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.071Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: sdb: '0.009374s: completed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.072Z] 20:35:25     INFO - GECKO(3897) | [Parent 3897, IPDL Background] WARNING: ls: '0.009380s: completed', file /builds/worker/checkouts/gecko/dom/quota/ActorsParent.cpp:3819
[task 2021-11-02T20:35:25.073Z] 20:35:25     INFO - GECKO(3897) | [Child 4078, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp:3353
[task 2021-11-02T20:35:25.076Z] 20:35:25     INFO - GECKO(3897) | [Child 4078, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.087Z] 20:35:25     INFO - GECKO(3897) | [Child 4078, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.088Z] 20:35:25     INFO - GECKO(3897) | [Child 4078, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.097Z] 20:35:25     INFO - GECKO(3897) | [Child 4078, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.102Z] 20:35:25     INFO - GECKO(3897) | [Child 4078, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp:4439
[task 2021-11-02T20:35:25.142Z] 20:35:25     INFO - GECKO(3897) | [Child 4036, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.263Z] 20:35:25     INFO - GECKO(3897) | [Child 4036, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.283Z] 20:35:25     INFO - GECKO(3897) | [Child 4036, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.291Z] 20:35:25     INFO - GECKO(3897) | [Child 4036, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp:3353
[task 2021-11-02T20:35:25.296Z] 20:35:25     INFO - GECKO(3897) | [Child 4036, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.301Z] 20:35:25     INFO - GECKO(3897) | [Child 4036, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.301Z] 20:35:25     INFO - GECKO(3897) | [Child 4036, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.303Z] 20:35:25     INFO - GECKO(3897) | [Child 4036, Main Thread] WARNING: IPC message discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:531
[task 2021-11-02T20:35:25.308Z] 20:35:25     INFO - GECKO(3897) | [Child 4036, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp:4439
[task 2021-11-02T20:35:26.118Z] 20:35:26     INFO - GECKO(3897) | [Parent 3897, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp:3353
[task 2021-11-02T20:35:26.155Z] 20:35:26     INFO - GECKO(3897) | [Parent 3897, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp:4439
[task 2021-11-02T20:35:26.179Z] 20:35:26     INFO - TEST-INFO | Main app process: exit 0
[task 2021-11-02T20:35:26.179Z] 20:35:26     INFO - runtests.py | Application ran for: 0:00:20.717844
[task 2021-11-02T20:35:26.179Z] 20:35:26     INFO - zombiecheck | Reading PID log: /tmp/tmp_x0t91fdpidlog
[task 2021-11-02T20:35:26.179Z] 20:35:26     INFO - ==> process 3897 launched child process 3915
[task 2021-11-02T20:35:26.179Z] 20:35:26     INFO - ==> process 3897 launched child process 3965
[task 2021-11-02T20:35:26.179Z] 20:35:26     INFO - ==> process 3897 launched child process 3984
[task 2021-11-02T20:35:26.179Z] 20:35:26     INFO - ==> process 3897 launched child process 4036
[task 2021-11-02T20:35:26.179Z] 20:35:26     INFO - ==> process 3897 launched child process 4078
[task 2021-11-02T20:35:26.179Z] 20:35:26     INFO - zombiecheck | Checking for orphan process with PID: 4036
[task 2021-11-02T20:35:26.179Z] 20:35:26     INFO - zombiecheck | Checking for orphan process with PID: 3915
[task 2021-11-02T20:35:26.179Z] 20:35:26     INFO - zombiecheck | Checking for orphan process with PID: 4078
[task 2021-11-02T20:35:26.179Z] 20:35:26     INFO - zombiecheck | Checking for orphan process with PID: 3984
[task 2021-11-02T20:35:26.179Z] 20:35:26     INFO - zombiecheck | Checking for orphan process with PID: 3965
[task 2021-11-02T20:35:26.179Z] 20:35:26     INFO - mozcrash Copy/paste: /builds/worker/fetches/minidump_stackwalk/minidump_stackwalk /tmp/tmpjdcphij2.mozrunner/minidumps/2b99d4c6-9fbd-d8c6-2abe-8153ff9c3d70.dmp /builds/worker/workspace/build/symbols https://symbols.mozilla.org/
[task 2021-11-02T20:35:30.601Z] 20:35:30     INFO - mozcrash Saved minidump as /builds/worker/workspace/build/blobber_upload_dir/2b99d4c6-9fbd-d8c6-2abe-8153ff9c3d70.dmp
[task 2021-11-02T20:35:30.602Z] 20:35:30     INFO - mozcrash Saved app info as /builds/worker/workspace/build/blobber_upload_dir/2b99d4c6-9fbd-d8c6-2abe-8153ff9c3d70.extra
[task 2021-11-02T20:35:30.696Z] 20:35:30     INFO - PROCESS-CRASH | Main app process exited normally | application crashed [@ mozilla::(anonymous namespace)::InputStreamCallbackRunnable::Run()]
[task 2021-11-02T20:35:30.696Z] 20:35:30     INFO - Mozilla crash reason: MOZ_DIAGNOSTIC_ASSERT(ok) (corrupt optimized wasm cache file)
[task 2021-11-02T20:35:30.696Z] 20:35:30     INFO - Crash dump filename: /tmp/tmpjdcphij2.mozrunner/minidumps/2b99d4c6-9fbd-d8c6-2abe-8153ff9c3d70.dmp
[task 2021-11-02T20:35:30.697Z] 20:35:30     INFO - Operating system: Linux
[task 2021-11-02T20:35:30.698Z] 20:35:30     INFO -                   0.0.0 Linux 4.4.0-1014-aws #14taskcluster1-Ubuntu SMP Tue Apr 3 10:27:00 UTC 2018 x86_64
[task 2021-11-02T20:35:30.698Z] 20:35:30     INFO - CPU: amd64
[task 2021-11-02T20:35:30.698Z] 20:35:30     INFO -      family 6 model 85 stepping 4
[task 2021-11-02T20:35:30.698Z] 20:35:30     INFO -      2 CPUs
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO - 
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO - GPU: UNKNOWN
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO - 
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO - Crash reason:  SIGSEGV / SEGV_MAPERR
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO - Crash address: 0x0
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO - Process uptime: not available
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO - 
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO - Thread 23 tid 4100 (crashed) - DOM Worker 0  libxul.so!mozilla::dom::JSStreamConsumer::OnInputStreamReady(nsIAsyncInputStream*) [FetchUtil.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 542 + 0x29]
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO -     rax = 0x00007f70db61a90f   rdx = 0x0000000000000000
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO -     rcx = 0x00005631a9d8e850   rbx = 0x00007f70d24ff301
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO -     rsi = 0x00007f70ef68f8b0   rdi = 0x00007f70ef68e680
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO -     rbp = 0x00007f70d24ff340   rsp = 0x00007f70d24ff300
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO -      r8 = 0x00007f70ef68f8b0    r9 = 0x00007f70d2500700
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO -     r10 = 0x0000000000000000   r11 = 0x0000000000000000
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO -     r12 = 0x00007f70d36ec500   r13 = 0x00007f70d36c36b0
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO -     r14 = 0x00007f70d33efb50   r15 = 0x00007f70d36ec500
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO -     rip = 0x00007f70e0960255
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO -     Found by: given as instruction pointer in context
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO -  1  libxul.so!mozilla::(anonymous namespace)::InputStreamCallbackRunnable::Run() [RemoteLazyInputStream.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 54 + 0x19]
[task 2021-11-02T20:35:30.699Z] 20:35:30     INFO -     rbx = 0x00007f70d36c3680   rbp = 0x00007f70d24ff370
[task 2021-11-02T20:35:30.700Z] 20:35:30     INFO -     rsp = 0x00007f70d24ff350   r12 = 0x00007f70d33efb50
[task 2021-11-02T20:35:30.700Z] 20:35:30     INFO -     r13 = 0x00007f70d36c36b0   r14 = 0x00007f70d36c36b0
[task 2021-11-02T20:35:30.700Z] 20:35:30     INFO -     r15 = 0x00007f70d36ec500   rip = 0x00007f70e098661f
[task 2021-11-02T20:35:30.700Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.700Z] 20:35:30     INFO -  2  libxul.so!mozilla::(anonymous namespace)::InputStreamCallbackRunnable::Execute(nsIInputStreamCallback*, nsIEventTarget*, mozilla::RemoteLazyInputStream*) [RemoteLazyInputStream.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 48 + 0x8]
[task 2021-11-02T20:35:30.700Z] 20:35:30     INFO -     rbx = 0x00007f70d36c3680   rbp = 0x00007f70d24ff3c0
[task 2021-11-02T20:35:30.700Z] 20:35:30     INFO -     rsp = 0x00007f70d24ff380   r12 = 0x00007f70d33efb50
[task 2021-11-02T20:35:30.700Z] 20:35:30     INFO -     r13 = 0x00007f70d36c36b0   r14 = 0x0000000000000000
[task 2021-11-02T20:35:30.701Z] 20:35:30     INFO -     r15 = 0x00007f70d36ec500   rip = 0x00007f70e097f212
[task 2021-11-02T20:35:30.701Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.701Z] 20:35:30     INFO -  3  libxul.so!mozilla::RemoteLazyInputStream::Close() [RemoteLazyInputStream.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 311 + 0x8]
[task 2021-11-02T20:35:30.701Z] 20:35:30     INFO -     rbx = 0x00007f70d36ec500   rbp = 0x00007f70d24ff410
[task 2021-11-02T20:35:30.701Z] 20:35:30     INFO -     rsp = 0x00007f70d24ff3d0   r12 = 0x0000000000000003
[task 2021-11-02T20:35:30.701Z] 20:35:30     INFO -     r13 = 0x00007f70d3658218   r14 = 0x00007f70d36ec5b8
[task 2021-11-02T20:35:30.701Z] 20:35:30     INFO -     r15 = 0x00007f70d24ff3d8   rip = 0x00007f70e097e2f6
[task 2021-11-02T20:35:30.701Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.701Z] 20:35:30     INFO -  4  libxul.so!std::_Function_handler<void (), mozilla::dom::WorkerStreamOwner::Create(nsIAsyncInputStream*, mozilla::dom::WorkerPrivate*, nsCOMPtr<nsIEventTarget>&&)::{lambda()#1}>::_M_invoke(std::_Any_data const&) [std_function.h : 316 + 0x2f]
[task 2021-11-02T20:35:30.701Z] 20:35:30     INFO -     rbx = 0x00007f70d33dffb0   rbp = 0x00007f70d24ff430
[task 2021-11-02T20:35:30.701Z] 20:35:30     INFO -     rsp = 0x00007f70d24ff420   r12 = 0x0000000000000003
[task 2021-11-02T20:35:30.701Z] 20:35:30     INFO -     r13 = 0x00007f70d3658218   r14 = 0x00007f70d36666b8
[task 2021-11-02T20:35:30.702Z] 20:35:30     INFO -     r15 = 0x00007f70d24ff4b0   rip = 0x00007f70e096332d
[task 2021-11-02T20:35:30.702Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.702Z] 20:35:30     INFO -  5  libxul.so!mozilla::dom::WorkerRef::Notify() [WorkerRef.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 98 + 0x5]
[task 2021-11-02T20:35:30.702Z] 20:35:30     INFO -     rbx = 0x00007f70d33dffb0   rbp = 0x00007f70d24ff480
[task 2021-11-02T20:35:30.703Z] 20:35:30     INFO -     rsp = 0x00007f70d24ff440   r12 = 0x0000000000000003
[task 2021-11-02T20:35:30.703Z] 20:35:30     INFO -     r13 = 0x00007f70d3658218   r14 = 0x00007f70d24ff440
[task 2021-11-02T20:35:30.704Z] 20:35:30     INFO -     r15 = 0x00007f70d24ff4b0   rip = 0x00007f70e132eb09
[task 2021-11-02T20:35:30.704Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.704Z] 20:35:30     INFO -  6  libxul.so!mozilla::dom::WeakWorkerRef::Notify() [WorkerRef.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 133 + 0x8]
[task 2021-11-02T20:35:30.705Z] 20:35:30     INFO -     rbx = 0x00007f70d33dffb0   rbp = 0x00007f70d24ff4a0
[task 2021-11-02T20:35:30.705Z] 20:35:30     INFO -     rsp = 0x00007f70d24ff490   r12 = 0x0000000000000003
[task 2021-11-02T20:35:30.705Z] 20:35:30     INFO -     r13 = 0x00007f70d3658218   r14 = 0x00007f70d3658200
[task 2021-11-02T20:35:30.705Z] 20:35:30     INFO -     r15 = 0x00007f70d24ff4b0   rip = 0x00007f70e132ed23
[task 2021-11-02T20:35:30.706Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.706Z] 20:35:30     INFO -  7  libxul.so!mozilla::dom::WorkerPrivate::NotifyWorkerRefs(mozilla::dom::WorkerStatus) [WorkerPrivate.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 3868 + 0x6]
[task 2021-11-02T20:35:30.706Z] 20:35:30     INFO -     rbx = 0x00007f70d24ff4b0   rbp = 0x00007f70d24ff540
[task 2021-11-02T20:35:30.706Z] 20:35:30     INFO -     rsp = 0x00007f70d24ff4b0   r12 = 0x0000000000000003
[task 2021-11-02T20:35:30.706Z] 20:35:30     INFO -     r13 = 0x00007f70d3658218   r14 = 0x00007f70d3658200
[task 2021-11-02T20:35:30.706Z] 20:35:30     INFO -     r15 = 0x00007f70d24ff4b0   rip = 0x00007f70e1324d4e
[task 2021-11-02T20:35:30.706Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.706Z] 20:35:30     INFO -  8  libxul.so!mozilla::dom::WorkerPrivate::NotifyInternal(mozilla::dom::WorkerStatus) [WorkerPrivate.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 4470 + 0xb]
[task 2021-11-02T20:35:30.707Z] 20:35:30     INFO -     rbx = 0x0000000000000001   rbp = 0x00007f70d24ff5a0
[task 2021-11-02T20:35:30.707Z] 20:35:30     INFO -     rsp = 0x00007f70d24ff550   r12 = 0x00007f70d3658200
[task 2021-11-02T20:35:30.707Z] 20:35:30     INFO -     r13 = 0x00007f70d3658218   r14 = 0x0000000000000003
[task 2021-11-02T20:35:30.707Z] 20:35:30     INFO -     r15 = 0x00007f70d36586f0   rip = 0x00007f70e1325c80
[task 2021-11-02T20:35:30.707Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.707Z] 20:35:30     INFO -  9  libxul.so!mozilla::dom::WorkerRunnable::Run() [WorkerRunnable.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 378 + 0x14]
[task 2021-11-02T20:35:30.707Z] 20:35:30     INFO -     rbx = 0x00007f70d33fa380   rbp = 0x00007f70d24ff740
[task 2021-11-02T20:35:30.707Z] 20:35:30     INFO -     rsp = 0x00007f70d24ff5b0   r12 = 0xaaaaaaaaaaaaaaaa
[task 2021-11-02T20:35:30.707Z] 20:35:30     INFO -     r13 = 0x00000000d3209701   r14 = 0x00007f70d24ff5f8
[task 2021-11-02T20:35:30.708Z] 20:35:30     INFO -     r15 = 0x00007f70d4d27600   rip = 0x00007f70e132ffdd
[task 2021-11-02T20:35:30.708Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.708Z] 20:35:30     INFO - 10  libxul.so!mozilla::dom::WorkerPrivate::ProcessAllControlRunnablesLocked() [WorkerPrivate.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 3625 + 0x6]
[task 2021-11-02T20:35:30.708Z] 20:35:30     INFO -     rbx = 0x0000000000000000   rbp = 0x00007f70d24ff790
[task 2021-11-02T20:35:30.708Z] 20:35:30     INFO -     rsp = 0x00007f70d24ff750   r12 = 0x00007f70d24ff750
[task 2021-11-02T20:35:30.708Z] 20:35:30     INFO -     r13 = 0x00007f70d3209740   r14 = 0x00007f70d3658218
[task 2021-11-02T20:35:30.708Z] 20:35:30     INFO -     r15 = 0x00007f70d3658578   rip = 0x00007f70e1325a0e
[task 2021-11-02T20:35:30.708Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.708Z] 20:35:30     INFO - 11  libxul.so!mozilla::dom::WorkerPrivate::DoRunLoop(JSContext*) [WorkerPrivate.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 2976 + 0x8]
[task 2021-11-02T20:35:30.709Z] 20:35:30     INFO -     rbx = 0x0000000000000000   rbp = 0x00007f70d24ff880
[task 2021-11-02T20:35:30.709Z] 20:35:30     INFO -     rsp = 0x00007f70d24ff7a0   r12 = 0x00007f70d3658200
[task 2021-11-02T20:35:30.709Z] 20:35:30     INFO -     r13 = 0x00007f70d3658620   r14 = 0x0000000000000000
[task 2021-11-02T20:35:30.709Z] 20:35:30     INFO -     r15 = 0x0000000000000000   rip = 0x00007f70e13250ed
[task 2021-11-02T20:35:30.709Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.709Z] 20:35:30     INFO - 12  libxul.so!mozilla::dom::workerinternals::(anonymous namespace)::WorkerThreadPrimaryRunnable::Run() [RuntimeService.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 2244 + 0xd]
[task 2021-11-02T20:35:30.709Z] 20:35:30     INFO -     rbx = 0x000000000000000f   rbp = 0x00007f70d24ff9f0
[task 2021-11-02T20:35:30.710Z] 20:35:30     INFO -     rsp = 0x00007f70d24ff890   r12 = 0x00007f70d322d780
[task 2021-11-02T20:35:30.710Z] 20:35:30     INFO -     r13 = 0x00007f70d4d27600   r14 = 0x000000000000000f
[task 2021-11-02T20:35:30.710Z] 20:35:30     INFO -     r15 = 0x0000000080004005   rip = 0x00007f70e130bddd
[task 2021-11-02T20:35:30.710Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.710Z] 20:35:30     INFO - 13  libxul.so!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 1169 + 0x11]
[task 2021-11-02T20:35:30.710Z] 20:35:30     INFO -     rbx = 0x00007f70d24ffaa0   rbp = 0x00007f70d24ffb30
[task 2021-11-02T20:35:30.711Z] 20:35:30     INFO -     rsp = 0x00007f70d24ffa00   r12 = 0x00007f70d24ffa30
[task 2021-11-02T20:35:30.711Z] 20:35:30     INFO -     r13 = 0x00007f70d335a330   r14 = 0x00007f70d335a200
[task 2021-11-02T20:35:30.712Z] 20:35:30     INFO -     r15 = 0xaaaaaaaaaaaaaaaa   rip = 0x00007f70de6b10de
[task 2021-11-02T20:35:30.712Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.712Z] 20:35:30     INFO - 14  libxul.so!NS_ProcessNextEvent(nsIThread*, bool) [nsThreadUtils.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 467 + 0xc]
[task 2021-11-02T20:35:30.713Z] 20:35:30     INFO -     rbx = 0x0000000000000000   rbp = 0x00007f70d24ffb60
[task 2021-11-02T20:35:30.713Z] 20:35:30     INFO -     rsp = 0x00007f70d24ffb40   r12 = 0x00007f70d24ffb78
[task 2021-11-02T20:35:30.713Z] 20:35:30     INFO -     r13 = 0x00007f70d322d6e0   r14 = 0x00007f70d24ffb47
[task 2021-11-02T20:35:30.713Z] 20:35:30     INFO -     r15 = 0x00007f70d335a200   rip = 0x00007f70de6b5a92
[task 2021-11-02T20:35:30.714Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.714Z] 20:35:30     INFO - 15  libxul.so!mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) [MessagePump.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 300 + 0xa]
[task 2021-11-02T20:35:30.714Z] 20:35:30     INFO -     rbx = 0x00007f70d24ffc68   rbp = 0x00007f70d24ffbb0
[task 2021-11-02T20:35:30.714Z] 20:35:30     INFO -     rsp = 0x00007f70d24ffb70   r12 = 0x00007f70d24ffb78
[task 2021-11-02T20:35:30.715Z] 20:35:30     INFO -     r13 = 0x00007f70d322d6e0   r14 = 0x00007f70d322d6c0
[task 2021-11-02T20:35:30.715Z] 20:35:30     INFO -     r15 = 0x00007f70d335a200   rip = 0x00007f70ded4d870
[task 2021-11-02T20:35:30.715Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.715Z] 20:35:30     INFO - 16  libxul.so!MessageLoop::RunInternal() [message_loop.cc:70ccbb2ebc815abd7c094fb09f397753a984e028 : 331 + 0x17]
[task 2021-11-02T20:35:30.715Z] 20:35:30     INFO -     rbx = 0x00007f70d24ffc68   rbp = 0x00007f70d24ffbf0
[task 2021-11-02T20:35:30.716Z] 20:35:30     INFO -     rsp = 0x00007f70d24ffbc0   r12 = 0x00007f70d24ffc68
[task 2021-11-02T20:35:30.716Z] 20:35:30     INFO -     r13 = 0x00007f70d335a200   r14 = 0x00007f70d24ffc00
[task 2021-11-02T20:35:30.716Z] 20:35:30     INFO -     r15 = 0x00007f70d335a250   rip = 0x00007f70decea73f
[task 2021-11-02T20:35:30.717Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.717Z] 20:35:30     INFO - 17  libxul.so!MessageLoop::Run() [message_loop.cc:70ccbb2ebc815abd7c094fb09f397753a984e028 : 306 + 0x8]
[task 2021-11-02T20:35:30.717Z] 20:35:30     INFO -     rbx = 0x00007f70d24ffc68   rbp = 0x00007f70d24ffc30
[task 2021-11-02T20:35:30.717Z] 20:35:30     INFO -     rsp = 0x00007f70d24ffc00   r12 = 0x00007f70d24ffc68
[task 2021-11-02T20:35:30.717Z] 20:35:30     INFO -     r13 = 0x00007f70d335a200   r14 = 0x00007f70d24ffc00
[task 2021-11-02T20:35:30.720Z] 20:35:30     INFO -     r15 = 0x00007f70d335a250   rip = 0x00007f70decea699
[task 2021-11-02T20:35:30.724Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.725Z] 20:35:30     INFO - 18  libxul.so!nsThread::ThreadFunc(void*) [nsThread.cpp:70ccbb2ebc815abd7c094fb09f397753a984e028 : 391 + 0x8]
[task 2021-11-02T20:35:30.725Z] 20:35:30     INFO -     rbx = 0x000000000000000a   rbp = 0x00007f70d24ffe60
[task 2021-11-02T20:35:30.726Z] 20:35:30     INFO -     rsp = 0x00007f70d24ffc40   r12 = 0x00007f70d24ffc68
[task 2021-11-02T20:35:30.727Z] 20:35:30     INFO -     r13 = 0x00007f70d335a200   r14 = 0x00007f70d335a258
[task 2021-11-02T20:35:30.727Z] 20:35:30     INFO -     r15 = 0x00007f70d335a250   rip = 0x00007f70de6adfba
[task 2021-11-02T20:35:30.728Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.728Z] 20:35:30     INFO - 19  libnspr4.so!_pt_root [ptthread.c:70ccbb2ebc815abd7c094fb09f397753a984e028 : 201 + 0x7]
[task 2021-11-02T20:35:30.729Z] 20:35:30     INFO -     rbx = 0x00007f70d99b6ee0   rbp = 0x00007f70d24ffeb0
[task 2021-11-02T20:35:30.729Z] 20:35:30     INFO -     rsp = 0x00007f70d24ffe70   r12 = 0x00007f70d2500630
[task 2021-11-02T20:35:30.730Z] 20:35:30     INFO -     r13 = 0x0000000000000002   r14 = 0x0000000000001004
[task 2021-11-02T20:35:30.730Z] 20:35:30     INFO -     r15 = 0x00007f70d2500700   rip = 0x00007f70f05cc53f
[task 2021-11-02T20:35:30.731Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.731Z] 20:35:30     INFO - 20  libpthread.so.0 + 0x76db
[task 2021-11-02T20:35:30.731Z] 20:35:30     INFO -     rbx = 0x0000000000000000   rbp = 0x0000000000000000
[task 2021-11-02T20:35:30.731Z] 20:35:30     INFO -     rsp = 0x00007f70d24ffec0   r12 = 0x00007f70d24fff80
[task 2021-11-02T20:35:30.732Z] 20:35:30     INFO -     r13 = 0x0000000000000000   r14 = 0x00007f70d99b6ee0
[task 2021-11-02T20:35:30.732Z] 20:35:30     INFO -     r15 = 0x00007ffdf83e0be0   rip = 0x00007f70f01dd6db
[task 2021-11-02T20:35:30.732Z] 20:35:30     INFO -     Found by: call frame info
[task 2021-11-02T20:35:30.732Z] 20:35:30     INFO - 21  libc.so.6 + 0x121a3f
[task 2021-11-02T20:35:30.733Z] 20:35:30     INFO -     rsp = 0x00007f70d24fff80   rip = 0x00007f70ef3c3a3f
[task 2021-11-02T20:35:30.733Z] 20:35:30     INFO -     Found by: stack scanning

Comment 1

[Yury Delendik (:yury)]

This time, the reason is different from bug 1737837 .

After instrumentation I got https://treeherder.mozilla.org/jobs?repo=try&revision=6de4ec4a480462cef50680a21aaa23207c02879d&selectedTaskRun=R6Z5ZVnARnmsW20DeYTGWQ.0

Means that OnInputStreamReady gets available == 0 before sending any information and calling WriteSegment above. It has timing issue with writing alt data into the cache and reading it back (?).

Comment 3

[Intermittent Failures Robot]

21 failures in 510 pushes (0.041 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 6
• mozilla-beta: 1

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 3
  • debug: 3
• linux1804-64-tsan-qr: 2
  • opt: 2
• linux1804-64-qr: 5
  • debug: 4
  • opt: 1
• android-em-7-0-x86_64-qr: 8
  • debug: 8
• linux1804-64-shippable-qr: 1
  • opt: 1
• linux1804-64-devedition-qr: 1
  • opt: 1
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-05&endday=2021-11-05&tree=all

Comment 4

[Intermittent Failures Robot]

69 failures in 3030 pushes (0.023 failures/push) were associated with this bug in the last 7 days.

This is the #10 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 18
• try: 1
• autoland: 48
• mozilla-beta: 2

Platform and build breakdown:

• linux1804-64-qr: 23
  • debug: 14
  • opt: 9
• linux1804-64-devedition-qr: 3
  • opt: 3
• android-em-7-0-x86_64-lite-qr: 10
  • debug: 10
• linux1804-64-shippable-qr: 6
  • opt: 6
• android-em-7-0-x86_64-qr: 18
  • debug: 18
• linux1804-64-tsan-qr: 7
  • opt: 7
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-01&endday=2021-11-07&tree=all

Comment 6

[Intermittent Failures Robot]

16 failures in 566 pushes (0.028 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 7
• try: 3
• autoland: 6

Platform and build breakdown:

• linux1804-64-shippable-qr: 3
  • opt: 3
• linux1804-64-ccov-qr: 1
  • opt: 1
• android-em-7-0-x86_64-qr: 5
  • debug: 5
• android-em-7-0-x86_64-lite-qr: 3
  • debug: 3
• linux1804-64-qr: 3
  • opt: 1
  • debug: 2
• windows10-64-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-08&endday=2021-11-08&tree=all

Comment 7

[Intermittent Failures Robot]

25 failures in 657 pushes (0.038 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 19
• mozilla-central: 6

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 2
  • debug: 2
• android-em-7-0-x86_64-qr: 8
  • debug: 8
• linux1804-64-qr: 6
  • debug: 6
• linux1804-64-shippable-qr: 3
  • opt: 3
• linux1804-64-tsan-qr: 2
  • opt: 2
• linux1804-64-asan-qr: 3
  • opt: 3
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-09&endday=2021-11-09&tree=all

Comment 8

[Intermittent Failures Robot]

17 failures in 449 pushes (0.038 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 11
• mozilla-central: 6

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 6
  • debug: 6
• linux1804-64-qr: 6
  • debug: 3
  • opt: 3
• linux1804-64-ccov-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 1
  • opt: 1
• linux1804-64-tsan-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-11&endday=2021-11-11&tree=all

Comment 9

[Iulian Moraru]

Update:
There have been 114 failures within the last 7 days:
• 15 failures on android-em-7-0-x86_64-lite-qr debug
• 38 failures on Android 7.0 x86-64 WebRender debug
• 5 failures on Linux 18.04 x64 WebRender asan opt
• 4 failures on Linux 18.04 x64 CCov WebRender opt
• 10 failures on Linux 18.04 x64 WebRender opt
• 21 failures on Linux 18.04 x64 WebRender debug
• 11 failures on Linux 18.04 x64 WebRender Shippable opt
• 8 failures on linux1804-64-tsan-qr opt
• 1 failures on OS X 10.15 WebRender debug
• 1 failures on Windows 10 x64 2004 WebRender debug
Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=357885741&repo=autoland&lineNumber=2565

[task 2021-11-12T15:49:03.866Z] 15:49:03     INFO -  TEST-START | dom/promise/tests/test_webassembly_compile.html
[task 2021-11-12T15:49:24.090Z] 15:49:24     INFO -  wait for org.mozilla.geckoview.test_runner complete; top activity=com.android.launcher3
[task 2021-11-12T15:49:24.091Z] 15:49:24     INFO -  runtestsremote.py | Application ran for: 0:00:35.939729
[task 2021-11-12T15:49:24.201Z] 15:49:24     INFO -  mozcrash Copy/paste: /builds/worker/fetches/minidump_stackwalk/minidump_stackwalk /tmp/tmp1v04j69o/71b3cc6f-6e5e-826c-71e0-bc6d3be0bd4e.dmp /builds/worker/workspace/build/symbols https://symbols.mozilla.org/
[task 2021-11-12T15:49:30.668Z] 15:49:30     INFO -  mozcrash Saved minidump as /builds/worker/workspace/build/blobber_upload_dir/71b3cc6f-6e5e-826c-71e0-bc6d3be0bd4e.dmp
[task 2021-11-12T15:49:30.669Z] 15:49:30     INFO -  mozcrash Saved app info as /builds/worker/workspace/build/blobber_upload_dir/71b3cc6f-6e5e-826c-71e0-bc6d3be0bd4e.extra
[task 2021-11-12T15:49:30.675Z] 15:49:30  WARNING -  PROCESS-CRASH | dom/promise/tests/test_webassembly_compile.html | application crashed [@ mozilla::(anonymous namespace)::InputStreamCallbackRunnable::Run()]
[task 2021-11-12T15:49:30.675Z] 15:49:30     INFO -  Mozilla crash reason: MOZ_DIAGNOSTIC_ASSERT(ok) (corrupt optimized wasm cache file)
[task 2021-11-12T15:49:30.675Z] 15:49:30     INFO -  Crash dump filename: /tmp/tmp1v04j69o/71b3cc6f-6e5e-826c-71e0-bc6d3be0bd4e.dmp
[task 2021-11-12T15:49:30.675Z] 15:49:30     INFO -  Operating system: Android
[task 2021-11-12T15:49:30.676Z] 15:49:30     INFO -                    0.0.0 Linux 3.10.0+ #260 SMP PREEMPT Fri May 19 12:48:14 PDT 2017 x86_64
[task 2021-11-12T15:49:30.676Z] 15:49:30     INFO -  CPU: amd64
[task 2021-11-12T15:49:30.676Z] 15:49:30     INFO -       family 6 model 6 stepping 3
[task 2021-11-12T15:49:30.676Z] 15:49:30     INFO -       4 CPUs
[task 2021-11-12T15:49:30.676Z] 15:49:30     INFO -  GPU: UNKNOWN
[task 2021-11-12T15:49:30.676Z] 15:49:30     INFO -  Crash reason:  SIGSEGV / SEGV_MAPERR
[task 2021-11-12T15:49:30.676Z] 15:49:30     INFO -  Crash address: 0x0
[task 2021-11-12T15:49:30.677Z] 15:49:30     INFO -  Process uptime: not available
[task 2021-11-12T15:49:30.677Z] 15:49:30     INFO -  Thread 32 tid 9066 (crashed) 0  libxul.so!mozilla::dom::JSStreamConsumer::OnInputStreamReady(nsIAsyncInputStream*) [FetchUtil.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 542 + 0x29]
[task 2021-11-12T15:49:30.677Z] 15:49:30     INFO -      rax = 0x000071b3bd716d54   rdx = 0x0000000000000004
[task 2021-11-12T15:49:30.677Z] 15:49:30     INFO -      rcx = 0x000071b3c1180c50   rbx = 0x000071b3ae1fe801
[task 2021-11-12T15:49:30.677Z] 15:49:30     INFO -      rsi = 0x000071b3ae1fd760   rdi = 0x000000000000001b
[task 2021-11-12T15:49:30.678Z] 15:49:30     INFO -      rbp = 0x000071b3ae1fe8c0   rsp = 0x000071b3ae1fe880
[task 2021-11-12T15:49:30.678Z] 15:49:30     INFO -       r8 = 0x000000000000ffff    r9 = 0x0000000000000000
[task 2021-11-12T15:49:30.678Z] 15:49:30     INFO -      r10 = 0x000071b3de9d63d0   r11 = 0x0000000000000246
[task 2021-11-12T15:49:30.678Z] 15:49:30     INFO -      r12 = 0x000071b3ae3be020   r13 = 0x000071b3d924ce00
[task 2021-11-12T15:49:30.678Z] 15:49:30     INFO -      r14 = 0x000071b3afa04600   r15 = 0x000071b3afa04600
[task 2021-11-12T15:49:30.679Z] 15:49:30     INFO -      rip = 0x000071b3b827569b
[task 2021-11-12T15:49:30.679Z] 15:49:30     INFO -      Found by: given as instruction pointer in context
[task 2021-11-12T15:49:30.679Z] 15:49:30     INFO -   1  libxul.so!mozilla::(anonymous namespace)::InputStreamCallbackRunnable::Run() [RemoteLazyInputStream.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 54 + 0x1d]
[task 2021-11-12T15:49:30.679Z] 15:49:30     INFO -      rbp = 0x000071b3ae1fe8e0   rsp = 0x000071b3ae1fe8d0
[task 2021-11-12T15:49:30.679Z] 15:49:30     INFO -      rip = 0x000071b3b8298fab
[task 2021-11-12T15:49:30.680Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.680Z] 15:49:30     INFO -   2  libxul.so!mozilla::(anonymous namespace)::InputStreamCallbackRunnable::Execute(nsIInputStreamCallback*, nsIEventTarget*, mozilla::RemoteLazyInputStream*) [RemoteLazyInputStream.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 48 + 0x8]
[task 2021-11-12T15:49:30.680Z] 15:49:30     INFO -      rbp = 0x000071b3ae1fe920   rsp = 0x000071b3ae1fe8f0
[task 2021-11-12T15:49:30.680Z] 15:49:30     INFO -      rip = 0x000071b3b829273d
[task 2021-11-12T15:49:30.680Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.681Z] 15:49:30     INFO -   3  libxul.so!mozilla::RemoteLazyInputStream::Close() [RemoteLazyInputStream.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 311 + 0x8]
[task 2021-11-12T15:49:30.681Z] 15:49:30     INFO -      rbp = 0x000071b3ae1fe970   rsp = 0x000071b3ae1fe930
[task 2021-11-12T15:49:30.681Z] 15:49:30     INFO -      rip = 0x000071b3b829196c
[task 2021-11-12T15:49:30.681Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.682Z] 15:49:30     INFO -   4  libxul.so!mozilla::dom::WorkerStreamOwner::Create(nsIAsyncInputStream*, mozilla::dom::WorkerPrivate*, nsCOMPtr<nsIEventTarget>&&)::{lambda()#1}::operator()() const [FetchUtil.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 303 + 0x1a]
[task 2021-11-12T15:49:30.682Z] 15:49:30     INFO -      rbp = 0x000071b3ae1fe990   rsp = 0x000071b3ae1fe980
[task 2021-11-12T15:49:30.682Z] 15:49:30     INFO -      rip = 0x000071b3b8278844
[task 2021-11-12T15:49:30.682Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.683Z] 15:49:30     INFO -   5  libxul.so!mozilla::dom::WorkerRef::Notify() [WorkerRef.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 98 + 0x8]
[task 2021-11-12T15:49:30.683Z] 15:49:30     INFO -      rbp = 0x000071b3ae1fe9e0   rsp = 0x000071b3ae1fe9a0
[task 2021-11-12T15:49:30.683Z] 15:49:30     INFO -      rip = 0x000071b3b8ba8c6c
[task 2021-11-12T15:49:30.683Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.683Z] 15:49:30     INFO -   6  libxul.so!mozilla::dom::WeakWorkerRef::Notify() [WorkerRef.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 133 + 0x8]
[task 2021-11-12T15:49:30.683Z] 15:49:30     INFO -      rbp = 0x000071b3ae1fea10   rsp = 0x000071b3ae1fe9f0
[task 2021-11-12T15:49:30.683Z] 15:49:30     INFO -      rip = 0x000071b3b8ba8e4f
[task 2021-11-12T15:49:30.683Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.684Z] 15:49:30     INFO -   7  libxul.so!mozilla::dom::WorkerPrivate::NotifyWorkerRefs(mozilla::dom::WorkerStatus) [WorkerPrivate.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 3920 + 0x6]
[task 2021-11-12T15:49:30.684Z] 15:49:30     INFO -      rbp = 0x000071b3ae1feac0   rsp = 0x000071b3ae1fea20
[task 2021-11-12T15:49:30.684Z] 15:49:30     INFO -      rip = 0x000071b3b8b9fbb3
[task 2021-11-12T15:49:30.684Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.684Z] 15:49:30     INFO -   8  libxul.so!mozilla::dom::WorkerPrivate::NotifyInternal(mozilla::dom::WorkerStatus) [WorkerPrivate.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 4522 + 0xa]
[task 2021-11-12T15:49:30.684Z] 15:49:30     INFO -      rbp = 0x000071b3ae1feb20   rsp = 0x000071b3ae1fead0
[task 2021-11-12T15:49:30.684Z] 15:49:30     INFO -      rip = 0x000071b3b8ba094e
[task 2021-11-12T15:49:30.685Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.685Z] 15:49:30     INFO -   9  libxul.so!mozilla::dom::WorkerRunnable::Run() [WorkerRunnable.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 378 + 0x15]
[task 2021-11-12T15:49:30.685Z] 15:49:30     INFO -      rbp = 0x000071b3ae1fecc0   rsp = 0x000071b3ae1feb30
[task 2021-11-12T15:49:30.685Z] 15:49:30     INFO -      rip = 0x000071b3b8baa023
[task 2021-11-12T15:49:30.685Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.685Z] 15:49:30     INFO -  10  libxul.so!mozilla::dom::WorkerPrivate::ProcessAllControlRunnablesLocked() [WorkerPrivate.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 3677 + 0x6]
[task 2021-11-12T15:49:30.685Z] 15:49:30     INFO -      rbp = 0x000071b3ae1fed10   rsp = 0x000071b3ae1fecd0
[task 2021-11-12T15:49:30.686Z] 15:49:30     INFO -      rip = 0x000071b3b8ba06df
[task 2021-11-12T15:49:30.686Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.686Z] 15:49:30     INFO -  11  libxul.so!mozilla::dom::WorkerPrivate::DoRunLoop(JSContext*) [WorkerPrivate.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 3004 + 0x8]
[task 2021-11-12T15:49:30.686Z] 15:49:30     INFO -      rbp = 0x000071b3ae1fee10   rsp = 0x000071b3ae1fed20
[task 2021-11-12T15:49:30.686Z] 15:49:30     INFO -      rip = 0x000071b3b8b9fe77
[task 2021-11-12T15:49:30.686Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.687Z] 15:49:30     INFO -  12  libxul.so!mozilla::dom::workerinternals::(anonymous namespace)::WorkerThreadPrimaryRunnable::Run() [RuntimeService.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 2244 + 0xb]
[task 2021-11-12T15:49:30.687Z] 15:49:30     INFO -      rbp = 0x000071b3ae1fef90   rsp = 0x000071b3ae1fee20
[task 2021-11-12T15:49:30.687Z] 15:49:30     INFO -      rip = 0x000071b3b8b8902c
[task 2021-11-12T15:49:30.687Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.687Z] 15:49:30     INFO -  13  libxul.so!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 1169 + 0x11]
[task 2021-11-12T15:49:30.688Z] 15:49:30     INFO -      rbp = 0x000071b3ae1ff0c0   rsp = 0x000071b3ae1fefa0
[task 2021-11-12T15:49:30.688Z] 15:49:30     INFO -      rip = 0x000071b3b6402aab
[task 2021-11-12T15:49:30.688Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.688Z] 15:49:30     INFO -  14  libxul.so!NS_ProcessNextEvent(nsIThread*, bool) [nsThreadUtils.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 467 + 0x10]
[task 2021-11-12T15:49:30.688Z] 15:49:30     INFO -      rbp = 0x000071b3ae1ff100   rsp = 0x000071b3ae1ff0d0
[task 2021-11-12T15:49:30.688Z] 15:49:30     INFO -      rip = 0x000071b3b6406ec1
[task 2021-11-12T15:49:30.688Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.688Z] 15:49:30     INFO -  15  libxul.so!mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) [MessagePump.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 330 + 0xb]
[task 2021-11-12T15:49:30.689Z] 15:49:30     INFO -      rbp = 0x000071b3ae1ff150   rsp = 0x000071b3ae1ff110
[task 2021-11-12T15:49:30.689Z] 15:49:30     INFO -      rip = 0x000071b3b6a34983
[task 2021-11-12T15:49:30.689Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.689Z] 15:49:30     INFO -  16  libxul.so!MessageLoop::RunInternal() [message_loop.cc:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 331 + 0x17]
[task 2021-11-12T15:49:30.689Z] 15:49:30     INFO -      rbp = 0x000071b3ae1ff190   rsp = 0x000071b3ae1ff160
[task 2021-11-12T15:49:30.689Z] 15:49:30     INFO -      rip = 0x000071b3b69d5a16
[task 2021-11-12T15:49:30.689Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.689Z] 15:49:30     INFO -  17  libxul.so!MessageLoop::Run() [message_loop.cc:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 306 + 0x8]
[task 2021-11-12T15:49:30.689Z] 15:49:30     INFO -      rbp = 0x000071b3ae1ff1d0   rsp = 0x000071b3ae1ff1a0
[task 2021-11-12T15:49:30.690Z] 15:49:30     INFO -      rip = 0x000071b3b69d597f
[task 2021-11-12T15:49:30.690Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.690Z] 15:49:30     INFO -  18  libxul.so!nsThread::ThreadFunc(void*) [nsThread.cpp:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 391 + 0x8]
[task 2021-11-12T15:49:30.690Z] 15:49:30     INFO -      rbp = 0x000071b3ae1ff3a0   rsp = 0x000071b3ae1ff1e0
[task 2021-11-12T15:49:30.690Z] 15:49:30     INFO -      rip = 0x000071b3b63ffe3c
[task 2021-11-12T15:49:30.690Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.690Z] 15:49:30     INFO -  19  libnss3.so!_pt_root [ptthread.c:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 201 + 0xa]
[task 2021-11-12T15:49:30.691Z] 15:49:30     INFO -      rbp = 0x000071b3ae1ff3e0   rsp = 0x000071b3ae1ff3b0
[task 2021-11-12T15:49:30.691Z] 15:49:30     INFO -      rip = 0x000071b3c0a670c5
[task 2021-11-12T15:49:30.691Z] 15:49:30     INFO -      Found by: previous frame's frame pointer
[task 2021-11-12T15:49:30.691Z] 15:49:30     INFO -  20  libnss3.so!pt_recvfrom_cont [ptio.c:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 996 + 0x2f]
[task 2021-11-12T15:49:30.691Z] 15:49:30     INFO -      rbp = 0x000071b3ae1ff3e0   rsp = 0x000071b3ae1ff3d0
[task 2021-11-12T15:49:30.691Z] 15:49:30     INFO -      rip = 0x000071b3c0a66f7a
[task 2021-11-12T15:49:30.691Z] 15:49:30     INFO -      Found by: stack scanning
[task 2021-11-12T15:49:30.691Z] 15:49:30     INFO -  21  libc.so + 0x89772
[task 2021-11-12T15:49:30.692Z] 15:49:30     INFO -      rsp = 0x000071b3ae1ff3f0   rip = 0x000071b3dea38772
[task 2021-11-12T15:49:30.692Z] 15:49:30     INFO -      Found by: stack scanning
[task 2021-11-12T15:49:30.692Z] 15:49:30     INFO -  22  libnss3.so!pt_recvfrom_cont [ptio.c:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 996 + 0x2f]
[task 2021-11-12T15:49:30.692Z] 15:49:30     INFO -      rsp = 0x000071b3ae1ff428   rip = 0x000071b3c0a66f7a
[task 2021-11-12T15:49:30.692Z] 15:49:30     INFO -      Found by: stack scanning
[task 2021-11-12T15:49:30.692Z] 15:49:30     INFO -  23  libc.so + 0x299ec
[task 2021-11-12T15:49:30.692Z] 15:49:30     INFO -      rsp = 0x000071b3ae1ff440   rip = 0x000071b3de9d89ec
[task 2021-11-12T15:49:30.692Z] 15:49:30     INFO -      Found by: stack scanning
[task 2021-11-12T15:49:30.692Z] 15:49:30     INFO -  24  libc.so + 0x896c0
[task 2021-11-12T15:49:30.692Z] 15:49:30     INFO -      rsp = 0x000071b3ae1ff448   rip = 0x000071b3dea386c0
[task 2021-11-12T15:49:30.692Z] 15:49:30     INFO -      Found by: stack scanning
[task 2021-11-12T15:49:30.692Z] 15:49:30     INFO -  25  libc.so + 0x1ca66
[task 2021-11-12T15:49:30.692Z] 15:49:30     INFO -      rsp = 0x000071b3ae1ff450   rip = 0x000071b3de9cba66
[task 2021-11-12T15:49:30.693Z] 15:49:30     INFO -      Found by: stack scanning
[task 2021-11-12T15:49:30.693Z] 15:49:30     INFO -  26  libnss3.so!pt_recvfrom_cont [ptio.c:4e3ce91389bb02e6a9a29cec10beefc02e913784 : 996 + 0x2f]
[task 2021-11-12T15:49:30.693Z] 15:49:30     INFO -      rsp = 0x000071b3ae1ff4b8   rip = 0x000071b3c0a66f7a
[task 2021-11-12T15:49:30.693Z] 15:49:30     INFO -      Found by: stack scanning

Comment 10

[Iulian Moraru]

Hi Yury! Are you working on this? Any updates? Thank you!

Comment 11

[Intermittent Failures Robot]

98 failures in 2723 pushes (0.036 failures/push) were associated with this bug in the last 7 days.

This is the #3 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-central: 35
• try: 3
• autoland: 60

Platform and build breakdown:

• linux1804-64-shippable-qr: 11
  • opt: 11
• android-em-7-0-x86_64-qr: 34
  • debug: 34
• android-em-7-0-x86_64-lite-qr: 8
  • debug: 8
• linux1804-64-ccov-qr: 6
  • opt: 6
• linux1804-64-qr: 24
  • opt: 9
  • debug: 15
• windows10-64-2004-qr: 1
  • debug: 1
• linux1804-64-tsan-qr: 5
  • opt: 5
• linux1804-64-asan-qr: 7
  • opt: 7
• macosx1015-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-08&endday=2021-11-14&tree=all

Comment 13

[Yury Delendik (:yury)]

Hi Yury! Are you working on this? Any updates?

I attempted reproduce failures on Linux jobs. 1 out of 20 times I was able to invoke a failure. But once I started adding instrumentation and enabling logging, I was not able to reproduce failures yet.

38 failures on Android 7.0 x86-64 WebRender debug

Knowing this stats, I'll try to reproduce it on Android with the instrumentation this week.

Comment 14

[Yury Delendik (:yury)]

I was able to capture the failure with "MOZ_LOG=cache2:5" at https://treeherder.mozilla.org/jobs?repo=try&revision=c9c0a7f3dd1a23ef89aca617414b65fd8ee82f54&selectedTaskRun=BK-zfF1uQu-tIjvxbK6pOA.0 -- trying to analyze

Comment 15

[Yury Delendik (:yury)]

Valentin, by comparing with good runs logs, there is a difference at about [task 2021-11-16T19:27:02.173Z] mark: something related to frecency? At this moment I'm trying to figure out how to reproduce it more consistently. Any ideas?

Comment 16

[Intermittent Failures Robot]

25 failures in 630 pushes (0.04 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 18
• try: 2
• mozilla-central: 5

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 10
  • debug: 10
• linux1804-64-qr: 3
  • debug: 3
• android-em-7-0-x86_64-lite-qr: 4
  • debug: 4
• linux1804-64-asan-qr: 2
  • opt: 2
• linux1804-64-shippable-qr: 5
  • opt: 5
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-16&endday=2021-11-16&tree=all

Comment 17

[Valentin Gosu [:valentin] (he/him) {{ AFK in July }}]

I doubt the frecency update has any impact.

I can't tell from the logs what could be wrong about the cache. On the other hand, I haven't debugged many cache issues.
Would you be able to add some more logging to FetchUtil to say what the state of the mZStream is when the DIAGNOSTIC_ASSERT is triggered?
Has anything been read into the stream? What did we expect the size to be? Etc?

PS. It would make things much easier to debug if you had a pernosco trace of the issue.
I triggered a few runs, but it seems it didn't reproduce?

Comment 18

[Intermittent Failures Robot]

22 failures in 674 pushes (0.033 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 19
• mozilla-central: 3

Platform and build breakdown:

• linux1804-64-tsan-qr: 2
  • opt: 2
• android-em-7-0-x86_64-qr: 10
  • debug: 10
• android-em-7-0-x86_64-lite-qr: 3
  • debug: 3
• linux1804-64-qr: 5
  • debug: 3
  • opt: 2
• linux1804-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-17&endday=2021-11-17&tree=all

Comment 19

[Intermittent Failures Robot]

23 failures in 665 pushes (0.035 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 9

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 3
  • debug: 3
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 4
  • opt: 4
• android-em-7-0-x86_64-qr: 10
  • debug: 10
• linux1804-64-qr: 2
  • debug: 2
• linux1804-64-ccov-qr: 2
  • opt: 2
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-18&endday=2021-11-18&tree=all

Comment 20

[Yury Delendik (:yury)]

Attachment: Logs with failure when mZStreamInitialized is not set for mOptimizedEncoding

Would you be able to add some more logging to FetchUtil to say what the state of the mZStream is when the DIAGNOSTIC_ASSERT is triggered?

I got a logs with cache2:5 plus additional instrumentation. That tells that mZStreamInitialized is not set for mOptimizedEncoding -- the altdata stream is empty.

https://treeherder.mozilla.org/jobs?repo=try&revision=f2d355010613106ed9821ea5f99c24569507155e&selectedTaskRun=Fro47eSsS0S2pqIDCqw_9A.0

Comment 21

[Intermittent Failures Robot]

19 failures in 638 pushes (0.03 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 18
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 7
  • debug: 7
• linux1804-64-qr: 4
  • debug: 2
  • opt: 2
• android-em-7-0-x86_64-lite-qr: 4
  • debug: 4
• linux1804-64-tsan-qr: 3
  • opt: 3
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-19&endday=2021-11-19&tree=all

Comment 22

[Andreea Pavel [:apavel]]

There have been 121 total failures in the last 7 days on

• linux1804-64-tsan-qr opt
• linux1804-64-shippable-qr opt
• linux1804-64-qr opt and debug
• android-em-7-0-x86_64-qr debug
  Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=358743689&repo=mozilla-central&lineNumber=26944

[task 2021-11-21T11:09:43.822Z] 11:09:43     INFO - TEST-START | dom/promise/tests/test_webassembly_compile.html
[task 2021-11-21T11:09:43.973Z] 11:09:43     INFO - GECKO(17467) | [Child 17966, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:525
[task 2021-11-21T11:09:44.025Z] 11:09:44     INFO - GECKO(17467) | [Child 17966, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:525
[task 2021-11-21T11:09:44.031Z] 11:09:44     INFO - GECKO(17467) | [Child 17966, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp:3351
[task 2021-11-21T11:09:44.034Z] 11:09:44     INFO - GECKO(17467) | [Child 17966, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:525
[task 2021-11-21T11:09:44.038Z] 11:09:44     INFO - GECKO(17467) | [Child 17966, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:525
[task 2021-11-21T11:09:44.038Z] 11:09:44     INFO - GECKO(17467) | [Child 17966, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:525
[task 2021-11-21T11:09:44.040Z] 11:09:44     INFO - GECKO(17467) | [Child 17966, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:525
[task 2021-11-21T11:09:44.047Z] 11:09:44     INFO - GECKO(17467) | [Child 17966, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp:4439
[task 2021-11-21T11:09:44.114Z] 11:09:44     INFO - GECKO(17467) | [Parent 17467, Main Thread] WARNING: WebProgress Ignored: no longer current window global: file /builds/worker/checkouts/gecko/dom/ipc/BrowserParent.cpp:2983
[task 2021-11-21T11:09:44.415Z] 11:09:44     INFO - GECKO(17467) | ### XPCOM_MEM_BLOAT_LOG defined -- logging bloat/leaks to /tmp/tmp1zkgbx26.mozrunner/runtests_leaks_tab_pid18075.log
[task 2021-11-21T11:09:44.417Z] 11:09:44     INFO - GECKO(17467) | [18075, Main Thread] WARNING: XPCOM_MEM_BLOAT_LOG is set, disabling native allocations.: file /builds/worker/checkouts/gecko/tools/profiler/core/platform.cpp:251
[task 2021-11-21T11:09:44.563Z] 11:09:44     INFO - GECKO(17467) | [Child 18075, Main Thread] WARNING: could not set real-time limit in CubebUtils::InitLibrary: file /builds/worker/checkouts/gecko/dom/media/CubebUtils.cpp:644
[task 2021-11-21T11:09:45.878Z] 11:09:45     INFO - GECKO(17467) | [Child 18003, TaskController #1] WARNING: A runnable was posted to a worker that is already shutting down!: file /builds/worker/checkouts/gecko/dom/workers/WorkerPrivate.cpp:1499

[task 2021-11-21T11:09:47.362Z] 11:09:47     INFO - GECKO(17467) | [Child 18003, TaskController #0] WARNING: A runnable was posted to a worker that is already shutting down!: file /builds/worker/checkouts/gecko/dom/workers/WorkerPrivate.cpp:1499
[task 2021-11-21T11:09:47.374Z] 11:09:47     INFO - GECKO(17467) | [Child 18003, TaskController #0] WARNING: A runnable was posted to a worker that is already shutting down!: file /builds/worker/checkouts/gecko/dom/workers/WorkerPrivate.cpp:1499
[task 2021-11-21T11:09:47.398Z] 11:09:47     INFO - GECKO(17467) | [Child 18003, TaskController #0] WARNING: A runnable was posted to a worker that is already shutting down!: file /builds/worker/checkouts/gecko/dom/workers/WorkerPrivate.cpp:1499
[task 2021-11-21T11:09:47.435Z] 11:09:47     INFO - GECKO(17467) | [Child 18003, DOM Worker] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp:3351
[task 2021-11-21T11:09:47.460Z] 11:09:47     INFO - GECKO(17467) | Assertion failure: ok (corrupt optimized wasm cache file), at /builds/worker/checkouts/gecko/dom/fetch/FetchUtil.cpp:542
[task 2021-11-21T11:09:47.469Z] 11:09:47     INFO -  Initializing stack-fixing for the first stack frame, this may take a while...
[task 2021-11-21T11:09:56.286Z] 11:09:56     INFO - GECKO(17467) | #01: mozilla::dom::JSStreamConsumer::OnInputStreamReady(nsIAsyncInputStream*) [dom/fetch/FetchUtil.cpp:542]
[task 2021-11-21T11:09:56.288Z] 11:09:56     INFO - GECKO(17467) | #02: mozilla::(anonymous namespace)::InputStreamCallbackRunnable::Run() [dom/file/ipc/RemoteLazyInputStream.cpp:55]
[task 2021-11-21T11:09:56.290Z] 11:09:56     INFO - GECKO(17467) | #03: mozilla::(anonymous namespace)::InputStreamCallbackRunnable::Execute(nsIInputStreamCallback*, nsIEventTarget*, mozilla::RemoteLazyInputStream*) [dom/file/ipc/RemoteLazyInputStream.cpp:48]
[task 2021-11-21T11:09:56.291Z] 11:09:56     INFO - GECKO(17467) | #04: mozilla::RemoteLazyInputStream::Close() [dom/file/ipc/RemoteLazyInputStream.cpp:315]
[task 2021-11-21T11:09:56.291Z] 11:09:56     INFO - GECKO(17467) | #05: std::_Function_handler<void (), mozilla::dom::WorkerStreamOwner::Create(nsIAsyncInputStream*, mozilla::dom::WorkerPrivate*, nsCOMPtr<nsIEventTarget>&&)::{lambda()#1}>::_M_invoke(std::_Any_data const&) [/builds/worker/fetches/sysroot-x86_64-linux-gnu/usr/include/c++/7/bits/std_function.h:316]
[task 2021-11-21T11:09:56.292Z] 11:09:56     INFO - GECKO(17467) | #06: mozilla::dom::WorkerRef::Notify() [dom/workers/WorkerRef.cpp:99]
[task 2021-11-21T11:09:56.300Z] 11:09:56     INFO - GECKO(17467) | #07: mozilla::dom::WeakWorkerRef::Notify() [dom/workers/WorkerRef.cpp:134]
[task 2021-11-21T11:09:56.300Z] 11:09:56     INFO - GECKO(17467) | #08: mozilla::dom::WorkerPrivate::NotifyWorkerRefs(mozilla::dom::WorkerStatus) [dom/workers/WorkerPrivate.cpp:3919]
[task 2021-11-21T11:09:56.300Z] 11:09:56     INFO - GECKO(17467) | #09: mozilla::dom::WorkerPrivate::NotifyInternal(mozilla::dom::WorkerStatus) [dom/workers/WorkerPrivate.cpp:4522]
[task 2021-11-21T11:09:56.301Z] 11:09:56     INFO - GECKO(17467) | #10: mozilla::dom::WorkerRunnable::Run() [dom/workers/WorkerRunnable.cpp:378]
[task 2021-11-21T11:09:56.301Z] 11:09:56     INFO - GECKO(17467) | #11: mozilla::dom::WorkerPrivate::ProcessAllControlRunnablesLocked() [dom/workers/WorkerPrivate.cpp:3677]
[task 2021-11-21T11:09:56.302Z] 11:09:56     INFO - GECKO(17467) | #12: mozilla::dom::WorkerPrivate::DoRunLoop(JSContext*) [dom/workers/WorkerPrivate.cpp:3005]
[task 2021-11-21T11:09:56.302Z] 11:09:56     INFO - GECKO(17467) | #13: mozilla::dom::workerinternals::(anonymous namespace)::WorkerThreadPrimaryRunnable::Run() [dom/workers/RuntimeService.cpp:2247]
[task 2021-11-21T11:09:56.303Z] 11:09:56     INFO - GECKO(17467) | #14: nsThread::ProcessNextEvent(bool, bool*) [xpcom/threads/nsThread.cpp:1178]
[task 2021-11-21T11:09:56.303Z] 11:09:56     INFO - GECKO(17467) | #15: NS_ProcessNextEvent(nsIThread*, bool) [xpcom/threads/nsThreadUtils.cpp:467]
[task 2021-11-21T11:09:56.303Z] 11:09:56     INFO - GECKO(17467) | #16: mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) [ipc/glue/MessagePump.cpp:301]
[task 2021-11-21T11:09:56.303Z] 11:09:56     INFO - GECKO(17467) | #17: MessageLoop::RunInternal() [ipc/chromium/src/base/message_loop.cc:331]
[task 2021-11-21T11:09:56.304Z] 11:09:56     INFO - GECKO(17467) | #18: MessageLoop::Run() [ipc/chromium/src/base/message_loop.cc:307]
[task 2021-11-21T11:09:56.304Z] 11:09:56     INFO - GECKO(17467) | #19: nsThread::ThreadFunc(void*) [xpcom/threads/nsThread.cpp:393]
[task 2021-11-21T11:09:56.307Z] 11:09:56     INFO - GECKO(17467) | #20: _pt_root [nsprpub/pr/src/pthreads/ptthread.c:204]
[task 2021-11-21T11:09:56.308Z] 11:09:56     INFO - GECKO(17467) | #21: ??? [/lib/x86_64-linux-gnu/libpthread.so.0 + 0x76db]
[task 2021-11-21T11:09:56.314Z] 11:09:56     INFO - GECKO(17467) | #22: clone [/lib/x86_64-linux-gnu/libc.so.6 + 0x121a3f]
[task 2021-11-21T11:09:56.314Z] 11:09:56     INFO - GECKO(17467) | #23: ??? (???:???)
[task 2021-11-21T11:09:56.315Z] 11:09:56     INFO - GECKO(17467) | [Parent 17467, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer FFB9039DBF891251.5F68B1C004BB075C: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:338
[task 2021-11-21T11:09:56.315Z] 11:09:56     INFO - GECKO(17467) | [Parent 17467, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer FFB9039DBF891251.5F68B1C004BB075C: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:338
[task 2021-11-21T11:09:56.316Z] 11:09:56     INFO - GECKO(17467) | [Parent 17467, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer FFB9039DBF891251.5F68B1C004BB075C: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:338
[task 2021-11-21T11:09:56.316Z] 11:09:56     INFO - GECKO(17467) | [Parent 17467, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer FFB9039DBF891251.5F68B1C004BB075C: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:338
[task 2021-11-21T11:09:56.317Z] 11:09:56     INFO - GECKO(17467) | [Parent 17467, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer FFB9039DBF891251.5F68B1C004BB075C: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:338
[task 2021-11-21T11:09:56.317Z] 11:09:56     INFO - GECKO(17467) | [Parent 17467, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer FFB9039DBF891251.5F68B1C004BB075C: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:338
[task 2021-11-21T11:09:56.317Z] 11:09:56     INFO - GECKO(17467) | [Parent 17467, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer FFB9039DBF891251.5F68B1C004BB075C: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:338
[task 2021-11-21T11:09:56.318Z] 11:09:56     INFO - GECKO(17467) | [Parent 17467, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer FFB9039DBF891251.5F68B1C004BB075C: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:338
[task 2021-11-21T11:09:56.318Z] 11:09:56     INFO - GECKO(17467) | [Parent 17467, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer FFB9039DBF891251.5F68B1C004BB075C: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:338
[task 2021-11-21T11:09:56.319Z] 11:09:56     INFO - GECKO(17467) | [Parent 17467, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer FFB9039DBF891251.5F68B1C004BB075C: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:338
[task 2021-11-21T11:09:56.319Z] 11:09:56     INFO - GECKO(17467) | [Parent 17467, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer FFB9039DBF891251.5F68B1C004BB075C: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:338
[task 2021-11-21T11:09:56.319Z] 11:09:56     INFO - GECKO(17467) | [Parent 17467, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer FFB9039DBF891251.5F68B1C004BB075C: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:338
[task 2021-11-21T11:09:56.320Z] 11:09:56     INFO - GECKO(17467) | [Parent 17467, IPC I/O Parent] WARNING: [1.1]: Ignoring message 'EVENT_MESSAGE' to unknown peer FFB9039DBF891251.5F68B1C004BB075C: file /builds/worker/checkouts/gecko/ipc/glue/NodeController.cpp:338
[task 2021-11-21T11:09:56.320Z] 11:09:56     INFO - GECKO(17467) | ###!!! [Parent][MessageChannel] Error: (msgtype=0xB20013,name=PWindowGlobal::Msg_RawMessage) Channel error: cannot send/recv

Comment 23

[Valentin Gosu [:valentin] (he/him) {{ AFK in July }}]

(In reply to Yury Delendik (:yury) from comment #20)

Created attachment 9251612 [details]
Logs with failure when mZStreamInitialized is not set for mOptimizedEncoding

Would you be able to add some more logging to FetchUtil to say what the state of the mZStream is when the DIAGNOSTIC_ASSERT is triggered?

I got a logs with cache2:5 plus additional instrumentation. That tells that mZStreamInitialized is not set for mOptimizedEncoding -- the altdata stream is empty.

As far as I can tell, the assertion is triggered after shutdown.
At that point we haven't read anything from the input stream. Shutdown causes it to be closed, which leads to 0 bytes being available.
I think the best course of action is handling that case in FetchUtil. So if the input stream is empty OR the length of the stream is smaller than the length encoded at the beginning, then we should just ignore the entry (especially if it's happening during shutdown 🙂).

Comment 24

[Intermittent Failures Robot]

115 failures in 3259 pushes (0.035 failures/push) were associated with this bug in the last 7 days.

This is the #2 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 85
• mozilla-central: 28
• try: 2

Platform and build breakdown:

• linux1804-64-qr: 24
  • opt: 7
  • debug: 17
• android-em-7-0-x86_64-qr: 41
  • debug: 41
• linux1804-64-shippable-qr: 17
  • opt: 17
• android-em-7-0-x86_64-lite-qr: 16
  • debug: 16
• linux1804-64-asan-qr: 5
  • opt: 5
• linux1804-64-tsan-qr: 9
  • opt: 9
• linux1804-64-ccov-qr: 2
  • opt: 2
• macosx1015-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-15&endday=2021-11-21&tree=all

Comment 26

[Yury Delendik (:yury)]

we should just ignore the entry (especially if it's happening during shutdown)

Does this mean logic at https://searchfox.org/mozilla-central/rev/702199bca53babc925e47fd8f86ed56487d42492/dom/fetch/FetchUtil.cpp#532-536 is incorrect? If there a better way to detect shutdown from the OnInputStreamReady() ?

Comment 27

[Intermittent Failures Robot]

16 failures in 488 pushes (0.033 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 12
• mozilla-central: 4

Platform and build breakdown:

• linux1804-64-tsan-qr: 2
  • opt: 2
• linux1804-64-qr: 3
  • debug: 3
• windows10-64-2004-qr: 1
  • debug: 1
• linux1804-64-shippable-qr: 3
  • opt: 3
• android-em-7-0-x86_64-lite-qr: 2
  • debug: 2
• android-em-7-0-x86_64-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-22&endday=2021-11-22&tree=all

Comment 28

[Valentin Gosu [:valentin] (he/him) {{ AFK in July }}]

We do have the ability to check the shutdown phase (although that's main thread only). Alternatively you could also add a shutdown observer or a RunOnShutdown callback and set a mShuttingDown variable.

That logic seems fine, but we need to do something special when the stream is closed and we didn't read all the content.

Comment 29

[Yury Delendik (:yury)]

Attachment: Bug 1738987 - Ignore altdata stream errors on shutdown.

Comment 33

[Intermittent Failures Robot]

23 failures in 562 pushes (0.041 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 20
• mozilla-central: 3

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1
• linux1804-64-tsan-qr: 2
  • opt: 2
• android-em-7-0-x86_64-lite-qr: 2
  • debug: 2
• android-em-7-0-x86_64-qr: 18
  • debug: 18

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-25&endday=2021-11-25&tree=all

Comment 34

[Andreea Pavel [:apavel]]

THere are 95 total failuresin the last 7 days on

• android-em-7-0-x86_64-lite-qr debug
• android-em-7-0-x86_64-qr debug
• linux1804-64-qr debug and opt
• linux1804-64-shippable-qr opt
• linux1804-64-tsan-qr opt
  Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=359366047&repo=autoland&lineNumber=4513

[task 2021-11-26T13:12:39.448Z] 13:12:39     INFO - TEST-START | dom/promise/tests/test_webassembly_compile.html
[task 2021-11-26T13:12:40.647Z] 13:12:40     INFO - GECKO(7558) | MEMORY STAT | vsize 2477MB | residentFast 105MB | heapAllocated 6MB
[task 2021-11-26T13:12:40.654Z] 13:12:40     INFO - <snipped 358 output lines - if you need more context, please use SimpleTest.requestCompleteLog() in your test>
[task 2021-11-26T13:12:40.654Z] 13:12:40     INFO - Buffered messages logged at 13:12:40
[task 2021-11-26T13:12:40.654Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got a module 
[task 2021-11-26T13:12:40.654Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got an instance 
[task 2021-11-26T13:12:40.654Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got result 
[task 2021-11-26T13:12:40.654Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | not cached yet 
[task 2021-11-26T13:12:40.655Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got a module 
[task 2021-11-26T13:12:40.656Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got an instance 
[task 2021-11-26T13:12:40.657Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got result 
[task 2021-11-26T13:12:40.657Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | clone loaded from cache 
[task 2021-11-26T13:12:40.658Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got a module 
[task 2021-11-26T13:12:40.659Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got an instance 
[task 2021-11-26T13:12:40.660Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got result 
[task 2021-11-26T13:12:40.661Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | original loaded from cache 
[task 2021-11-26T13:12:40.661Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got a module 
[task 2021-11-26T13:12:40.662Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got an instance 
[task 2021-11-26T13:12:40.662Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got result 
[task 2021-11-26T13:12:40.664Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | not cached yet 
[task 2021-11-26T13:12:40.664Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got a module 
[task 2021-11-26T13:12:40.664Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got an instance 
[task 2021-11-26T13:12:40.665Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got result 
[task 2021-11-26T13:12:40.666Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | clone loaded from cache 
[task 2021-11-26T13:12:40.666Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got a module 
[task 2021-11-26T13:12:40.666Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got an instance 
[task 2021-11-26T13:12:40.667Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got result 
[task 2021-11-26T13:12:40.667Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | original loaded from cache 
[task 2021-11-26T13:12:40.667Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | fun time 
[task 2021-11-26T13:12:40.667Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | not cached yet 
[task 2021-11-26T13:12:40.672Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | undefined assertion name 
[task 2021-11-26T13:12:40.673Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | cache hit of undefined 
[task 2021-11-26T13:12:40.750Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got a module 
[task 2021-11-26T13:12:40.754Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got an instance 
[task 2021-11-26T13:12:40.755Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | got result 
[task 2021-11-26T13:12:40.757Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | worker test: ok 
[task 2021-11-26T13:12:40.759Z] 13:12:40     INFO - TEST-PASS | dom/promise/tests/test_webassembly_compile.html | worker streaming terminate test: ok 
[task 2021-11-26T13:12:40.761Z] 13:12:40     INFO - Buffered messages finished
[task 2021-11-26T13:12:40.763Z] 13:12:40     INFO - TEST-UNEXPECTED-ERROR | dom/promise/tests/test_webassembly_compile.html | unexpected-crash-dump-found - This test left crash dumps behind, but we weren't expecting it to!
[task 2021-11-26T13:12:40.765Z] 13:12:40     INFO - Found unexpected crash dump file /tmp/tmp6em92w2g.mozrunner/minidumps/153cabf6-c319-644a-d4e5-a45fafe2e03c.dmp.
[task 2021-11-26T13:12:40.768Z] 13:12:40     INFO - GECKO(7558) | ###!!! [Parent][MessageChannel] Error: (msgtype=0x230081,name=PBrowser::Msg_StopIMEStateManagement) Channel error: cannot send/recv
[task 2021-11-26T13:12:40.769Z] 13:12:40     INFO - GECKO(7558) | ###!!! [Parent][MessageChannel] Error: (msgtype=0x3A0145,name=PContent::Msg_CommitBrowsingContextTransaction) Channel error: cannot send/recv
[task 2021-11-26T13:12:40.772Z] 13:12:40    ERROR - GECKO(7558) | A content process crashed and MOZ_CRASHREPORTER_SHUTDOWN is set, shutting down
[task 2021-11-26T13:12:40.772Z] 13:12:40     INFO - GECKO(7558) | JavaScript error: , line 0: uncaught exception: Object
[task 2021-11-26T13:12:40.800Z] 13:12:40     INFO - GECKO(7558) | JavaScript error: resource://gre/modules/AsyncShutdown.jsm, line 575: NotFoundError: No such JSWindowActor 'SpecialPowers'
[task 2021-11-26T13:12:40.883Z] 13:12:40     INFO - GECKO(7558) | 1637932360882	Marionette	TRACE	Received observer notification quit-application
[task 2021-11-26T13:12:40.885Z] 13:12:40     INFO - GECKO(7558) | 1637932360883	Marionette	INFO	Stopped listening on port 2828
[task 2021-11-26T13:12:40.886Z] 13:12:40     INFO - GECKO(7558) | 1637932360886	Marionette	DEBUG	Marionette stopped listening
[task 2021-11-26T13:12:41.426Z] 13:12:41     INFO - GECKO(7558) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2021-11-26T13:12:41.470Z] 13:12:41     INFO - TEST-INFO | Main app process: exit 0

Comment 35

[Intermittent Failures Robot]

15 failures in 443 pushes (0.034 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 9
• mozilla-central: 6

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 3
  • debug: 3
• windows10-64-2004-ccov-qr: 2
  • opt: 2
• android-em-7-0-x86_64-lite-qr: 5
  • debug: 5
• linux1804-64-tsan-qr: 1
  • opt: 1
• linux1804-64-qr: 1
  • opt: 1
• linux1804-64-ccov-qr: 2
  • opt: 2
• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-26&endday=2021-11-26&tree=all

Comment 36

[Intermittent Failures Robot]

84 failures in 2819 pushes (0.03 failures/push) were associated with this bug in the last 7 days.

This is the #9 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 56
• mozilla-central: 28

Platform and build breakdown:

• linux1804-64-tsan-qr: 11
  • opt: 11
• linux1804-64-qr: 8
  • debug: 6
  • opt: 2
• windows10-64-2004-qr: 1
  • debug: 1
• linux1804-64-shippable-qr: 7
  • opt: 7
• android-em-7-0-x86_64-lite-qr: 13
  • debug: 13
• android-em-7-0-x86_64-qr: 35
  • debug: 35
• linux1804-64-asan-qr: 2
  • opt: 2
• windows10-64-2004-ccov-qr: 5
  • opt: 5
• linux1804-64-ccov-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-22&endday=2021-11-28&tree=all

Comment 37

[Yury Delendik (:yury)]

(In reply to Valentin Gosu [:valentin] (he/him) from comment #28)

We do have the ability to check the shutdown phase (although that's main thread only). Alternatively you could also add a shutdown observer or a RunOnShutdown callback and set a mShuttingDown variable.

There is no luck with RunOnShutdown method:
https://treeherder.mozilla.org/jobs?repo=try&revision=1857262d8ee0840cce5df7c4935dc1d7a3a85937&selectedTaskRun=aTblK6Z9TXe68jZnATx4RA.0 is failing before shutdown is called. Do we want to just skip the shutdown check and just return an error?

Comment 38

[Intermittent Failures Robot]

18 failures in 585 pushes (0.031 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 10
• mozilla-central: 8

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 8
  • debug: 8
• linux1804-64-shippable-qr: 5
  • opt: 5
• android-em-7-0-x86_64-lite-qr: 4
  • debug: 4
• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-29&endday=2021-11-29&tree=all

Comment 39

[Valentin Gosu [:valentin] (he/him) {{ AFK in July }}]

Do we want to just skip the shutdown check and just return an error?

Yes, I think we should.

Comment 41

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/b9a874645033
Ignore altdata stream errors on shutdown. r=valentin

Comment 42

[Intermittent Failures Robot]

20 failures in 590 pushes (0.034 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 12
• mozilla-central: 8

Platform and build breakdown:

• linux1804-64-qr: 1
  • opt: 1
• android-em-7-0-x86_64-lite-qr: 1
  • debug: 1
• android-em-7-0-x86_64-qr: 11
  • debug: 11
• linux1804-64-shippable-qr: 3
  • opt: 3
• linux1804-64-tsan-qr: 2
  • opt: 2
• linux1804-64-asan-qr: 1
  • opt: 1
• windows10-64-2004-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-30&endday=2021-11-30&tree=all

Comment 43

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/b9a874645033

Comment 44

[Intermittent Failures Robot]

42 failures in 3170 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #20 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 22
• mozilla-central: 19
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 19
  • debug: 19
• linux1804-64-shippable-qr: 8
  • opt: 8
• android-em-7-0-x86_64-lite-qr: 5
  • debug: 5
• linux1804-64-ccov-qr: 2
  • opt: 2
• linux1804-64-qr: 2
  • opt: 1
  • debug: 1
• linux1804-64-tsan-qr: 2
  • opt: 2
• linux1804-64-asan-qr: 3
  • opt: 3
• windows10-64-2004-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1738987&startday=2021-11-29&endday=2021-12-05&tree=all