1754529 - Crash in [@ wgpu_core::hub::Storage<T>::get]

Status: RESOLVED FIXED

(Core :: Graphics: WebGPU, defect)

Description

[Andrew Osmond [:aosmond] (he/him)]

I hit this crash visiting https://austin-eng.com/webgpu-samples/samples/resizeCanvas on the latest nightly.

Crash report: https://crash-stats.mozilla.org/report/index/a121e1ba-d9aa-4f4d-a1a2-1381c0220209

MOZ_CRASH Reason: assertion failed: `(left == right)` left: `1`, right: `2`: Device[0] is no longer alive

Top 10 frames of crashing thread:

0 libxul.so RustMozCrash mozglue/static/rust/wrappers.cpp:18
1 libxul.so mozglue_static::panic_hook mozglue/static/rust/lib.rs:91
2 libxul.so core::ops::function::Fn::call library/core/src/ops/function.rs:70
3 libxul.so std::panicking::rust_panic_with_hook library/std/src/panicking.rs:610
4 libxul.so std::panicking::begin_panic_handler::{{closure}} library/std/src/panicking.rs:502
5 libxul.so std::sys_common::backtrace::__rust_end_short_backtrace library/std/src/sys_common/backtrace.rs:139
6 libxul.so rust_begin_unwind library/std/src/panicking.rs:498
7 libxul.so core::panicking::panic_fmt library/core/src/panicking.rs:107
8 libxul.so core::panicking::assert_failed_inner library/core/src/panicking.rs:182
9 libxul.so core::panicking::assert_failed library/core/src/panicking.rs:145

Comment 1

[Andrew Osmond [:aosmond] (he/him)]

This seems like a more recent regression than the original crash report in bug 1704148 given these crashes only started in the last week and a half.

Comment 2

[Andrew Osmond [:aosmond] (he/him)]

I was able to reproduce on https://wgpu.rs/examples-gpu/?example=shadow

Comment 3

[Andrew Osmond [:aosmond] (he/him)]

Possibly (?) related to a "parent device is lost" message I have seen in the web console:
https://searchfox.org/mozilla-central/rev/c12a59323ee46b29b90c9917a3a7a70ea714ffec/third_party/rust/wgpu-core/src/device/mod.rs#2866

Comment 4

[Andrew Osmond [:aosmond] (he/him)]

According to kvark, updating my Mesa drivers should fix the problem, which it appears to do. Presumably the old drivers were causing "parent device is lost", we tore down our wgpu resources, but then we tried to tear down again and panicked.

Comment 5

[Andrew Osmond [:aosmond] (he/him)]

I'll see if I can figure this out how to handle the device loss gracefully (the device loss itself might be a separate bug). It still happens to me on NVIDIA.

Comment 6

[Valentin Gosu [:valentin] (he/him)]

https://crash-stats.mozilla.org/report/index/fdd594bf-f1dc-446f-9b55-acc000220308

I hit this by going to https://surma.dev/things/webgpu/step1/index.html - I enabled webgpu from about:config, restarted, disabled the pref, restarted, then I restored the tab with the webgpu page and hit this crash.

Comment 7

[Andrew Osmond [:aosmond] (he/him)]

I suspect most of these crashes are related to the fact that we may destroy the device:

https://searchfox.org/mozilla-central/rev/61c6b2ca66b8fc7d82a71d6f045871e5a8649cbb/dom/webgpu/Device.cpp#74

before we tear down the swap chain:

https://searchfox.org/mozilla-central/rev/61c6b2ca66b8fc7d82a71d6f045871e5a8649cbb/dom/webgpu/CanvasContext.cpp#81

I have a log showing this order of events.

Comment 8

[Andrew Osmond [:aosmond] (he/him)]

When we configure, we should likely take a strong pointer to the Device object, and clear it when we unconfigure:

https://searchfox.org/mozilla-central/rev/61c6b2ca66b8fc7d82a71d6f045871e5a8649cbb/dom/webgpu/CanvasContext.cpp#68

Comment 9

[Andrew Osmond [:aosmond] (he/him)]

Actually mTexture already has a strong pointer to the owning Device which has a strong pointer to the owning Adapter. I think cycle collection cannot destroy Device or Adapter, it needs to clean up CanvasContext first.

Comment 10

[Andrew Osmond [:aosmond] (he/him)]

Attachment: Bug 1754529 - Ensure WebGPU objects are destroyed in the right order.

The cycle collection can cause Texture, Device and Adapter to be
destroyed before their dependent objects. This patch ensures that
the dependencies must be destroyed first via the Cleanup method
used to clear our cyclical links. Any objects that might have
ChildOf (or CanvasContext) dependencies must rely upon their
children clearing their references first.

Comment 14

[Intermittent Failures Robot]

53 failures in 3341 pushes (0.016 failures/push) were associated with this bug in the last 7 days.

This is the #18 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 10
• mozilla-central: 43

Platform and build breakdown:

• windows10-64-2004-qr: 13
  • debug: 13
• windows10-32-2004-mingwclang-qr: 19
  • debug: 19
• windows10-64-2004-mingwclang-qr: 14
  • debug: 14
• windows10-64-2004-ccov-qr: 6
  • opt: 6
• windows10-32-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-03-21&endday=2022-03-27&tree=all

Comment 15

[Andreea Pavel [:apavel]]

There are 51 total failures in the last 7 days on

• windows10-64-2004-qr debug
• windows10-64-2004-mingwclang-qr debug
• windows10-32-2004-mingwclang-qr debug
  Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=372647956&repo=autoland&lineNumber=57367

[task 2022-03-29T03:41:17.653Z] 03:41:17     INFO - TEST-START | remote/shared/listeners/test/browser/browser_ConsoleListener_cached_messages.js
[task 2022-03-29T03:41:17.662Z] 03:41:17     INFO - GECKO(10100) | [Child 2736: Main Thread]: I/DocShellAndDOMWindowLeak ++DOCSHELL 16b8531fc00 == 1 [pid = 2736] [id = 0]
[task 2022-03-29T03:41:17.663Z] 03:41:17     INFO - GECKO(10100) | [Child 2736: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 1 (16b8036f260) [pid = 2736] [serial = 1] [outer = 0]
[task 2022-03-29T03:41:17.664Z] 03:41:17     INFO - GECKO(10100) | [Child 2736: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 2 (16b85320400) [pid = 2736] [serial = 2] [outer = 16b8036f260]
[task 2022-03-29T03:41:17.722Z] 03:41:17     INFO - GECKO(10100) | [Child 2736, Main Thread] WARNING: NS_ENSURE_TRUE(info) failed: file /builds/worker/checkouts/gecko/extensions/permissions/PermissionDelegateHandler.cpp:348
[task 2022-03-29T03:41:17.723Z] 03:41:17     INFO - GECKO(10100) | [Child 2736: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 3 (16b85324000) [pid = 2736] [serial = 3] [outer = 16b8036f260]
[task 2022-03-29T03:41:17.764Z] 03:41:17     INFO - GECKO(10100) | JavaScript error: https://example.com/document-builder.sjs?html=%3Cmeta%20charset=utf8%3E%3C/meta%3E, line 1: uncaught exception: error1
[task 2022-03-29T03:41:18.847Z] 03:41:18     INFO - GECKO(10100) | [2022-03-29T03:41:18Z WARN  webrender::device::gl] Missing optimized shader source for gpu_cache_update
[task 2022-03-29T03:41:18.874Z] 03:41:18     INFO - GECKO(10100) | [Child 2736: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 2 (16b85320400) [pid = 2736] [serial = 2] [outer = 0] [url = about:blank]
[task 2022-03-29T03:41:18.879Z] 03:41:18     INFO - GECKO(10100) | [Child 8208: Main Thread]: I/DocShellAndDOMWindowLeak --DOCSHELL 27646214c00 == 1 [pid = 8208] [id = 1] [url = about:blank]
[task 2022-03-29T03:41:18.895Z] 03:41:18     INFO - GECKO(10100) | [Child 3948: Main Thread]: I/DocShellAndDOMWindowLeak --DOCSHELL 1e12580b000 == 0 [pid = 3948] [id = 3] [url = about:blank]
[task 2022-03-29T03:41:18.912Z] 03:41:18     INFO - GECKO(10100) | [Child 8208: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 3 (276413707d0) [pid = 8208] [serial = 3] [outer = 0] [url = about:blank]
[task 2022-03-29T03:41:18.935Z] 03:41:18     INFO - GECKO(10100) | [Child 3948: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 1 (1e120870260) [pid = 3948] [serial = 10] [outer = 0] [url = about:blank]
[task 2022-03-29T03:41:19.142Z] 03:41:19     INFO - GECKO(10100) | [Child 5424, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:506
[task 2022-03-29T03:41:19.156Z] 03:41:19     INFO - GECKO(10100) | [Child 5424, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkout[Child 6416, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:506
[task 2022-03-29T03:41:19.156Z] 03:41:19     INFO - GECKO(10100) | [Child 6416, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:506
[task 2022-03-29T03:41:19.158Z] 03:41:19     INFO - GECKO(10100) | s/gecko/ipc/glue/ProtocolUtils.cpp:506
[task 2022-03-29T03:41:19.158Z] 03:41:19     INFO - GECKO(10100) | [Child 6416, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:506
[task 2022-03-29T03:41:19.158Z] 03:41:19     INFO - GECKO(10100) | [Child 5424, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:506
[task 2022-03-29T03:41:19.159Z] 03:41:19     INFO - GECKO(10100) | [Child 6416, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:506
[task 2022-03-29T03:41:19.159Z] 03:41:19     INFO - GECKO(10100) | [Child 5424, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:506
[task 2022-03-29T03:41:19.162Z] 03:41:19     INFO - GECKO(10100) | [Child 5424, Main Thread] WARNING: Ex[tChra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp:3359
[task 2022-03-29T03:41:19.164Z] 03:41:19     INFO - GECKO(10100) | [2022-03-29T03:41:19Z WARN  audioipc2::ipccore] AudioIPC Server RPC: EventLoop drop - closing connection for Token(7) failed: Custom { kind: NotFound, error: "I/O source not registered with `Registry`" }
[task 2022-03-29T03:41:19.166Z] 03:41:19     INFO - GECKO(10100) | ild 6416, Mai[Child 5424, Main Thread] WARNING: NS_ENSURE_TRUE(InitStaticMembne rThrse(ad)] )WA RNfING: aExitlrae d:s hutfdoiwle /n bCuiClds: /w'io r< kNOeRrM/AwLo_rSkHsUpTaDcOWN_CeOLL/ECoTIONSb', jfi-lbeu il/d/bduiislds/wotr/ikncelru/dceh/mozilla/Preferenceesckou.ts/geh:c12k8o
[task 2022-03-29T03:41:19.167Z] 03:41:19     INFO - GECKO(10100) | /xpcom/base/nsCycleCollec[Chitoldr. c5p4p:243,35 9Ma
[task 2022-03-29T03:41:19.168Z] 03:41:19     INFO - GECKO(10100) | in Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:506
[task 2022-03-29T03:41:19.169Z] 03:41:19     INFO - GECKO(10100) | [2022-03-29T03:41:19Z WARN  audioipc2::ipccore] AudioIPC Server RPC: EventLoop drop - closing connection for Token(6) failed: Custom { kind: NotFound, error: "I/O source not registered with `Registry`" }
[task 2022-03-29T03:41:19.170Z] 03:41:19     INFO - GECKO(10100) | [Child 6416, Main Thread] WARNING: NS_ENSURE_TRU[Child 5424, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/workerE/c(hInietckoStutsaticMembers/g(eck)o/)i pfca/gilue/led: Pfrioletoc /olUbutiilldss./wcporpk:50e6r/
[task 2022-03-29T03:41:19.171Z] 03:41:19     INFO - GECKO(10100) | workspace/obj-build/d[Chisitld/ 5inc4l24ud,e M/maoinzi lThrlaead/] WPARNrINGe: IfPC message 'PIedlreeSnccehs.he:12d8uler
[task 2022-03-29T03:41:19.171Z] 03:41:19     INFO - GECKO(10100) | ::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/Prot[Cohilcdo l6U41t6ils, M.aicn pTp:h5re0ad]6
[task 2022-03-29T03:41:19.172Z] 03:41:19     INFO - GECKO(10100) | WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cann[Child 5424, Main Thread] WARNINGo:t s eIPnC mdessa:g fie l'PIde l/builds/weoSrkcehre/dcuhelcekro:ut:sM/sggec_kDoo/nipecG/Cg'lu ed/iPsroctaorcodleUdt:il sa.ccptpo:r5 0c6
[task 2022-03-29T03:41:19.173Z] 03:41:19     INFO - GECKO(10100) | annot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:506
[task 2022-03-29T03:41:19.176Z] 03:41:19     INFO - GECKO(10100) | [Child 6416, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_DoneGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:506
[task 2022-03-29T03:41:19.177Z] 03:41:19     INFO - GECKO(10100) | [Child 6416, Main Thread] WARNING: IPC message 'PIdleScheduler::Msg_StartedGC' discarded: actor cannot send: file /builds/worker/checkouts/gecko/ipc/glue/ProtocolUtils.cpp:506
[task 2022-03-29T03:41:19.179Z] 03:41:19     INFO - GECKO(10100) | [Child 6416, Main Threa[dChi]ld  5W4A24R, NMIaNiGn:  TIhPrC ead]m WeAsRsaNIgNeG:  NS_E'NSPUIREd_leTSRcUhEe(Prdefuelreenrces:::In:itMStatsicMgem_bDerso(ne)) GfC'ai dled: isfcarildeed: a ct/buoilrd sc/awnonort ksened: rfile/ che/bcuildksou/tworkser/ch/eckoguectks/ogeck/omo/dipcule/glsue/P/rliboptocorelUf/tils.cPrppef:5er06
[task 2022-03-29T03:41:19.180Z] 03:41:19     INFO - GECKO(10100) | ences.cpp:4465
[task 2022-03-29T03:41:19.184Z] 03:41:19     INFO - GECKO(10100) | [Child 6416, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp:4465
[task 2022-03-29T03:41:19.200Z] 03:41:19     INFO - GECKO(10100) | [Child 3948: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 0 (1e12580c800) [pid = 3948] [serial = 11] [outer = 0] [url = about:blank]
[task 2022-03-29T03:41:19.203Z] 03:41:19     INFO - GECKO(10100) | [Child 8208: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 2 (27646215800) [pid = 8208] [serial = 4] [outer = 0] [url = about:blank]
[task 2022-03-29T03:41:19.442Z] 03:41:19     INFO - GECKO(10100) | [Parent 384, IPC I/O Parent] WARNING: file /builds/worker/checkouts/gecko/ipc/chromium/src/base/process_util_win.cc:167
[task 2022-03-29T03:41:19.444Z] 03:41:19     INFO - GECKO(10100) | [Parent 384, IPC I/O Parent] WARNING: file /builds/worker/checkouts/gecko/ipc/chromium/src/base/process_util_win.cc:167
[task 2022-03-29T03:41:19.447Z] 03:41:19     INFO - GECKO(10100) | [2022-03-29T03:41:19Z WARN  webrender::device::gl] Missing optimized shader source for gpu_cache_update
[task 2022-03-29T03:41:19.457Z] 03:41:19     INFO - GECKO(10100) | Hit MOZ_CRASH(attempt to subtract with overflow) at gfx/wr/webrender/src/renderer/upload.rs:773
[task 2022-03-29T03:41:19.570Z] 03:41:19     INFO -  Initializing stack-fixing for the first stack frame, this may take a while...
[task 2022-03-29T03:41:29.577Z] 03:41:29     INFO - GECKO(10100) | #01: RustMozCrash(char const*, int, char const*) [mozglue/static/rust/wrappers.cpp:17]
[task 2022-03-29T03:41:29.578Z] 03:41:29     INFO - GECKO(10100) | #02: mozglue_static::panic_hook(core::panic::panic_info::PanicInfo*) [mozglue/static/rust/lib.rs:91]
[task 2022-03-29T03:41:29.579Z] 03:41:29     INFO - GECKO(10100) | #03: core::ops::function::Fn::call<void (*)(ref$<core::panic::panic_info::PanicInfo>),tuple$<ref$<core::panic::panic_info::PanicInfo> > >(void (**)(core::panic::panic_info::PanicInfo*), core::panic::panic_info::PanicInfo*) [git:github.com/rust-lang/rust:../9d1b2106e23b1abd32fce1f17267604a5102f57a/library/core/src/ops/function.rs:9d1b2106e23b1abd32fce1f17267604a5102f57a:70]
[task 2022-03-29T03:41:29.580Z] 03:41:29     INFO - GECKO(10100) | #04: std::panicking::rust_panic_with_hook() [git:github.com/rust-lang/rust:../9d1b2106e23b1abd32fce1f17267604a5102f57a//library/std/src/panicking.rs:9d1b2106e23b1abd32fce1f17267604a5102f57a:613]
[task 2022-03-29T03:41:29.581Z] 03:41:29     INFO - GECKO(10100) | #05: std::panicking::begin_panic_handler::closure$0() [git:github.com/rust-lang/rust:../9d1b2106e23b1abd32fce1f17267604a5102f57a//library/std/src/panicking.rs:9d1b2106e23b1abd32fce1f17267604a5102f57a:500]
[task 2022-03-29T03:41:29.582Z] 03:41:29     INFO - GECKO(10100) | #06: std::sys_common::backtrace::__rust_end_short_backtrace<std::panicking::begin_panic_handler::closure$0,never$>() [git:github.com/rust-lang/rust:../9d1b2106e23b1abd32fce1f17267604a5102f57a//library/std/src/sys_common/backtrace.rs:9d1b2106e23b1abd32fce1f17267604a5102f57a:139]
[task 2022-03-29T03:41:29.582Z] 03:41:29     INFO - GECKO(10100) | #07: std::panicking::begin_panic_handler() [git:github.com/rust-lang/rust:../9d1b2106e23b1abd32fce1f17267604a5102f57a//library/std/src/panicking.rs:9d1b2106e23b1abd32fce1f17267604a5102f57a:498]
[task 2022-03-29T03:41:29.583Z] 03:41:29     INFO - GECKO(10100) | #08: core::panicking::panic_fmt() [git:github.com/rust-lang/rust:../9d1b2106e23b1abd32fce1f17267604a5102f57a//library/core/src/panicking.rs:9d1b2106e23b1abd32fce1f17267604a5102f57a:116]
[task 2022-03-29T03:41:29.584Z] 03:41:29     INFO - GECKO(10100) | #09: core::panicking::panic() [git:github.com/rust-lang/rust:../9d1b2106e23b1abd32fce1f17267604a5102f57a//library/core/src/panicking.rs:9d1b2106e23b1abd32fce1f17267604a5102f57a:48]
[task 2022-03-29T03:41:29.585Z] 03:41:29     INFO - GECKO(10100) | #10: webrender::renderer::Renderer::render_impl(webrender_api::DocumentId, webrender::internal_types::RenderedDocument*, enum$<core::option::Option<euclid::size::Size2D<i32,webrender_api::units::DevicePixel> > >, unsigned long long) [gfx/wr/webrender/src/renderer/mod.rs:2172]
[task 2022-03-29T03:41:29.586Z] 03:41:29     INFO - GECKO(10100) | #11: webrender::renderer::Renderer::render(euclid::size::Size2D<i32,webrender_api::units::DevicePixel>, unsigned long long) [gfx/wr/webrender/src/renderer/mod.rs:1731]
[task 2022-03-29T03:41:29.586Z] 03:41:29     INFO - GECKO(10100) | #12: webrender_bindings::bindings::wr_renderer_render(webrender::renderer::Renderer*, int, int, unsigned long long, webrender::renderer::RendererStats*, thin_vec::ThinVec<euclid::box2d::Box2D<i32,webrender_api::units::DevicePixel> >*) [gfx/webrender_bindings/src/bindings.rs:620]
[task 2022-03-29T03:41:29.587Z] 03:41:29     INFO - GECKO(10100) | #13: mozilla::wr::RendererOGL::UpdateAndRender(mozilla::Maybe<mozilla::gfx::IntSizeTyped<mozilla::gfx::UnknownUnits> > const&, mozilla::Maybe<mozilla::wr::ImageFormat> const&, mozilla::Maybe<mozilla::Range<unsigned char> > const&, bool*, mozilla::wr::RendererStats*) [gfx/webrender_bindings/RendererOGL.cpp:185]
[task 2022-03-29T03:41:29.588Z] 03:41:29     INFO - GECKO(10100) | #14: mozilla::wr::RenderThread::UpdateAndRender(mozilla::wr::WrWindowId, mozilla::layers::BaseTransactionId<mozilla::VsyncIdType> const&, mozilla::TimeStamp const&, bool, mozilla::Maybe<mozilla::gfx::IntSizeTyped<mozilla::gfx::UnknownUnits> > const&, mozilla::Maybe<mozilla::wr::ImageFormat> const&, mozilla::Maybe<mozilla::Range<unsigned char> > const&, bool*) [gfx/webrender_bindings/RenderThread.cpp:535]
[task 2022-03-29T03:41:29.590Z] 03:41:29     INFO - GECKO(10100) | #15: mozilla::wr::RenderThread::HandleFrameOneDoc(mozilla::wr::WrWindowId, bool) [gfx/webrender_bindings/RenderThread.cpp:391]
[task 2022-03-29T03:41:29.590Z] 03:41:29     INFO - GECKO(10100) | #16: mozilla::detail::RunnableMethodImpl<mozilla::wr::RenderThread *,void (mozilla::wr::RenderThread::*)(mozilla::wr::WrWindowId, bool),1,mozilla::RunnableKind::Standard,mozilla::wr::WrWindowId,bool>::Run() [xpcom/threads/nsThreadUtils.h:1203]
[task 2022-03-29T03:41:29.591Z] 03:41:29     INFO - GECKO(10100) | #17: nsThread::ProcessNextEvent(bool, bool*) [xpcom/threads/nsThread.cpp:1181]
[task 2022-03-29T03:41:29.592Z] 03:41:29     INFO - GECKO(10100) | #18: NS_ProcessNextEvent(nsIThread*, bool) [xpcom/threads/nsThreadUtils.cpp:465]
[task 2022-03-29T03:41:29.592Z] 03:41:29     INFO - GECKO(10100) | #19: mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) [ipc/glue/MessagePump.cpp:301]
[task 2022-03-29T03:41:29.593Z] 03:41:29     INFO - GECKO(10100) | #20: MessageLoop::RunHandler() [ipc/chromium/src/base/message_loop.cc:374]
[task 2022-03-29T03:41:29.593Z] 03:41:29     INFO - GECKO(10100) | #21: MessageLoop::Run() [ipc/chromium/src/base/message_loop.cc:356]
[task 2022-03-29T03:41:29.594Z] 03:41:29     INFO - GECKO(10100) | #22: static nsThread::ThreadFunc(void*) [xpcom/threads/nsThread.cpp:387]
[task 2022-03-29T03:41:29.769Z] 03:41:29     INFO - GECKO(10100) | #23: PR_NativeRunThread(void*) [nsprpub/pr/src/threads/combined/pruthr.c:408]
[task 2022-03-29T03:41:29.769Z] 03:41:29     INFO - GECKO(10100) | #24: pr_root(void*) [nsprpub/pr/src/md/windows/w95thred.c:140]
[task 2022-03-29T03:41:29.773Z] 03:41:29     INFO -  fix-stacks: error: failed to read debug info file `ucrtbase.pdb` for `C:\windows\System32\ucrtbase.dll`
[task 2022-03-29T03:41:29.773Z] 03:41:29     INFO -  fix-stacks: note: this is expected and harmless for all PDB files on opt automation runs
[task 2022-03-29T03:41:29.774Z] 03:41:29     INFO -  fix-stacks: The system cannot find the file specified. (os error 2)
[task 2022-03-29T03:41:29.774Z] 03:41:29     INFO - GECKO(10100) | #25: o_ceil [C:\windows\System32\ucrtbase.dll + 0x1c4be]

[task 2022-03-29T03:41:33.520Z] 03:41:33     INFO - PROCESS-CRASH | Main app process exited normally | application crashed [@ RustMozCrash(char const*, int, char const*)]
[task 2022-03-29T03:41:33.520Z] 03:41:33     INFO - Mozilla crash reason: attempt to subtract with overflow
[task 2022-03-29T03:41:33.520Z] 03:41:33     INFO - Crash dump filename: C:\Users\task_1648504984\AppData\Local\Temp\tmp_1ce16l5.mozrunner\minidumps\f42f4f93-cab9-4ef6-b2de-c5d64d3a3060.dmp
[task 2022-03-29T03:41:33.521Z] 03:41:33     INFO - Operating system: Windows NT
[task 2022-03-29T03:41:33.521Z] 03:41:33     INFO -                   10.0.17134
[task 2022-03-29T03:41:33.521Z] 03:41:33     INFO - CPU: amd64
[task 2022-03-29T03:41:33.521Z] 03:41:33     INFO -      family 6 model 94 stepping 3
[task 2022-03-29T03:41:33.521Z] 03:41:33     INFO -      8 CPUs
[task 2022-03-29T03:41:33.521Z] 03:41:33     INFO - 
[task 2022-03-29T03:41:33.521Z] 03:41:33     INFO - Crash reason:  EXCEPTION_BREAKPOINT
[task 2022-03-29T03:41:33.521Z] 03:41:33     INFO - Crash address: 0x7ffe60e632b3
[task 2022-03-29T03:41:33.521Z] 03:41:33     INFO - Process uptime: 11 seconds
[task 2022-03-29T03:41:33.521Z] 03:41:33     INFO - 
[task 2022-03-29T03:41:33.521Z] 03:41:33     INFO - Thread 8 Renderer (crashed)
[task 2022-03-29T03:41:33.522Z] 03:41:33     INFO -  0  xul.dll!RustMozCrash(char const*, int, char const*) [wrappers.cpp:e4671795ebee9b38646875da2f8e87acb685dd6e : 17 + 0x23]
[task 2022-03-29T03:41:33.522Z] 03:41:33     INFO -      rax = 0x00007ffe7d211b60    rdx = 0x0000000000000000
[task 2022-03-29T03:41:33.522Z] 03:41:33     INFO -      rcx = 0x0000000000000000    rbx = 0x00007ffe628510ea
[task 2022-03-29T03:41:33.522Z] 03:41:33     INFO -      rsi = 0x000000010013d762    rdi = 0x0000000000000305
[task 2022-03-29T03:41:33.522Z] 03:41:33     INFO -      rbp = 0x000000010013d5b0    rsp = 0x000000010013d4f0
[task 2022-03-29T03:41:33.522Z] 03:41:33     INFO -       r8 = 0x000000010013f800     r9 = 0x0000000000000021
[task 2022-03-29T03:41:33.522Z] 03:41:33     INFO -      r10 = 0x000000010013f7b0    r11 = 0x00007ffe9dbb0000
[task 2022-03-29T03:41:33.522Z] 03:41:33     INFO -      r12 = 0x00007ffe6275d7d0    r13 = 0x00007ffe62851828
[task 2022-03-29T03:41:33.522Z] 03:41:33     INFO -      r14 = 0x00007ffe62835890    r15 = 0x0000000000000021
[task 2022-03-29T03:41:33.523Z] 03:41:33     INFO -      rip = 0x00007ffe60e632b3
[task 2022-03-29T03:41:33.523Z] 03:41:33     INFO -     Found by: given as instruction pointer in context
[task 2022-03-29T03:41:33.523Z] 03:41:33     INFO -  1  xul.dll!mozglue_static::panic_hook(core::panic::panic_info::PanicInfo*) [lib.rs:e4671795ebee9b38646875da2f8e87acb685dd6e : 91 + 0x6]
[task 2022-03-29T03:41:33.523Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.523Z] 03:41:33     INFO -      rsp = 0x000000010013d530    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.523Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.523Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe5f8091b4
[task 2022-03-29T03:41:33.523Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.523Z] 03:41:33     INFO -  2  xul.dll!core::ops::function::Fn::call<void (*)(ref$<core::panic::panic_info::PanicInfo>),tuple$<ref$<core::panic::panic_info::PanicInfo> > >(void (**)(core::panic::panic_info::PanicInfo*), core::panic::panic_info::PanicInfo*) [function.rs:9d1b2106e23b1abd32fce1f17267604a5102f57a : 70 + 0x11]
[task 2022-03-29T03:41:33.524Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.524Z] 03:41:33     INFO -      rsp = 0x000000010013d9a0    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.524Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.524Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe5f808f12
[task 2022-03-29T03:41:33.524Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.524Z] 03:41:33     INFO -  3  xul.dll!std::panicking::rust_panic_with_hook() [panicking.rs:9d1b2106e23b1abd32fce1f17267604a5102f57a : 610 + 0x8]
[task 2022-03-29T03:41:33.524Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.524Z] 03:41:33     INFO -      rsp = 0x000000010013d9d0    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.524Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.524Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe605e4686
[task 2022-03-29T03:41:33.524Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.524Z] 03:41:33     INFO -  4  xul.dll!std::panicking::begin_panic_handler::closure$0() [panicking.rs:9d1b2106e23b1abd32fce1f17267604a5102f57a : 500 + 0x25]
[task 2022-03-29T03:41:33.524Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.525Z] 03:41:33     INFO -      rsp = 0x000000010013dad0    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.525Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.525Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe605e445f
[task 2022-03-29T03:41:33.525Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.525Z] 03:41:33     INFO -  5  xul.dll!std::sys_common::backtrace::__rust_end_short_backtrace<std::panicking::begin_panic_handler::closure$0,never$>() [backtrace.rs:9d1b2106e23b1abd32fce1f17267604a5102f57a : 139 + 0x12]
[task 2022-03-29T03:41:33.525Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.525Z] 03:41:33     INFO -      rsp = 0x000000010013db40    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.525Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.525Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe605e0db7
[task 2022-03-29T03:41:33.525Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.526Z] 03:41:33     INFO -  6  xul.dll!std::panicking::begin_panic_handler() [panicking.rs:9d1b2106e23b1abd32fce1f17267604a5102f57a : 498 + 0x18]
[task 2022-03-29T03:41:33.526Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.526Z] 03:41:33     INFO -      rsp = 0x000000010013db70    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.526Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.526Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe605e4189
[task 2022-03-29T03:41:33.526Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.526Z] 03:41:33     INFO -  7  xul.dll!core::panicking::panic_fmt() [panicking.rs:9d1b2106e23b1abd32fce1f17267604a5102f57a : 116 + 0x4]
[task 2022-03-29T03:41:33.526Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.526Z] 03:41:33     INFO -      rsp = 0x000000010013dbc0    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.526Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.526Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe6121c160
[task 2022-03-29T03:41:33.527Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.527Z] 03:41:33     INFO -  8  xul.dll!core::panicking::panic() [panicking.rs:9d1b2106e23b1abd32fce1f17267604a5102f57a : 48 + 0x7]
[task 2022-03-29T03:41:33.527Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.527Z] 03:41:33     INFO -      rsp = 0x000000010013dc10    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.527Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.527Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe6121c0ac
[task 2022-03-29T03:41:33.527Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.527Z] 03:41:33     INFO -  9  xul.dll!webrender::renderer::Renderer::render_impl(webrender_api::DocumentId, webrender::internal_types::RenderedDocument*, enum$<core::option::Option<euclid::size::Size2D<i32,webrender_api::units::DevicePixel> > >, unsigned long long) [mod.rs:e4671795ebee9b38646875da2f8e87acb685dd6e : 2172 + 0x17]
[task 2022-03-29T03:41:33.527Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.527Z] 03:41:33     INFO -      rsp = 0x000000010013dc80    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.528Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.528Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe60b90657
[task 2022-03-29T03:41:33.528Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.528Z] 03:41:33     INFO - 10  xul.dll!webrender::renderer::Renderer::render(euclid::size::Size2D<i32,webrender_api::units::DevicePixel>, unsigned long long) [mod.rs:e4671795ebee9b38646875da2f8e87acb685dd6e : 1731 + 0x39]
[task 2022-03-29T03:41:33.528Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.528Z] 03:41:33     INFO -      rsp = 0x000000010013e1e0    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.528Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.528Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe60b8a750
[task 2022-03-29T03:41:33.528Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.528Z] 03:41:33     INFO - 11  xul.dll!webrender_bindings::bindings::wr_renderer_render(webrender::renderer::Renderer*, int, int, unsigned long long, webrender::renderer::RendererStats*, thin_vec::ThinVec<euclid::box2d::Box2D<i32,webrender_api::units::DevicePixel> >*) [bindings.rs:e4671795ebee9b38646875da2f8e87acb685dd6e : 620 + 0x10]
[task 2022-03-29T03:41:33.528Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.528Z] 03:41:33     INFO -      rsp = 0x000000010013ea80    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.529Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.529Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe5f745c75
[task 2022-03-29T03:41:33.529Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.529Z] 03:41:33     INFO - 12  xul.dll!mozilla::wr::RendererOGL::UpdateAndRender(mozilla::Maybe<mozilla::gfx::IntSizeTyped<mozilla::gfx::UnknownUnits> > const&, mozilla::Maybe<mozilla::wr::ImageFormat> const&, mozilla::Maybe<mozilla::Range<unsigned char> > const&, bool*, mozilla::wr::RendererStats*) [RendererOGL.cpp:e4671795ebee9b38646875da2f8e87acb685dd6e : 185 + 0x2b]
[task 2022-03-29T03:41:33.529Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.529Z] 03:41:33     INFO -      rsp = 0x000000010013ecb0    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.529Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.529Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe59831f0e
[task 2022-03-29T03:41:33.529Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.529Z] 03:41:33     INFO - 13  xul.dll!mozilla::wr::RenderThread::UpdateAndRender(mozilla::wr::WrWindowId, mozilla::layers::BaseTransactionId<mozilla::VsyncIdType> const&, mozilla::TimeStamp const&, bool, mozilla::Maybe<mozilla::gfx::IntSizeTyped<mozilla::gfx::UnknownUnits> > const&, mozilla::Maybe<mozilla::wr::ImageFormat> const&, mozilla::Maybe<mozilla::Range<unsigned char> > const&, bool*) [RenderThread.cpp:e4671795ebee9b38646875da2f8e87acb685dd6e : 535 + 0x3b]
[task 2022-03-29T03:41:33.529Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.529Z] 03:41:33     INFO -      rsp = 0x000000010013ed50    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.529Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.530Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe59830f34
[task 2022-03-29T03:41:33.530Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.530Z] 03:41:33     INFO - 14  xul.dll!mozilla::wr::RenderThread::HandleFrameOneDoc(mozilla::wr::WrWindowId, bool) [RenderThread.cpp:e4671795ebee9b38646875da2f8e87acb685dd6e : 385 + 0x4f]
[task 2022-03-29T03:41:33.530Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.530Z] 03:41:33     INFO -      rsp = 0x000000010013ef60    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.530Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.530Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe598303ad
[task 2022-03-29T03:41:33.530Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.530Z] 03:41:33     INFO - 15  xul.dll!mozilla::detail::RunnableMethodImpl<mozilla::wr::RenderThread *,void (mozilla::wr::RenderThread::*)(mozilla::wr::WrWindowId, bool),1,mozilla::RunnableKind::Standard,mozilla::wr::WrWindowId,bool>::Run() [nsThreadUtils.h:e4671795ebee9b38646875da2f8e87acb685dd6e : 1200 + 0x11]
[task 2022-03-29T03:41:33.530Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.530Z] 03:41:33     INFO -      rsp = 0x000000010013f0d0    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.530Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.531Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe59843c32
[task 2022-03-29T03:41:33.531Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.531Z] 03:41:33     INFO - 16  xul.dll!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:e4671795ebee9b38646875da2f8e87acb685dd6e : 1181 + 0xc]
[task 2022-03-29T03:41:33.531Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.531Z] 03:41:33     INFO -      rsp = 0x000000010013f100    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.531Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.531Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe584d5784
[task 2022-03-29T03:41:33.531Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.531Z] 03:41:33     INFO - 17  xul.dll!NS_ProcessNextEvent(nsIThread*, bool) [nsThreadUtils.cpp:e4671795ebee9b38646875da2f8e87acb685dd6e : 465 + 0x16]
[task 2022-03-29T03:41:33.531Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.531Z] 03:41:33     INFO -      rsp = 0x000000010013f2e0    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.531Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.532Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe584dca85
[task 2022-03-29T03:41:33.532Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.532Z] 03:41:33     INFO - 18  xul.dll!mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) [MessagePump.cpp:e4671795ebee9b38646875da2f8e87acb685dd6e : 300 + 0x9]
[task 2022-03-29T03:41:33.532Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.532Z] 03:41:33     INFO -      rsp = 0x000000010013f330    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.532Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.532Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe58f0e1b7
[task 2022-03-29T03:41:33.532Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.532Z] 03:41:33     INFO - 19  xul.dll!MessageLoop::RunHandler() [message_loop.cc:e4671795ebee9b38646875da2f8e87acb685dd6e : 373 + 0x7]
[task 2022-03-29T03:41:33.532Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.532Z] 03:41:33     INFO -      rsp = 0x000000010013f3a0    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.532Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.532Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe58e91f40
[task 2022-03-29T03:41:33.532Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.533Z] 03:41:33     INFO - 20  xul.dll!MessageLoop::Run() [message_loop.cc:e4671795ebee9b38646875da2f8e87acb685dd6e : 355 + 0x4]
[task 2022-03-29T03:41:33.533Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.533Z] 03:41:33     INFO -      rsp = 0x000000010013f3f0    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.533Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.533Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe58e91dfd
[task 2022-03-29T03:41:33.533Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.533Z] 03:41:33     INFO - 21  xul.dll!static nsThread::ThreadFunc(void*) [nsThread.cpp:e4671795ebee9b38646875da2f8e87acb685dd6e : 385 + 0x7]
[task 2022-03-29T03:41:33.533Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.533Z] 03:41:33     INFO -      rsp = 0x000000010013f440    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.533Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.533Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe584d0aca
[task 2022-03-29T03:41:33.533Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.533Z] 03:41:33     INFO - 22  nss3.dll!PR_NativeRunThread(void*) [pruthr.c:e4671795ebee9b38646875da2f8e87acb685dd6e : 399 + 0xd]
[task 2022-03-29T03:41:33.534Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.534Z] 03:41:33     INFO -      rsp = 0x000000010013f630    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.534Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.534Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe81a18c22
[task 2022-03-29T03:41:33.534Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.534Z] 03:41:33     INFO - 23  nss3.dll!pr_root(void*) [w95thred.c:e4671795ebee9b38646875da2f8e87acb685dd6e : 139 + 0xc]
[task 2022-03-29T03:41:33.534Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.534Z] 03:41:33     INFO -      rsp = 0x000000010013f6b0    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.534Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe81a09571
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO - 24  ucrtbase.dll!thread_start<unsigned int (__cdecl*)(void * __ptr64)> + 0x3d
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO -      rsp = 0x000000010013f6e0    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe99f9c4be
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO - 25  kernel32.dll!BaseThreadInitThunk + 0x13
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO -      rsp = 0x000000010013f710    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe9d913034
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO - 26  mozglue.dll!patched_BaseThreadInitThunk(int, void*, void*) [WindowsDllBlocklist.cpp:e4671795ebee9b38646875da2f8e87acb685dd6e : 568 + 0x28]
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.535Z] 03:41:33     INFO -      rsp = 0x000000010013f740    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.536Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.536Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe7d1927c4
[task 2022-03-29T03:41:33.536Z] 03:41:33     INFO -     Found by: call frame info
[task 2022-03-29T03:41:33.536Z] 03:41:33     INFO - 27  ntdll.dll!RtlUserThreadStart + 0x20
[task 2022-03-29T03:41:33.536Z] 03:41:33     INFO -      rbx = 0x00007ffe628510ea    rbp = 0x000000010013d5b0
[task 2022-03-29T03:41:33.536Z] 03:41:33     INFO -      rsp = 0x000000010013f7b0    r12 = 0x00007ffe6275d7d0
[task 2022-03-29T03:41:33.536Z] 03:41:33     INFO -      r13 = 0x00007ffe62851828    r14 = 0x00007ffe62835890
[task 2022-03-29T03:41:33.536Z] 03:41:33     INFO -      r15 = 0x0000000000000021    rip = 0x00007ffe9dc21461
[task 2022-03-29T03:41:33.536Z] 03:41:33     INFO -     Found by: call frame info

Comment 16

[Intermittent Failures Robot]

44 failures in 3323 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #19 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 12
• mozilla-central: 32

Platform and build breakdown:

• windows10-64-2004-qr: 14
  • debug: 14
• windows10-32-2004-mingwclang-qr: 14
  • debug: 14
• windows10-64-2004-mingwclang-qr: 14
  • debug: 14
• windows10-32-2004-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-03-28&endday=2022-04-03&tree=all

Comment 17

[Andreea Pavel [:apavel]]

Hi Kelsey, are you working on this?

Comment 18

[Kelsey Gilbert [:jgilbert]]

I believe jimb is fixing this over in bug 1752215. Is that right?

Comment 19

[Jim Blandy :jimb]

The fix for that may well address this crash as well. I'll be verifying today or tomorrow.

Comment 20

[Jim Blandy :jimb]

This error:

MOZ_CRASH Reason: assertion failed: `(left == right)` left: `1`, right: `2`: Device[0] is no longer alive

means that the epoch check failed. This makes it more likely that bug 1752215 will fix this one, too.

Comment 21

[Intermittent Failures Robot]

28 failures in 2922 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #35 most frequent failure this week.

Repository breakdown:

• autoland: 6
• mozilla-central: 20
• try: 2

Platform and build breakdown:

• windows10-64-2004-qr: 11
  • debug: 11
• windows10-64-2004-mingwclang-qr: 8
  • debug: 8
• windows10-32-2004-mingwclang-qr: 8
  • debug: 8
• windows10-32-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-04-04&endday=2022-04-10&tree=all

Comment 22

[Kelsey Gilbert [:jgilbert]]

Did you get a chance to try this again?

Comment 23

[Intermittent Failures Robot]

10 failures in 2948 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 4

Platform and build breakdown:

• windows10-64-2004-qr: 9
  • debug: 9
• windows10-32-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-04-11&endday=2022-04-17&tree=all

Comment 24

[Jim Blandy :jimb]

Not yet - will do so now.

Comment 25

[Jim Blandy :jimb]

In trying to reproduce this in a2aa25965e8b, just before the wgpu update for bug 1762730 I can get:

Hit MOZ_CRASH(Device[4] does not exist) at /home/jimb/moz/central/third_party/rust/wgpu-core/src/hub.rs:116

pretty easily but not the "Device[n] is no longer alive" message. However, the only difference there is whether the wgpu Hub id index got reused, so this should be just as good. Both assertions are in wgpu_core::hub::Storage<T>::get.

In 0b5d13bcf367, just after the wgpu update, I can't reproduce this because the WGSL syntax changed, and none of the examples run at all.

I want to fix the wgpu.rs examples anyway (that site's contents are a repo in the gfx-rs org), so I'll be able to have both pre- and post-update examples on hand, and can use that to see if this is fixed. (I'm still expecting this to be fixed.)

Comment 26

[Jim Blandy :jimb]

wgpu.rs is, in part, automatically generated from wgpu by CI jobs. Updating the gecko branch in the wgpu repository automatically regenerates the examples and publishes them on the web site. However, the CI is currently hitting a problem: https://github.com/gfx-rs/wgpu/issues/2620

Comment 27

[Jim Blandy :jimb]

Okay, this no longer crashes on current M-C. All the wgpu.rs examples work (or at least don't crash). The original austin-eng.com page is using the old WGSL syntax, so I can't test it directly.

Anyway, since I was able to get crashes before, but no longer, I'm calling this fixed.

Comment 28

[Intermittent Failures Robot]

9 failures in 3159 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• mozilla-central: 5
• autoland: 3

Platform and build breakdown:

• windows10-64-2004-qr: 7
  • debug: 7
• windows10-32-2004-qr: 1
  • debug: 1
• android-em-7-0-x86_64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-04-18&endday=2022-04-24&tree=all

Comment 29

[Andreea Pavel [:apavel]]

Hi Jim. We still see failures with this crash signature [@ RustMozCrash(char const*, int, char const*)], should we file a separate bug?

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=375769353&repo=autoland&lineNumber=57842

[task 2022-04-26T03:05:03.362Z] 03:05:03     INFO - TEST-INFO | Main app process: exit 0
[task 2022-04-26T03:05:03.363Z] 03:05:03     INFO - TEST-INFO | Confirming we saw 36 DOCSHELL created and 36 destroyed log strings.
[task 2022-04-26T03:05:03.363Z] 03:05:03     INFO - TEST-INFO | Confirming we saw 103 DOMWINDOW created and 103 destroyed log strings.
[task 2022-04-26T03:05:03.364Z] 03:05:03     INFO - TEST-INFO | remote/shared/listeners/test/browser/browser_BrowsingContextListener.js | This test created 1 hidden window(s)
[task 2022-04-26T03:05:03.364Z] 03:05:03     INFO - TEST-INFO | remote/shared/listeners/test/browser/browser_BrowsingContextListener.js | This test created 1 hidden docshell(s)
[task 2022-04-26T03:05:03.365Z] 03:05:03     INFO - runtests.py | Application ran for: 0:00:21.265731
[task 2022-04-26T03:05:03.365Z] 03:05:03     INFO - zombiecheck | Reading PID log: C:\Users\task_1650924657\AppData\Local\Temp\tmpuxa9v8ngpidlog
[task 2022-04-26T03:05:03.366Z] 03:05:03     INFO - ==> process 8168 launched child process 7556 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.0.355186864\283582679" -parentBuildID 20220426020720 -prefsHandle 1860 -prefMapHandle 1836 -prefsLen 1 -prefMapSize 263461 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 1940 1eef0dfee80 gpu)
[task 2022-04-26T03:05:03.367Z] 03:05:03     INFO - ==> process 8168 launched child process 9164 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.1.1360530205\1917587795" -childID 1 -isForBrowser -prefsHandle 2568 -prefMapHandle 2564 -prefsLen 1641 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 2552 1eef5556b80 tab)
[task 2022-04-26T03:05:03.368Z] 03:05:03     INFO - ==> process 8168 launched child process 356 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.2.1521460389\1012981315" -childID 2 -isForBrowser -prefsHandle 2912 -prefMapHandle 2928 -prefsLen 1747 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 2800 1eef4b1a480 tab)
[task 2022-04-26T03:05:03.369Z] 03:05:03     INFO - ==> process 8168 launched child process 7352 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.3.2122111729\160216768" -childID 3 -isForBrowser -prefsHandle 3172 -prefMapHandle 3168 -prefsLen 1822 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 3184 1eef65c8480 tab)
[task 2022-04-26T03:05:03.370Z] 03:05:03     INFO - ==> process 8168 launched child process 8612 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.4.1517655934\959829496" -childID 4 -isForBrowser -prefsHandle 2792 -prefMapHandle 3440 -prefsLen 1991 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 3428 1eef3b7db80 tab)
[task 2022-04-26T03:05:03.372Z] 03:05:03     INFO - ==> process 8168 launched child process 3032 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.5.244389431\381940802" -childID 5 -isForBrowser -prefsHandle 3660 -prefMapHandle 2552 -prefsLen 1991 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 2548 1eef6461880 tab)
[task 2022-04-26T03:05:03.373Z] 03:05:03     INFO - ==> process 8168 launched child process 2072 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.6.416875048\1023593672" -childID 6 -isForBrowser -prefsHandle 3708 -prefMapHandle 3712 -prefsLen 2024 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 3700 1eef15de580 tab)
[task 2022-04-26T03:05:03.374Z] 03:05:03     INFO - ==> process 8168 launched child process 7660 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.7.1443306037\1704994060" -childID 7 -isForBrowser -prefsHandle 4564 -prefMapHandle 4560 -prefsLen 10010 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 4412 1eefb26d580 tab)
[task 2022-04-26T03:05:03.375Z] 03:05:03     INFO - ==> process 8168 launched child process 4708 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.8.1889359016\1257816026" -childID 8 -isForBrowser -prefsHandle 4964 -prefMapHandle 4960 -prefsLen 10010 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 1420 1eefd83e880 tab)
[task 2022-04-26T03:05:03.376Z] 03:05:03     INFO - ==> process 8168 launched child process 5052 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.9.1618258786\1918825177" -childID 9 -isForBrowser -prefsHandle 4580 -prefMapHandle 4556 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 4480 1eef6b85c80 tab)
[task 2022-04-26T03:05:03.377Z] 03:05:03     INFO - ==> process 8168 launched child process 6420 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.10.1291292080\287615800" -childID 10 -isForBrowser -prefsHandle 5116 -prefMapHandle 4680 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 1428 1eef9571a80 tab)
[task 2022-04-26T03:05:03.378Z] 03:05:03     INFO - ==> process 8168 launched child process 8152 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.11.2041284753\1719510529" -childID 11 -isForBrowser -prefsHandle 4884 -prefMapHandle 4476 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 5216 1eef6b86880 tab)
[task 2022-04-26T03:05:03.379Z] 03:05:03     INFO - ==> process 8168 launched child process 4132 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.12.2144861538\1096865565" -childID 12 -isForBrowser -prefsHandle 5416 -prefMapHandle 5420 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 5000 1eefdbde680 tab)
[task 2022-04-26T03:05:03.380Z] 03:05:03     INFO - ==> process 8168 launched child process 1900 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.13.180534880\745682748" -childID 13 -isForBrowser -prefsHandle 5212 -prefMapHandle 5260 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 4884 1eefdbdd780 tab)
[task 2022-04-26T03:05:03.381Z] 03:05:03     INFO - ==> process 8168 launched child process 1924 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.14.619878765\1600076413" -childID 14 -isForBrowser -prefsHandle 5168 -prefMapHandle 5208 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 4740 1eefdbdec80 tab)
[task 2022-04-26T03:05:03.382Z] 03:05:03     INFO - ==> process 8168 launched child process 8808 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.15.1722462688\2024033758" -childID 15 -isForBrowser -prefsHandle 4568 -prefMapHandle 5288 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 5040 1eefdc04780 tab)
[task 2022-04-26T03:05:03.383Z] 03:05:03     INFO - ==> process 8168 launched child process 3916 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.16.32719025\2083701878" -childID 16 -isForBrowser -prefsHandle 5384 -prefMapHandle 5052 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 4560 1eefdbdd780 tab)
[task 2022-04-26T03:05:03.384Z] 03:05:03     INFO - ==> process 8168 launched child process 4336 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.17.915600038\1778259094" -childID 17 -isForBrowser -prefsHandle 5044 -prefMapHandle 5152 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 5528 1eefdc03e80 tab)
[task 2022-04-26T03:05:03.385Z] 03:05:03     INFO - ==> process 8168 launched child process 3780 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.18.1630548069\864456115" -childID 18 -isForBrowser -prefsHandle 4644 -prefMapHandle 4592 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 4620 1eefdbde980 tab)
[task 2022-04-26T03:05:03.386Z] 03:05:03     INFO - ==> process 8168 launched child process 492 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.19.1134956292\707465118" -childID 19 -isForBrowser -prefsHandle 5256 -prefMapHandle 5392 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 5892 1eefdc03280 tab)
[task 2022-04-26T03:05:03.387Z] 03:05:03     INFO - ==> process 8168 launched child process 6480 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.20.1747122078\2013767507" -childID 20 -isForBrowser -prefsHandle 5336 -prefMapHandle 5248 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 5856 1eee4834580 tab)
[task 2022-04-26T03:05:03.388Z] 03:05:03     INFO - ==> process 8168 launched child process 6244 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.21.266062809\592415260" -childID 21 -isForBrowser -prefsHandle 5228 -prefMapHandle 4740 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 5892 1eee487af80 tab)
[task 2022-04-26T03:05:03.390Z] 03:05:03     INFO - ==> process 8168 launched child process 960 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.22.750751834\192624551" -childID 22 -isForBrowser -prefsHandle 5704 -prefMapHandle 5480 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 5316 1eee4886980 tab)
[task 2022-04-26T03:05:03.391Z] 03:05:03     INFO - ==> process 8168 launched child process 2416 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.23.661605779\1921140846" -parentBuildID 20220426020720 -prefsHandle 3148 -prefMapHandle 4548 -prefsLen 10182 -prefMapSize 263461 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 5924 1eee4889180 gpu)
[task 2022-04-26T03:05:03.392Z] 03:05:03     INFO - ==> process 8168 launched child process 1356 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.24.213262206\940218673" -childID 23 -isForBrowser -prefsHandle 5096 -prefMapHandle 5484 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 5664 1eee487af80 tab)
[task 2022-04-26T03:05:03.393Z] 03:05:03     INFO - ==> process 8168 launched child process 8992 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.25.1134926459\1111262486" -childID 24 -isForBrowser -prefsHandle 5228 -prefMapHandle 5124 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 2816 1eee487f280 tab)
[task 2022-04-26T03:05:03.394Z] 03:05:03     INFO - ==> process 8168 launched child process 816 ("C:\Users\task_1650924657\build\application\firefox\firefox.exe" -contentproc --channel="8168.26.1838892882\326441841" -childID 25 -isForBrowser -prefsHandle 4996 -prefMapHandle 5520 -prefsLen 10182 -prefMapSize 263461 -jsInitHandle 1252 -jsInitLen 336308 -a11yResourceId 64 -parentBuildID 20220426020720 -appDir "C:\Users\task_1650924657\build\application\firefox\browser" - 8168 "\\.\pipe\gecko-crash-server-pipe.8168" 5072 1eef0043f80 tab)
[task 2022-04-26T03:05:03.395Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 7556
[task 2022-04-26T03:05:03.395Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 1924
[task 2022-04-26T03:05:03.396Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 6420
[task 2022-04-26T03:05:03.397Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 2072
[task 2022-04-26T03:05:03.397Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 8992
[task 2022-04-26T03:05:03.398Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 8612
[task 2022-04-26T03:05:03.398Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 4132
[task 2022-04-26T03:05:03.398Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 816
[task 2022-04-26T03:05:03.399Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 7352
[task 2022-04-26T03:05:03.400Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 5052
[task 2022-04-26T03:05:03.400Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 960
[task 2022-04-26T03:05:03.400Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 3780
[task 2022-04-26T03:05:03.401Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 9164
[task 2022-04-26T03:05:03.401Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 3916
[task 2022-04-26T03:05:03.402Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 1356
[task 2022-04-26T03:05:03.402Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 6480
[task 2022-04-26T03:05:03.403Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 3032
[task 2022-04-26T03:05:03.403Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 8152
[task 2022-04-26T03:05:03.404Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 356
[task 2022-04-26T03:05:03.405Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 4708
[task 2022-04-26T03:05:03.405Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 6244
[task 2022-04-26T03:05:03.406Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 8808
[task 2022-04-26T03:05:03.406Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 7660
[task 2022-04-26T03:05:03.407Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 1900
[task 2022-04-26T03:05:03.407Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 492
[task 2022-04-26T03:05:03.408Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 4336
[task 2022-04-26T03:05:03.408Z] 03:05:03     INFO - zombiecheck | Checking for orphan process with PID: 2416
[task 2022-04-26T03:05:03.416Z] 03:05:03     INFO - mozcrash Copy/paste: C:/Users/task_1650924657/fetches\minidump-stackwalk\minidump-stackwalk.exe --symbols-url=https://symbols.mozilla.org/ --human C:\Users\task_1650924657\AppData\Local\Temp\tmp_2h9qpgz.mozrunner\minidumps\814ba0c3-9804-4b5e-a9b8-e4316d7949a8.dmp C:\Users\task_1650924657\build\symbols
[task 2022-04-26T03:05:06.578Z] 03:05:06     INFO - mozcrash Saved minidump as C:\Users\task_1650924657\build\blobber_upload_dir\814ba0c3-9804-4b5e-a9b8-e4316d7949a8.dmp
[task 2022-04-26T03:05:06.579Z] 03:05:06     INFO - mozcrash Saved app info as C:\Users\task_1650924657\build\blobber_upload_dir\814ba0c3-9804-4b5e-a9b8-e4316d7949a8.extra
[task 2022-04-26T03:05:06.829Z] 03:05:06     INFO - PROCESS-CRASH | Main app process exited normally | application crashed [@ RustMozCrash(char const*, int, char const*)]
[task 2022-04-26T03:05:06.829Z] 03:05:06     INFO - Mozilla crash reason: attempt to subtract with overflow
[task 2022-04-26T03:05:06.829Z] 03:05:06     INFO - Crash dump filename: C:\Users\task_1650924657\AppData\Local\Temp\tmp_2h9qpgz.mozrunner\minidumps\814ba0c3-9804-4b5e-a9b8-e4316d7949a8.dmp
[task 2022-04-26T03:05:06.829Z] 03:05:06     INFO - Operating system: Windows NT
[task 2022-04-26T03:05:06.829Z] 03:05:06     INFO -                   10.0.17134
[task 2022-04-26T03:05:06.829Z] 03:05:06     INFO - CPU: amd64
[task 2022-04-26T03:05:06.829Z] 03:05:06     INFO -      family 6 model 94 stepping 3
[task 2022-04-26T03:05:06.830Z] 03:05:06     INFO -      8 CPUs
[task 2022-04-26T03:05:06.830Z] 03:05:06     INFO - 
[task 2022-04-26T03:05:06.830Z] 03:05:06     INFO - Crash reason:  EXCEPTION_BREAKPOINT
[task 2022-04-26T03:05:06.830Z] 03:05:06     INFO - Crash address: 0x7ff8f1491ca3
[task 2022-04-26T03:05:06.830Z] 03:05:06     INFO - Process uptime: 11 seconds
[task 2022-04-26T03:05:06.830Z] 03:05:06     INFO - 
[task 2022-04-26T03:05:06.830Z] 03:05:06     INFO - Thread 8 Renderer (crashed)
[task 2022-04-26T03:05:06.830Z] 03:05:06     INFO -  0  xul.dll!RustMozCrash(char const*, int, char const*) [wrappers.cpp:7c1264c01390b022a11684b294c87e0e343a9e91 : 17 + 0x23]
[task 2022-04-26T03:05:06.830Z] 03:05:06     INFO -      rax = 0x00007ff913893b60    rdx = 0x0000000000000000
[task 2022-04-26T03:05:06.830Z] 03:05:06     INFO -      rcx = 0x0000000000000000    rbx = 0x00007ff8f2ec8952
[task 2022-04-26T03:05:06.831Z] 03:05:06     INFO -      rsi = 0x000000d651b6df32    rdi = 0x0000000000000305
[task 2022-04-26T03:05:06.831Z] 03:05:06     INFO -      rbp = 0x000000d651b6dd80    rsp = 0x000000d651b6dcc0
[task 2022-04-26T03:05:06.831Z] 03:05:06     INFO -       r8 = 0x000000d651b6ffa0     r9 = 0x0000000000000021
[task 2022-04-26T03:05:06.831Z] 03:05:06     INFO -      r10 = 0x000000d651b6ff50    r11 = 0x00007ff930b00000
[task 2022-04-26T03:05:06.831Z] 03:05:06     INFO -      r12 = 0x00007ff8f2ec9090    r13 = 0x000000d651b6e2d0
[task 2022-04-26T03:05:06.831Z] 03:05:06     INFO -      r14 = 0x00007ff8f2ead3a0    r15 = 0x0000000000000021
[task 2022-04-26T03:05:06.832Z] 03:05:06     INFO -      rip = 0x00007ff8f1491ca3
[task 2022-04-26T03:05:06.832Z] 03:05:06     INFO -     Found by: given as instruction pointer in context
[task 2022-04-26T03:05:06.832Z] 03:05:06     INFO -  1  xul.dll!mozglue_static::panic_hook(core::panic::panic_info::PanicInfo*) [lib.rs:7c1264c01390b022a11684b294c87e0e343a9e91 : 91 + 0x6]
[task 2022-04-26T03:05:06.832Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.832Z] 03:05:06     INFO -      rsp = 0x000000d651b6dd00    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.832Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.832Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8efe27f64
[task 2022-04-26T03:05:06.832Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.832Z] 03:05:06     INFO -  2  xul.dll!core::ops::function::Fn::call<void (*)(ref$<core::panic::panic_info::PanicInfo>),tuple$<ref$<core::panic::panic_info::PanicInfo> > >(void (**)(core::panic::panic_info::PanicInfo*), core::panic::panic_info::PanicInfo*) [function.rs:7737e0b5c4103216d6fd8cf941b7ab9bdbaace7c : 70 + 0x11]
[task 2022-04-26T03:05:06.832Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.832Z] 03:05:06     INFO -      rsp = 0x000000d651b6e170    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.833Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.833Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8efe27c92
[task 2022-04-26T03:05:06.833Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.833Z] 03:05:06     INFO -  3  xul.dll!std::panicking::rust_panic_with_hook() [panicking.rs:7737e0b5c4103216d6fd8cf941b7ab9bdbaace7c : 702 + 0x9]
[task 2022-04-26T03:05:06.833Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.833Z] 03:05:06     INFO -      rsp = 0x000000d651b6e1a0    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.833Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.833Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8f0c35a81
[task 2022-04-26T03:05:06.833Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.833Z] 03:05:06     INFO -  4  xul.dll!std::panicking::begin_panic_handler::closure$0() [panicking.rs:7737e0b5c4103216d6fd8cf941b7ab9bdbaace7c : 586 + 0x34]
[task 2022-04-26T03:05:06.834Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.834Z] 03:05:06     INFO -      rsp = 0x000000d651b6e2a0    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.834Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.834Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8f0c35792
[task 2022-04-26T03:05:06.834Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.834Z] 03:05:06     INFO -  5  xul.dll!std::sys_common::backtrace::__rust_end_short_backtrace<std::panicking::begin_panic_handler::closure_env$0,never$>() [backtrace.rs:7737e0b5c4103216d6fd8cf941b7ab9bdbaace7c : 138 + 0x12]
[task 2022-04-26T03:05:06.834Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.834Z] 03:05:06     INFO -      rsp = 0x000000d651b6e320    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.834Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.834Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8f0c322d7
[task 2022-04-26T03:05:06.834Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.834Z] 03:05:06     INFO -  6  xul.dll!std::panicking::begin_panic_handler() [panicking.rs:7737e0b5c4103216d6fd8cf941b7ab9bdbaace7c : 584 + 0x18]
[task 2022-04-26T03:05:06.835Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.835Z] 03:05:06     INFO -      rsp = 0x000000d651b6e350    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.835Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.835Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8f0c35449
[task 2022-04-26T03:05:06.835Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.835Z] 03:05:06     INFO -  7  xul.dll!core::panicking::panic_fmt() [panicking.rs:7737e0b5c4103216d6fd8cf941b7ab9bdbaace7c : 143 + 0x4]
[task 2022-04-26T03:05:06.835Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.835Z] 03:05:06     INFO -      rsp = 0x000000d651b6e3a0    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.835Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.835Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8f1849565
[task 2022-04-26T03:05:06.835Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.835Z] 03:05:06     INFO -  8  xul.dll!core::panicking::panic() [panicking.rs:7737e0b5c4103216d6fd8cf941b7ab9bdbaace7c : 48 + 0x7]
[task 2022-04-26T03:05:06.836Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.836Z] 03:05:06     INFO -      rsp = 0x000000d651b6e3f0    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.836Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.836Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8f184940c
[task 2022-04-26T03:05:06.836Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.836Z] 03:05:06     INFO -  9  xul.dll!webrender::renderer::Renderer::render_impl(webrender_api::DocumentId, webrender::internal_types::RenderedDocument*, enum$<core::option::Option<euclid::size::Size2D<i32,webrender_api::units::DevicePixel> > >, unsigned long long) [mod.rs:7c1264c01390b022a11684b294c87e0e343a9e91 : 2178 + 0x17]
[task 2022-04-26T03:05:06.836Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.836Z] 03:05:06     INFO -      rsp = 0x000000d651b6e460    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.836Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.836Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8f11e8b16
[task 2022-04-26T03:05:06.836Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.836Z] 03:05:06     INFO - 10  xul.dll!webrender::renderer::Renderer::render(euclid::size::Size2D<i32,webrender_api::units::DevicePixel>, unsigned long long) [mod.rs:7c1264c01390b022a11684b294c87e0e343a9e91 : 1737 + 0x39]
[task 2022-04-26T03:05:06.837Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.837Z] 03:05:06     INFO -      rsp = 0x000000d651b6e9a0    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.837Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.837Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8f11e2a46
[task 2022-04-26T03:05:06.837Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.837Z] 03:05:06     INFO - 11  xul.dll!webrender_bindings::bindings::wr_renderer_render(webrender::renderer::Renderer*, int, int, unsigned long long, webrender::renderer::RendererStats*, thin_vec::ThinVec<euclid::box2d::Box2D<i32,webrender_api::units::DevicePixel> >*) [bindings.rs:7c1264c01390b022a11684b294c87e0e343a9e91 : 620 + 0xf]
[task 2022-04-26T03:05:06.837Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.837Z] 03:05:06     INFO -      rsp = 0x000000d651b6f240    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.837Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.837Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8efd5baf4
[task 2022-04-26T03:05:06.838Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.838Z] 03:05:06     INFO - 12  xul.dll!mozilla::wr::RendererOGL::UpdateAndRender(mozilla::Maybe<mozilla::gfx::IntSizeTyped<mozilla::gfx::UnknownUnits> > const&, mozilla::Maybe<mozilla::wr::ImageFormat> const&, mozilla::Maybe<mozilla::Range<unsigned char> > const&, bool*, mozilla::wr::RendererStats*) [RendererOGL.cpp:7c1264c01390b022a11684b294c87e0e343a9e91 : 185 + 0x2b]
[task 2022-04-26T03:05:06.838Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.838Z] 03:05:06     INFO -      rsp = 0x000000d651b6f460    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.838Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.838Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8e9e34b0f
[task 2022-04-26T03:05:06.838Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.838Z] 03:05:06     INFO - 13  xul.dll!mozilla::wr::RenderThread::UpdateAndRender(mozilla::wr::WrWindowId, mozilla::layers::BaseTransactionId<mozilla::VsyncIdType> const&, mozilla::TimeStamp const&, bool, mozilla::Maybe<mozilla::gfx::IntSizeTyped<mozilla::gfx::UnknownUnits> > const&, mozilla::Maybe<mozilla::wr::ImageFormat> const&, mozilla::Maybe<mozilla::Range<unsigned char> > const&, bool*) [RenderThread.cpp:7c1264c01390b022a11684b294c87e0e343a9e91 : 537 + 0x3b]
[task 2022-04-26T03:05:06.838Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.838Z] 03:05:06     INFO -      rsp = 0x000000d651b6f500    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.838Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.838Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8e9e33a66
[task 2022-04-26T03:05:06.839Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.839Z] 03:05:06     INFO - 14  xul.dll!mozilla::wr::RenderThread::HandleFrameOneDoc(mozilla::wr::WrWindowId, bool) [RenderThread.cpp:7c1264c01390b022a11684b294c87e0e343a9e91 : 387 + 0x51]
[task 2022-04-26T03:05:06.839Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.839Z] 03:05:06     INFO -      rsp = 0x000000d651b6f710    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.839Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.839Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8e9e32ece
[task 2022-04-26T03:05:06.839Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.839Z] 03:05:06     INFO - 15  xul.dll!mozilla::detail::RunnableMethodImpl<mozilla::wr::RenderThread *,void (mozilla::wr::RenderThread::*)(mozilla::wr::WrWindowId, bool),1,mozilla::RunnableKind::Standard,mozilla::wr::WrWindowId,bool>::Run() [nsThreadUtils.h:7c1264c01390b022a11684b294c87e0e343a9e91 : 1200 + 0x11]
[task 2022-04-26T03:05:06.839Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.839Z] 03:05:06     INFO -      rsp = 0x000000d651b6f880    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.839Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.839Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8e9e465f2
[task 2022-04-26T03:05:06.839Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.840Z] 03:05:06     INFO - 16  xul.dll!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:7c1264c01390b022a11684b294c87e0e343a9e91 : 1174 + 0xc]
[task 2022-04-26T03:05:06.840Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.840Z] 03:05:06     INFO -      rsp = 0x000000d651b6f8b0    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.840Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.840Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8e8ade815
[task 2022-04-26T03:05:06.840Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.840Z] 03:05:06     INFO - 17  xul.dll!NS_ProcessNextEvent(nsIThread*, bool) [nsThreadUtils.cpp:7c1264c01390b022a11684b294c87e0e343a9e91 : 465 + 0x16]
[task 2022-04-26T03:05:06.840Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.840Z] 03:05:06     INFO -      rsp = 0x000000d651b6fa90    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.840Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.840Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8e8ae53c5
[task 2022-04-26T03:05:06.840Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.841Z] 03:05:06     INFO - 18  xul.dll!mozilla::ipc::MessagePumpForNonMainThreads::Run(base::MessagePump::Delegate*) [MessagePump.cpp:7c1264c01390b022a11684b294c87e0e343a9e91 : 330 + 0x9]
[task 2022-04-26T03:05:06.841Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.841Z] 03:05:06     INFO -      rsp = 0x000000d651b6fae0    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.841Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.841Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8e9514923
[task 2022-04-26T03:05:06.841Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.841Z] 03:05:06     INFO - 19  xul.dll!MessageLoop::RunHandler() [message_loop.cc:7c1264c01390b022a11684b294c87e0e343a9e91 : 373 + 0x7]
[task 2022-04-26T03:05:06.841Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.841Z] 03:05:06     INFO -      rsp = 0x000000d651b6fb50    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.841Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.841Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8e9498e10
[task 2022-04-26T03:05:06.841Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.842Z] 03:05:06     INFO - 20  xul.dll!MessageLoop::Run() [message_loop.cc:7c1264c01390b022a11684b294c87e0e343a9e91 : 355 + 0x4]
[task 2022-04-26T03:05:06.842Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.842Z] 03:05:06     INFO -      rsp = 0x000000d651b6fba0    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.842Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.842Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8e9498cd0
[task 2022-04-26T03:05:06.842Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.842Z] 03:05:06     INFO - 21  xul.dll!static nsThread::ThreadFunc(void*) [nsThread.cpp:7c1264c01390b022a11684b294c87e0e343a9e91 : 378 + 0x7]
[task 2022-04-26T03:05:06.842Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.842Z] 03:05:06     INFO -      rsp = 0x000000d651b6fbf0    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.842Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.842Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff8e8ad9992
[task 2022-04-26T03:05:06.842Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.842Z] 03:05:06     INFO - 22  nss3.dll!PR_NativeRunThread(void*) [pruthr.c:7c1264c01390b022a11684b294c87e0e343a9e91 : 399 + 0xd]
[task 2022-04-26T03:05:06.843Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.843Z] 03:05:06     INFO -      rsp = 0x000000d651b6fdd0    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.843Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.843Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff90e9ff832
[task 2022-04-26T03:05:06.843Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.843Z] 03:05:06     INFO - 23  nss3.dll!pr_root(void*) [w95thred.c:7c1264c01390b022a11684b294c87e0e343a9e91 : 139 + 0xc]
[task 2022-04-26T03:05:06.843Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.843Z] 03:05:06     INFO -      rsp = 0x000000d651b6fe50    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.843Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.843Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff90e9f0611
[task 2022-04-26T03:05:06.843Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.843Z] 03:05:06     INFO - 24  ucrtbase.dll!thread_start<unsigned int (__cdecl*)(void * __ptr64)> + 0x3d
[task 2022-04-26T03:05:06.844Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.844Z] 03:05:06     INFO -      rsp = 0x000000d651b6fe80    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.844Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.844Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff92deac4be
[task 2022-04-26T03:05:06.844Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.844Z] 03:05:06     INFO - 25  kernel32.dll!BaseThreadInitThunk + 0x13
[task 2022-04-26T03:05:06.844Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.844Z] 03:05:06     INFO -      rsp = 0x000000d651b6feb0    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.844Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.844Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff9301a3034
[task 2022-04-26T03:05:06.844Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.844Z] 03:05:06     INFO - 26  mozglue.dll!patched_BaseThreadInitThunk(int, void*, void*) [WindowsDllBlocklist.cpp:7c1264c01390b022a11684b294c87e0e343a9e91 : 572 + 0x28]
[task 2022-04-26T03:05:06.845Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.845Z] 03:05:06     INFO -      rsp = 0x000000d651b6fee0    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.845Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.845Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff913813324
[task 2022-04-26T03:05:06.845Z] 03:05:06     INFO -     Found by: call frame info
[task 2022-04-26T03:05:06.845Z] 03:05:06     INFO - 27  ntdll.dll!RtlUserThreadStart + 0x20
[task 2022-04-26T03:05:06.845Z] 03:05:06     INFO -      rbx = 0x00007ff8f2ec8952    rbp = 0x000000d651b6dd80
[task 2022-04-26T03:05:06.845Z] 03:05:06     INFO -      rsp = 0x000000d651b6ff50    r12 = 0x00007ff8f2ec9090
[task 2022-04-26T03:05:06.845Z] 03:05:06     INFO -      r13 = 0x000000d651b6e2d0    r14 = 0x00007ff8f2ead3a0
[task 2022-04-26T03:05:06.845Z] 03:05:06     INFO -      r15 = 0x0000000000000021    rip = 0x00007ff930b71461
[task 2022-04-26T03:05:06.845Z] 03:05:06     INFO -     Found by: call frame info

Comment 30

[Jim Blandy :jimb]

Hi Jim. We still see failures with this crash signature [@ RustMozCrash(char const*, int, char const*)], should we file a separate bug?

That stack frame is going to be common to any crash caused by an assertion failure in anything written in Rust. It gives no information about the cause; it just says "this crashed in some Rust code somewhere". It should probably be excluded from all signatures across the system.

In this specific case, crashes in WebRender were being attributed to this bug, which is about WebGPU. The two are both Rust code, but they are otherwise independent projects.

Comment 31

[Jim Blandy :jimb]

The failure log in comment 29 is, likewise, a crash in WebRender, and not related to WebGPU at all.

Comment 32

[Jim Blandy :jimb]

Let me be more specific about the failure log in comment 29.

In the stack trace following "Thread 8 Render (crashed)", stack frames 1-8 are all from Rust's runtime check failure ("panic") handling machinery. I don't know if it's always going to be those exact frames in that exact order, but regardless, you're going to see something like them on any crash caused by a runtime check in Rust code. Like, if an array index goes out of bounds, Rust checks for that, and you'll get a crash with those frames.

It's frame 9, in xul.dll!webrender::renderer::Renderer::render_impl that is the first one to give us any real information. The filename mod.rs isn't helpful but the function name tells us that it's a WebRender crash.

The oldest panicking.rs frame on the stack and everything above it should probably be ignored for the purpose of guessing which bug to assign an intermittent failure to.

Comment 33

[Andreea Pavel [:apavel]]

Thank you Jim. We'll track these failures in bug 1766321 for now.

Comment 34

[Intermittent Failures Robot]

6 failures in 3289 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 1

Platform and build breakdown:

• windows10-64-2004-qr: 6
  • debug: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-04-25&endday=2022-05-01&tree=all

Comment 35

[Intermittent Failures Robot]

6 failures in 3540 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 3

Platform and build breakdown:

• windows10-32-2004-qr: 1
  • debug: 1
• windows10-64-2004-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-05-02&endday=2022-05-08&tree=all

Comment 36

[Intermittent Failures Robot]

6 failures in 3317 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6

Platform and build breakdown:

• windows10-32-2004-qr: 1
  • debug: 1
• windows10-64-2004-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-05-09&endday=2022-05-15&tree=all

Comment 37

[Intermittent Failures Robot]

4 failures in 2694 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform and build breakdown:

• windows10-32-2004-qr: 1
  • debug: 1
• windows10-64-2004-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-05-16&endday=2022-05-22&tree=all

Comment 38

[Intermittent Failures Robot]

1 failures in 2917 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-05-30&endday=2022-06-05&tree=all

Comment 39

[Intermittent Failures Robot]

3 failures in 3336 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 1

Platform and build breakdown:

• windows10-64-2004-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-06-06&endday=2022-06-12&tree=all

Comment 40

[Intermittent Failures Robot]

1 failures in 3170 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-06-13&endday=2022-06-19&tree=all

Comment 41

[Intermittent Failures Robot]

1 failures in 3057 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-08-01&endday=2022-08-07&tree=all

Comment 42

[Intermittent Failures Robot]

1 failures in 3339 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-08-08&endday=2022-08-14&tree=all

Comment 43

[Intermittent Failures Robot]

2 failures in 3293 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• windows10-64-2004-ccov-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-08-22&endday=2022-08-28&tree=all

Comment 44

[Intermittent Failures Robot]

8 failures in 3537 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr102: 1
• autoland: 1
• mozilla-central: 6

Platform and build breakdown:

• windows10-64-2004-qr: 2
  • debug: 2
• windows10-64-2004-ccov-qr: 6
  • opt: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-08-29&endday=2022-09-04&tree=all

Comment 45

[Intermittent Failures Robot]

5 failures in 3616 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 5

Platform and build breakdown:

• windows10-64-2004-ccov-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-09-05&endday=2022-09-11&tree=all

Comment 46

[Intermittent Failures Robot]

7 failures in 3023 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 7

Platform and build breakdown:

• windows10-64-2004-ccov-qr: 7
  • opt: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-09-12&endday=2022-09-18&tree=all

Comment 47

[Intermittent Failures Robot]

3 failures in 2909 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform and build breakdown:

• windows10-64-2004-ccov-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-09-19&endday=2022-09-25&tree=all

Comment 48

[Intermittent Failures Robot]

2 failures in 2041 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• windows10-64-2004-ccov-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2022-09-26&endday=2022-10-02&tree=all

Comment 49

[Intermittent Failures Robot]

1 failures in 3606 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr102: 1

Platform and build breakdown:

• windows10-32-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2023-01-30&endday=2023-02-05&tree=all

Comment 50

[Intermittent Failures Robot]

1 failures in 3863 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr102: 1

Platform and build breakdown:

• windows10-32-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2023-03-27&endday=2023-04-02&tree=all

Comment 51

[Intermittent Failures Robot]

1 failures in 4004 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr102: 1

Platform and build breakdown:

• windows10-64-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2023-04-17&endday=2023-04-23&tree=all

Comment 52

[Intermittent Failures Robot]

1 failures in 4079 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr102: 1

Platform and build breakdown:

• windows10-32-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2023-06-12&endday=2023-06-18&tree=all

Comment 53

[Intermittent Failures Robot]

2 failures in 3594 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr102: 2

Platform and build breakdown:

• windows10-64-2004-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1754529&startday=2023-06-26&endday=2023-07-02&tree=all