Open Bug 1844964 Opened 10 months ago Updated 1 day ago

Crash in [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:44)] kotlinx.coroutines.channels.BufferedChannel

Categories

(Fenix :: General, defect, P3)

ARM
Android

Tracking

(firefox115 wontfix, firefox116 wontfix, firefox117 wontfix, firefox118 wontfix, firefox119 wontfix, firefox120 wontfix, firefox121 wontfix, firefox122 wontfix, firefox123 wontfix, firefox124 wontfix, firefox125 wontfix, firefox126 wontfix, firefox127 fix-optional)

Tracking Status
firefox115 --- wontfix
firefox116 --- wontfix
firefox117 --- wontfix
firefox118 --- wontfix
firefox119 --- wontfix
firefox120 --- wontfix
firefox121 --- wontfix
firefox122 --- wontfix
firefox123 --- wontfix
firefox124 --- wontfix
firefox125 --- wontfix
firefox126 --- wontfix
firefox127 --- fix-optional

People

(Reporter: cpeterson, Unassigned)

References

(Regression)

Details

(Keywords: crash, regression)

Crash Data

Crash report: https://crash-stats.mozilla.org/report/index/c50fff7b-2f92-4f30-9a92-bf13f0230712

I think this crash is either a regression in 115 or the signature changed in 115, to:

[@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:48) ] and exception java.lang.NoClassDefFoundError: <clinit> failed for class kotlinx.coroutines.channels.AbstractChannel; see exception in other thread.

from:

[@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:48) ] and exception java.lang.NoClassDefFoundError: kotlinx.coroutines.channels.BufferedChannel

Though both signatures appear in 115. The second last appears in 115.

Java stack trace:

java.lang.NoClassDefFoundError: kotlinx.coroutines.channels.BufferedChannel
	at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:44)
	at androidx.datastore.core.SimpleActor.<init>(SimpleActor.kt:18)
	at androidx.datastore.core.SingleProcessDataStore.<init>(SingleProcessDataStore.kt:68)
	at org.mozilla.fenix.components.Components$appStore$2.invoke(Components.kt:302)
	at kotlin.SynchronizedLazyImpl.getValue(LazyJVM.kt:21)
	at org.mozilla.fenix.components.Components.getAppStore(Components.kt:3)
	at org.mozilla.fenix.components.Components$useCases$2.invoke(Components.kt:59)
	at kotlin.SynchronizedLazyImpl.getValue(LazyJVM.kt:21)
	at org.mozilla.fenix.components.Components.getUseCases(Components.kt:3)
	at org.mozilla.fenix.FenixApplication.initialize(FenixApplication.kt:701)
	at org.mozilla.fenix.FenixApplication.onCreate(FenixApplication.kt:4)
	at android.app.Instrumentation.callApplicationOnCreate(Instrumentation.java:1020)
	at android.app.ActivityThread.handleBindApplication(ActivityThread.java:5109)
	at android.app.ActivityThread.access$1600(ActivityThread.java:177)
	at android.app.ActivityThread$H.handleMessage(ActivityThread.java:1509)
	at android.os.Handler.dispatchMessage(Handler.java:102)
	at android.os.Looper.loop(Looper.java:145)
	at android.app.ActivityThread.main(ActivityThread.java:5938)
	at java.lang.reflect.Method.invoke(Native Method)
	at java.lang.reflect.Method.invoke(Method.java:372)
	at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:1400)
	at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:1195)

The bug is linked to a topcrash signature, which matches the following criterion:

  • Top 10 AArch64 and ARM crashes on beta

For more information, please visit BugBot documentation.

Keywords: topcrash
Duplicate of this bug: 1846566

I think bug 1846566 is a duplicate of this bug. In that bug, Aryx says:

Startup crash with Android 5.0 on Samsung devices (only?), new with Firefox for Android 116.0, 17 crash reports from 11 installations at this moment.

Crash report: https://crash-stats.mozilla.org/report/index/5bcfbd2c-dcbf-419f-9c17-079cc0230801

Java stack trace:

java.lang.NoClassDefFoundError: kotlinx.coroutines.channels.BufferedChannelKt
	at kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:15)
	at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:46)
	at androidx.datastore.core.SimpleActor.<init>(SimpleActor.kt:18)
	at androidx.datastore.core.SingleProcessDataStore.<init>(SingleProcessDataStore.kt:68)
	at org.mozilla.fenix.components.Components$appStore$2.invoke(Components.kt:302)
	at kotlin.SynchronizedLazyImpl.getValue(LazyJVM.kt:21)
	at org.mozilla.fenix.components.Components.getAppStore(Components.kt:3)
	at org.mozilla.fenix.components.Components$useCases$2.invoke(Components.kt:59)
	at kotlin.SynchronizedLazyImpl.getValue(LazyJVM.kt:21)
	at org.mozilla.fenix.components.Components.getUseCases(Components.kt:3)
	at org.mozilla.fenix.FenixApplication.initialize(FenixApplication.kt:703)
	at org.mozilla.fenix.FenixApplication.onCreate(FenixApplication.kt:4)
	at android.app.Instrumentation.callApplicationOnCreate(Instrumentation.java:1020)
	at android.app.ActivityThread.handleBindApplication(ActivityThread.java:5245)
	at android.app.ActivityThread.access$1600(ActivityThread.java:181)
	at android.app.ActivityThread$H.handleMessage(ActivityThread.java:1537)
	at android.os.Handler.dispatchMessage(Handler.java:102)
	at android.os.Looper.loop(Looper.java:145)
	at android.app.ActivityThread.main(ActivityThread.java:6134)
	at java.lang.reflect.Method.invoke(Native Method)
	at java.lang.reflect.Method.invoke(Method.java:372)
	at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:1399)
	at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:1194)
Crash Signature: [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:44)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:48) ] → [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:15)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:44)] [@ java.lang.NoClassDefFoundErro…
Priority: -- → P3

Is there anything we can do here atleast for 117? Seems to be pretty high volume for 116

Crash Signature: [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:15)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:44)] [@ java.lang.NoClassDefFoundErro… → [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:44)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:48) ]
Flags: needinfo?(jonalmeida942)

[@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:15)] is a slightly different crash signature for the same crash stack trace:

Crash report: https://crash-stats.mozilla.org/report/index/d828696f-9180-4905-8129-89d1c0230815

Java stack trace:

java.lang.NoClassDefFoundError
	at kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:15)
	at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:46)
	at androidx.datastore.core.SimpleActor.<init>(SimpleActor.kt:18)
	at androidx.datastore.core.SingleProcessDataStore.<init>(SingleProcessDataStore.kt:68)
	at org.mozilla.fenix.components.Components$appStore$2.invoke(Components.kt:302)
	at kotlin.SynchronizedLazyImpl.getValue(LazyJVM.kt:21)
	at org.mozilla.fenix.components.Components.getAppStore(Components.kt:3)
	at org.mozilla.fenix.components.Components$useCases$2.invoke(Components.kt:59)
	at kotlin.SynchronizedLazyImpl.getValue(LazyJVM.kt:21)
	at org.mozilla.fenix.components.Components.getUseCases(Components.kt:3)
	at org.mozilla.fenix.FenixApplication.initialize(FenixApplication.kt:703)
	at org.mozilla.fenix.FenixApplication.onCreate(FenixApplication.kt:4)
	at android.app.Instrumentation.callApplicationOnCreate(Instrumentation.java:1020)
	at android.app.ActivityThread.handleBindApplication(ActivityThread.java:5237)
	at android.app.ActivityThread.access$1600(ActivityThread.java:181)
	at android.app.ActivityThread$H.handleMessage(ActivityThread.java:1536)
	at android.os.Handler.dispatchMessage(Handler.java:102)
	at android.os.Looper.loop(Looper.java:145)
	at android.app.ActivityThread.main(ActivityThread.java:6126)
	at java.lang.reflect.Method.invoke(Native Method)
	at java.lang.reflect.Method.invoke(Method.java:372)
	at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:1399)
	at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:1194)
Crash Signature: [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:44)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:48) ] → [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:44)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:48) ] [@ java.lang.NoClassDefFoundError: a…

99.98% of these crash reports are from Android 5.0 (API 21).

I suspect this crash is a regression bug 1838274, which updated the Kotlin coroutines library from version 1.6.4 to 1.7.1 in Fx116.

Bug 1841081 updated from 1.7.1 to 1.7.2 in Fx117, but we're still crashing.

Regressed by: 1826590
See Also: → 1841081
Regressed by: 1838274
No longer regressed by: 1826590

Bug 1838274 should not be the regression. The kotlin coroutine library update in GeckoView is not used in production code.

Bug 1826590 does seem like the most likely cause and it did land in 116 as well. I will try to spend a few cycles to see if there is some change in the release notes that we missed.

Flags: needinfo?(jonalmeida942)
No longer regressed by: 1838274
Assignee: nobody → jonalmeida942

Set release status flags based on info from the regressing bug 1826590

All of these crashes are happening on API 21 devices from the linked crash reports.

They are all originating with the same stack trace within the Datastore library that uses a much earlier version of kotlin coroutines (1.5.0) that we no longer use (currently on 1.7.2), so we end up upgrading the library to our version. The alpha version of the data store library has updated to the latest coroutine library, so I suspect that might fix it (eventually) but we can't rely on this alpha library right now.

This doesn't answer yet why the BufferedChannelKt is missing when the BufferedChannel class exists and is part of the initialization stack. csadilek and I went through some of the most common theories and it seems more like a bug in the coroutine library than ours.

Filed: https://github.com/Kotlin/kotlinx.coroutines/issues/3882

From the feedback in the coroutine bug and more discussions offline, it doesn't seem like there is anything else actionable we can do right now.

  • There is nothing special the coroutine library does with the classloader.
  • The datastore library doesn't seem to have any special code path for API 21. There are only two instances at this point:
    1. An IPC logger (IpcLogger.kt), that is used for multi-process datastores (which we do not use).
    2. SharedPreferencesMigration.kt which we also have not exercised in our code base.
  • This doc line, "This should only be used from a single application in a single classloader in a single process.", that made us consider if we are somehow initializing data store, however all code paths to our usages (Pocket and Cookie Banner storage) are always done in the main process.

This leaves only something specific to API 21 platform code that has bugs with coroutine 1.7.0, so we can file a google ticket for that (with low expectations of a fix).

TL;DR: we need to wait to update datastore to version 1.1 when it is release-ready as it includes the coroutine 1.7.0 library upgrade.

TL;DR: we need to wait to update datastore to version 1.1 when it is release-ready as it includes the coroutine 1.7.0 library upgrade.

Do you know what is the ETA for the release of datastore?

Flags: needinfo?(jonalmeida942)

(In reply to Emilio Cobos Álvarez (:emilio) from comment #12)

TL;DR: we need to wait to update datastore to version 1.1 when it is release-ready as it includes the coroutine 1.7.0 library upgrade.

Do you know what is the ETA for the release of datastore?

No, unfortunately.

Version 1.0.0 was released in Aug 2021 and the the 1.1.0 alpha05 was released in Sept 2023. 1.0.0 previously had a release cadence of once each month until it's final release. There doesn't seem to be a fixed time between any of the releases any more from what I can see any more.

Flags: needinfo?(jonalmeida942)
See Also: → 1851704
See Also: 1851704

Version 1.1.0 is still in alpha
Version 1.1.0-alpha06 released on November 1, 2023

Version 1.1.0 is still in alpha
Version 1.1.0-alpha07 released on November 29, 2023

Crash Signature: at kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:15)] → at kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:15)] [@ java.lang.ExceptionInInitializerError: at kotlinx.coroutines.flow.StateFlowKt.MutableStateFlow(StateFlow.kt:1) ]
See Also: → 1872192
See Also: → 1804115
Assignee: jonalmeida942 → nobody
Crash Signature: [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:44)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:48) ] [@ java.lang.NoClassDefFoundError: a… → [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:44)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:45)] [@ java.lang.NoClassDefFoundError: at…
Hardware: Unspecified → ARM
Crash Signature: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:48) ] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:15)] [@ java.lang.ExceptionInInitializerError: at kotlinx.coroutines.f… → at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:48) ] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:10)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels…
Crash Signature: [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:44)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:45)] [@ java.lang.NoClassDefFoundError: at… → [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:10)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:15)] [@ java.lang.NoClassDefFoun…
Crash Signature: kotlinx.coroutines.flow.StateFlowKt.MutableStateFlow(StateFlow.kt:1)] → kotlinx.coroutines.flow.StateFlowKt.MutableStateFlow(StateFlow.kt:1)] [@ java.lang.ExceptionInInitializerError: at kotlinx.coroutines.JobSupport.cancelImpl$kotlinx_coroutines_core(JobSupport.kt:171)] [@ java.lang.ExceptionInInitializerError: at kotlinx…

Version 1.1.0 is now in RC. So most be close to releasing.
Version 1.1.0-rc1 released on April 3, 2024

Depends on: 1892144

The next Fx127 nightly builds will have the DataStore 1.1.0 upgrade included in them. We'll see what affect it has soon.

Based on the topcrash criteria, the crash signatures linked to this bug are not in the topcrash signatures anymore.

For more information, please visit BugBot documentation.

Keywords: topcrash
Crash Signature: [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:10)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:15)] [@ java.lang.NoClassDefFoun… → [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.BuildersKt.withContext ] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:10)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.c…
Crash Signature: kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:15)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt:44)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.Cha… → kotlinx.coroutines.channels.BufferedChannel.<init>(BufferedChannel.kt:15)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.ChannelKt.Channel$default(Channel.kt)] [@ java.lang.NoClassDefFoundError: at kotlinx.coroutines.channels.Channe…
You need to log in before you can comment on or make changes to this bug.