Closed Bug 1824133 Opened 2 years ago Closed 1 year ago

Intermittent UI test failure - Legacy arm - < TabbedBrowsingTest.openNewTabTest >

Categories

(Firefox for Android :: UI Tests, defect, P3)

Product:
Firefox for Android
Component:
UI Tests
Version:
Firefox 113
Platform:
All
Android
Type:
defect

Tracking

()

Status:
RESOLVED FIXED
Tracking Flags:
Tracking Status
firefox113 --- wontfix
firefox114 --- unaffected
firefox115 --- unaffected
firefox116 --- wontfix
firefox117 --- unaffected
firefox118 --- unaffected
firefox119 --- wontfix
firefox131 --- unaffected
firefox132 --- unaffected
firefox133 --- fixed

People

(Reporter: ajoltan, Unassigned)

Details

(Keywords: intermittent-failure)

Firebase Test Run: Firebase link

Stacktrace:

java.lang.NullPointerException: Attempt to invoke interface method 'java.lang.String java.lang.CharSequence.toString()' on a null object reference
at android.view.accessibility.AccessibilityInteractionClient.finalizeAndCacheAccessibilityNodeInfo(AccessibilityInteractionClient.java:738)
at android.view.accessibility.AccessibilityInteractionClient.finalizeAndCacheAccessibilityNodeInfos(AccessibilityInteractionClient.java:765)
at android.view.accessibility.AccessibilityInteractionClient.findAccessibilityNodeInfoByAccessibilityId(AccessibilityInteractionClient.java:299)
at android.view.accessibility.AccessibilityInteractionClient.getRootInActiveWindow(AccessibilityInteractionClient.java:162)
at android.app.UiAutomation.getRootInActiveWindow(UiAutomation.java:479)
at androidx.test.uiautomator.QueryController.getRootNode(QueryController.java:182)
at androidx.test.uiautomator.QueryController.findAccessibilityNodeInfo(QueryController.java:161)
at androidx.test.uiautomator.QueryController.findAccessibilityNodeInfo(QueryController.java:150)
at androidx.test.uiautomator.UiObject.findAccessibilityNodeInfo(UiObject.java:192)
at androidx.test.uiautomator.UiObject.waitForExists(UiObject.java:932)
at org.mozilla.fenix.ui.robots.SearchRobot$Transition.submitQuery(SearchRobot.kt:362)
at org.mozilla.fenix.ui.TabbedBrowsingTest.openNewTabTest(TabbedBrowsingTest.kt:83)

Build: 3/22 Main

Flaky 1x on Pixel 2 (ARM), Virtual, API Level 26 on 4/6 Main Firebase link

java.lang.NullPointerException: Attempt to invoke interface method 'java.lang.String java.lang.CharSequence.toString()' on a null object reference
at android.view.accessibility.AccessibilityInteractionClient.finalizeAndCacheAccessibilityNodeInfo(AccessibilityInteractionClient.java:738)
at android.view.accessibility.AccessibilityInteractionClient.finalizeAndCacheAccessibilityNodeInfos(AccessibilityInteractionClient.java:765)
at android.view.accessibility.AccessibilityInteractionClient.findAccessibilityNodeInfoByAccessibilityId(AccessibilityInteractionClient.java:299)
at android.view.accessibility.AccessibilityInteractionClient.getRootInActiveWindow(AccessibilityInteractionClient.java:162)
at android.app.UiAutomation.getRootInActiveWindow(UiAutomation.java:479)
at androidx.test.uiautomator.QueryController.getRootNode(QueryController.java:182)
at androidx.test.uiautomator.QueryController.findAccessibilityNodeInfo(QueryController.java:161)
at androidx.test.uiautomator.QueryController.findAccessibilityNodeInfo(QueryController.java:150)
at androidx.test.uiautomator.UiObject.findAccessibilityNodeInfo(UiObject.java:192)
at androidx.test.uiautomator.UiObject.waitForExists(UiObject.java:932)
at androidx.test.uiautomator.UiObject.exists(UiObject.java:983)
at org.mozilla.fenix.helpers.HomeActivityTestRuleKt.closeNotificationShade(HomeActivityTestRule.kt:288)
at org.mozilla.fenix.helpers.HomeActivityTestRuleKt.access$closeNotificationShade(HomeActivityTestRule.kt:1)
at org.mozilla.fenix.helpers.HomeActivityTestRule.afterActivityFinished(HomeActivityTestRule.kt:92)
at androidx.test.rule.ActivityTestRule.finishActivity(ActivityTestRule.java:415)
at androidx.test.rule.ActivityTestRule$ActivityStatement.evaluate(ActivityTestRule.java:551)
at org.mozilla.fenix.helpers.RetryTestRule$apply$$inlined$statement$1.evaluate(RetryTestRule.kt:106)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:67)
at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:58)
at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:446)
at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2074)

Flaky 1x on 5/3 Main Firebase link

java.lang.NullPointerException: Attempt to invoke interface method 'java.lang.String java.lang.CharSequence.toString()' on a null object reference
at android.view.accessibility.AccessibilityInteractionClient.finalizeAndCacheAccessibilityNodeInfo(AccessibilityInteractionClient.java:738)
at android.view.accessibility.AccessibilityInteractionClient.finalizeAndCacheAccessibilityNodeInfos(AccessibilityInteractionClient.java:765)
at android.view.accessibility.AccessibilityInteractionClient.findAccessibilityNodeInfoByAccessibilityId(AccessibilityInteractionClient.java:299)
at android.view.accessibility.AccessibilityInteractionClient.getRootInActiveWindow(AccessibilityInteractionClient.java:162)
at android.app.UiAutomation.getRootInActiveWindow(UiAutomation.java:479)
at androidx.test.uiautomator.UiDevice.getWindowRoots(UiDevice.java:1102)
at androidx.test.uiautomator.UiDevice.findObject(UiDevice.java:150)
at androidx.test.uiautomator.Until$3.apply(Until.java:68)
at androidx.test.uiautomator.Until$3.apply(Until.java:65)
at androidx.test.uiautomator.WaitMixin.wait(WaitMixin.java:40)
at androidx.test.uiautomator.WaitMixin.wait(WaitMixin.java:34)
at androidx.test.uiautomator.UiDevice.wait(UiDevice.java:174)
at org.mozilla.fenix.helpers.ext.WaitNotNullKt.waitNotNull(WaitNotNull.kt:20)
at org.mozilla.fenix.ui.robots.NavigationToolbarRobotKt.openEditURLView(NavigationToolbarRobot.kt:284)
at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:123)
at org.mozilla.fenix.ui.TabbedBrowsingTest.openNewTabTest(TabbedBrowsingTest.kt:73)

Flaky 1x on 5/4 Main Firebase link

05-04 08:53:02.202: E/TestRunner(6252): ----- begin exception -----
05-04 08:53:02.205: E/TestRunner(6252): java.lang.ExceptionInInitializerError
05-04 08:53:02.205: E/TestRunner(6252): at org.mozilla.fenix.helpers.HomeActivityTestRule.<init>(HomeActivityTestRule.kt:42)
05-04 08:53:02.205: E/TestRunner(6252): at org.mozilla.fenix.helpers.HomeActivityTestRule$Companion.withDefaultSettingsOverrides(HomeActivityTestRule.kt:110)
05-04 08:53:02.205: E/TestRunner(6252): at org.mozilla.fenix.helpers.HomeActivityTestRule$Companion.withDefaultSettingsOverrides$default(HomeActivityTestRule.kt:106)
05-04 08:53:02.205: E/TestRunner(6252): at org.mozilla.fenix.ui.TabbedBrowsingTest.<init>(TabbedBrowsingTest.kt:48)
05-04 08:53:02.205: E/TestRunner(6252): at java.lang.reflect.Constructor.newInstance0(Native Method)
05-04 08:53:02.205: E/TestRunner(6252): at java.lang.reflect.Constructor.newInstance(Constructor.java:334)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.BlockJUnit4ClassRunner.createTest(BlockJUnit4ClassRunner.java:250)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.BlockJUnit4ClassRunner.createTest(BlockJUnit4ClassRunner.java:260)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.BlockJUnit4ClassRunner$2.runReflectiveCall(BlockJUnit4ClassRunner.java:309)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.BlockJUnit4ClassRunner.methodBlock(BlockJUnit4ClassRunner.java:306)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.Suite.runChild(Suite.java:128)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.Suite.runChild(Suite.java:27)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
05-04 08:53:02.205: E/TestRunner(6252): at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
05-04 08:53:02.205: E/TestRunner(6252): at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:67)
05-04 08:53:02.205: E/TestRunner(6252): at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:58)
05-04 08:53:02.205: E/TestRunner(6252): at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:446)
05-04 08:53:02.205: E/TestRunner(6252): at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2074)
05-04 08:53:02.205: E/TestRunner(6252): Caused by: java.lang.RuntimeException: Error while connecting UiAutomation
05-04 08:53:02.205: E/TestRunner(6252): at android.app.UiAutomation.connect(UiAutomation.java:239)
05-04 08:53:02.205: E/TestRunner(6252): at android.app.Instrumentation.getUiAutomation(Instrumentation.java:2045)
05-04 08:53:02.205: E/TestRunner(6252): at androidx.test.uiautomator.UiDevice.getUiAutomation(UiDevice.java:1129)
05-04 08:53:02.205: E/TestRunner(6252): at androidx.test.uiautomator.QueryController.<init>(QueryController.java:95)
05-04 08:53:02.205: E/TestRunner(6252): at androidx.test.uiautomator.UiDevice.<init>(UiDevice.java:109)
05-04 08:53:02.205: E/TestRunner(6252): at androidx.test.uiautomator.UiDevice.getInstance(UiDevice.java:261)
05-04 08:53:02.205: E/TestRunner(6252): at org.mozilla.fenix.helpers.TestHelper.<clinit>(TestHelper.kt:85)
05-04 08:53:02.205: E/TestRunner(6252): ... 37 more
05-04 08:53:02.205: E/TestRunner(6252): ----- end exception -----
05-04 08:53:02.216: I/TestRunner(6252): finished: openNewTabTest(org.mozilla.fenix.ui.TabbedBrowsingTest)
05-04 08:53:02.226: I/TestRunner(6252): run finished: 1 tests, 1 failed, 0 ignored
05-04 08:53:02.226: I/TestRunner(6252): --------- beginning of crash
05-04 08:53:02.232: E/AndroidRuntime(6252): FATAL EXCEPTION: Instr: androidx.test.runner.AndroidJUnitRunner
05-04 08:53:02.232: E/AndroidRuntime(6252): Process: org.mozilla.fenix.debug, PID: 6252
05-04 08:53:02.232: E/AndroidRuntime(6252): java.lang.IllegalStateException: UiAutomation not connected!
05-04 08:53:02.232: E/AndroidRuntime(6252): at android.app.UiAutomation.throwIfNotConnectedLocked(UiAutomation.java:1043)
05-04 08:53:02.232: E/AndroidRuntime(6252): at android.app.UiAutomation.disconnect(UiAutomation.java:275)
05-04 08:53:02.232: E/AndroidRuntime(6252): at android.app.Instrumentation.finish(Instrumentation.java:241)
05-04 08:53:02.232: E/AndroidRuntime(6252): at androidx.test.runner.MonitoringInstrumentation.finish(MonitoringInstrumentation.java:422)
05-04 08:53:02.232: E/AndroidRuntime(6252): at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:457)
05-04 08:53:02.232: E/AndroidRuntime(6252): at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2074)
05-04 08:53:02.240: I/Process(6252): Sending signal. PID: 6252 SIG: 9
05-04 08:53:02.302: I/ActivityManager(1395): Process org.mozilla.fenix.debug (pid 6252) has died: fore FGS
05-04 08:53:02.305: W/ActivityManager(1395): Scheduling restart of crashed service org.mozilla.fenix.debug/androidx.work.impl.background.systemjob.SystemJobService in 1000ms
05-04 08:53:02.306: W/ActivityManager(1395): Crash of app org.mozilla.fenix.debug running instrumentation ComponentInfo{org.mozilla.fenix.debug.test/androidx.test.runner.AndroidJUnitRunner}
05-04 08:53:02.307: I/ActivityManager(1395): Force stopping org.mozilla.fenix.debug appid=10086 user=0: finished inst
05-04 08:53:02.307: I/ServiceChildProcess(6296): Destroying GeckoServiceChildProcess
05-04 08:53:02.307: I/ActivityManager(1395): Killing 6296:org.mozilla.fenix.debug:tab33/u0a86 (adj 0): stop org.mozilla.fenix.debug
05-04 08:53:02.307: W/Binder(1395): Outgoing transactions from this process must be FLAG_ONEWAY
05-04 08:53:02.307: W/Binder(1395): java.lang.Throwable
05-04 08:53:02.307: W/Binder(1395): at android.os.BinderProxy.transact(Binder.java:736)
05-04 08:53:02.307: W/Binder(1395): at android.app.IInstrumentationWatcher$Stub$Proxy.instrumentationFinished(IInstrumentationWatcher.java:160)
05-04 08:53:02.307: W/Binder(1395): at com.android.server.am.InstrumentationReporter$MyThread.run(InstrumentationReporter.java:86)
05-04 08:53:02.314: D/AndroidRuntime(6243): Shutting down VM
05-04 08:53:02.314: I/ActivityManager(1395): Killing 6396:org.mozilla.fenix.debug:gpu/u0a86 (adj 0): stop org.mozilla.fenix.debug
05-04 08:53:02.315: W/Binder(6243): Binder call failed.
05-04 08:53:02.315: W/Binder(6243): java.lang.SecurityException: Calling from not trusted UID!
05-04 08:53:02.315: W/Binder(6243): at android.app.UiAutomationConnection.throwIfCalledByNotTrustedUidLocked(UiAutomationConnection.java:413)
05-04 08:53:02.315: W/Binder(6243): at android.app.UiAutomationConnection.shutdown(UiAutomationConnection.java:317)
05-04 08:53:02.315: W/Binder(6243): at android.app.IUiAutomationConnection$Stub.onTransact(IUiAutomationConnection.java:209)
05-04 08:53:02.315: W/Binder(6243): at android.os.Binder.execTransact(Binder.java:674)
05-04 08:53:02.320: I/ActivityManager(1395): Killing 3977:com.android.keychain/1000 (adj 906): empty #17
05-04 08:53:02.321: I/ActivityManager(1395): Killing 2690:android.process.media/u0a9 (adj 906): empty #18
05-04 08:53:02.321: E/lowmemorykiller(1166): Error writing /proc/3977/oom_score_adj; errno=22
05-04 08:53:02.323: I/ActivityManager(1395): Force stopping service ServiceRecord{c0e49dd u0 org.mozilla.fenix.debug/androidx.work.impl.background.systemjob.SystemJobService}
05-04 08:53:02.326: E/memtrack(1395): Couldn't load memtrack module
05-04 08:53:02.326: W/android.os.Debug(1395): failed to get memory consumption info: -1
05-04 08:53:02.332: E/memtrack(1395): Couldn't load memtrack module
05-04 08:53:02.334: W/android.os.Debug(1395): failed to get memory consumption info: -1
05-04 08:53:02.343: I/ActivityManager(1395): Force stopping androidx.test.orchestrator appid=10079 user=0: finished inst
05-04 08:53:02.343: I/ActivityManager(1395): Killing 6199:androidx.test.orchestrator/u0a79 (adj 0): stop androidx.test.orchestrator
05-04 08:53:02.343: W/Binder(1395): Outgoing transactions from this process must be FLAG_ONEWAY
05-04 08:53:02.343: W/Binder(1395): java.lang.Throwable
05-04 08:53:02.343: W/Binder(1395): at android.os.BinderProxy.transact(Binder.java:736)
05-04 08:53:02.343: W/Binder(1395): at android.app.IInstrumentationWatcher$Stub$Proxy.instrumentationFinished(IInstrumentationWatcher.java:160)
05-04 08:53:02.343: W/Binder(1395): at com.android.server.am.InstrumentationReporter$MyThread.run(InstrumentationReporter.java:86)
05-04 08:53:02.344: D/AndroidRuntime(6186): Shutting down VM

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: NEW → RESOLVED
Closed: 2 years ago
status-firefox113: affected → wontfix
Resolution: --- → INCOMPLETE

► 6/27 Firebase link

Status: RESOLVED → REOPENED
status-firefox114: --- → unaffected
status-firefox115: --- → unaffected
status-firefox116: --- → affected
Resolution: INCOMPLETE → ---

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED
Closed: 2 years ago → 2 years ago
status-firefox116: affected → wontfix
Resolution: --- → INCOMPLETE

► 6/27
openNewPrivateTabTest on Pixel 2 (Arm), Virtual, API Level 27 Firebase link

Status: RESOLVED → REOPENED
status-firefox117: --- → unaffected
status-firefox118: --- → unaffected
status-firefox119: --- → affected
Resolution: INCOMPLETE → ---

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED
Closed: 2 years ago → 2 years ago
status-firefox119: affected → wontfix
Resolution: --- → INCOMPLETE

► 10/2 autoland on Pixel 2 (Arm), Virtual, API Level 26 Firebase link

► 10/9 autoland on Pixel 2 (Arm), Virtual, API Level 26 Firebase link

► 10/10 mozilla-release on Pixel 2 (Arm), Virtual, API Level 26 Firebase link

► 10/10 mozilla-beta on Pixel 2 (Arm), Virtual, API Level 26 Firebase link

Status: RESOLVED → REOPENED
status-firefox131: --- → unaffected
status-firefox132: --- → unaffected
status-firefox133: --- → affected
Resolution: INCOMPLETE → ---

Closing for now, there's a fix for this test in Bug 1924995. Reopen if it shows up again.

Status: REOPENED → RESOLVED
Closed: 2 years ago → 1 year ago
status-firefox133: affected → fixed
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.