1853621 - Intermittent UI test failure - < EnhancedTrackingProtectionTest. clearWebsitesFromTPExceptionListTest >

Status: RESOLVED FIXED

(Firefox for Android :: UI Tests, defect, P3)

Description

[Andrei Jolțan [:Andi]]

Firebase Test Run: Firebase link

Stacktrace:

junit.framework.AssertionFailedError
at junit.framework.Assert.fail(Assert.java:48)
at junit.framework.Assert.assertTrue(Assert.java:20)
at junit.framework.Assert.assertTrue(Assert.java:27)
at org.mozilla.fenix.ui.robots.SettingsSubMenuEnhancedTrackingProtectionExceptionsRobot.verifyTPExceptionsDefaultView(SettingsSubMenuEnhancedTrackingProtectionExceptionsRobot.kt:38)
at org.mozilla.fenix.ui.EnhancedTrackingProtectionTest$clearWebsitesFromTPExceptionListTest$17.invoke(EnhancedTrackingProtectionTest.kt:228)
at org.mozilla.fenix.ui.EnhancedTrackingProtectionTest$clearWebsitesFromTPExceptionListTest$17.invoke(EnhancedTrackingProtectionTest.kt:227)
at org.mozilla.fenix.ui.robots.SettingsSubMenuEnhancedTrackingProtectionExceptionsRobot$Transition.disableExceptions(SettingsSubMenuEnhancedTrackingProtectionExceptionsRobot.kt:79)
at org.mozilla.fenix.ui.EnhancedTrackingProtectionTest.clearWebsitesFromTPExceptionListTest(EnhancedTrackingProtectionTest.kt:227)

Build: 9/15 Main

Comment 1

[Andrei Jolțan [:Andi]]

► 9/22 Firebase link

androidx.test.espresso.PerformException: Error performing 'single click' on view 'view.getId() is <2131297450/org.mozilla.fenix.debug:id/removeAllExceptions>'.

Comment 2

[Andrei Jolțan [:Andi]]

►10/5 Firebase link

junit.framework.AssertionFailedError at junit.framework.Assert.fail(Assert.java:48) at junit.framework.Assert.assertTrue(Assert.java:20) at junit.framework.Assert.assertTrue(Assert.java:27) at org.mozilla.fenix.ui.robots.SettingsSubMenuEnhancedTrackingProtectionExceptionsRobot.verifyTPExceptionsDefaultView(SettingsSubMenuEnhancedTrackingProtectionExceptionsRobot.kt:38)

Comment 3

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 4

[Andrei Jolțan [:Andi]]

► 11/17 Firebase link

Comment 5

[Oana Horvath [:ohorvath]]

Flaky on 20/11: Firebase

java.lang.AssertionError: UiSelector[TEXT=Exceptions let you disable tracking protection for selected sites.] does not exist
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists(MatcherHelper.kt:99)
at org.mozilla.fenix.helpers.MatcherHelper.assertUIObjectExists$default(MatcherHelper.kt:92)
at org.mozilla.fenix.ui.robots.SettingsSubMenuEnhancedTrackingProtectionExceptionsRobot.verifyTPExceptionsDefaultView(SettingsSubMenuEnhancedTrackingProtectionExceptionsRobot.kt:36)```

Comment 6

[Andrei Jolțan [:Andi]]

► 11/20 Firebase link

Comment 7

[Andrei Jolțan [:Andi]]

The UI test seem to be flaky because of 1865781

Comment 8

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 9

[Andrei Jolțan [:Andi]]

► 2/1 Firebase link

Comment 10

[Andrei Jolțan [:Andi]]

►2/3 Firebase link

Comment 11

[Andrei Jolțan [:Andi]]

► 2/21 Firebase link

Comment 12

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 13

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 14

[Andrei Jolțan [:Andi]]

Attachment: Bug 1853621 - Re-enable clearWebsitesFromTPExceptionListTest UI test

Comment 15

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/dc7669754269
Re-enable clearWebsitesFromTPExceptionListTest UI test r=ohorvath

Comment 16

[Norisz Fay [:noriszfay]]

https://hg.mozilla.org/mozilla-central/rev/dc7669754269