1617475 - Intermittent org.mozilla.geckoview.test.AccessibilityTest#autoFill_navigation | java.lang.AssertionError: Password auto-fill count should match

Status: RESOLVED INCOMPLETE

(GeckoView :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=290088297&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/JPez1vDVT_e2QEwItePbMQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-02-23T16:32:57.624Z] 16:32:57 INFO - TEST-START | org.mozilla.geckoview.test.AccessibilityTest.autoFill_navigation
[task 2020-02-23T16:33:01.139Z] 16:33:01 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: numtests=640
[task 2020-02-23T16:33:01.142Z] 16:33:01 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stream=
[task 2020-02-23T16:33:01.142Z] 16:33:01 INFO - org.mozilla.geckoview.test | Error in autoFill_navigation(org.mozilla.geckoview.test.AccessibilityTest):
[task 2020-02-23T16:33:01.142Z] 16:33:01 INFO - org.mozilla.geckoview.test | java.lang.AssertionError: Password auto-fill count should match
[task 2020-02-23T16:33:01.142Z] 16:33:01 INFO - org.mozilla.geckoview.test | Expected: <4>
[task 2020-02-23T16:33:01.142Z] 16:33:01 INFO - org.mozilla.geckoview.test | but: was <2>
[task 2020-02-23T16:33:01.142Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
[task 2020-02-23T16:33:01.142Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.Assert.assertThat(Assert.java:956)
[task 2020-02-23T16:33:01.142Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
[task 2020-02-23T16:33:01.142Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
[task 2020-02-23T16:33:01.142Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
[task 2020-02-23T16:33:01.143Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.checkThat(GeckoSessionTestRule.java:801)
[task 2020-02-23T16:33:01.144Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.BaseSessionTest.assertThat(BaseSessionTest.kt:81)
[task 2020-02-23T16:33:01.144Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.AccessibilityTest.autoFill_navigation(AccessibilityTest.kt:1117)
[task 2020-02-23T16:33:01.144Z] 16:33:01 INFO - org.mozilla.geckoview.test | at java.lang.reflect.Method.invoke(Native Method)
[task 2020-02-23T16:33:01.144Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
[task 2020-02-23T16:33:01.144Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
[task 2020-02-23T16:33:01.144Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
[task 2020-02-23T16:33:01.144Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
[task 2020-02-23T16:33:01.144Z] 16:33:01 INFO - org.mozilla.geckoview.test | at androidx.test.internal.runner.junit4.statement.RunBefores.evaluate(RunBefores.java:80)
[task 2020-02-23T16:33:01.144Z] 16:33:01 INFO - org.mozilla.geckoview.test | at androidx.test.internal.runner.junit4.statement.RunAfters.evaluate(RunAfters.java:61)
[task 2020-02-23T16:33:01.144Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2.lambda$evaluate$0$GeckoSessionTestRule$2(GeckoSessionTestRule.java:1282)
[task 2020-02-23T16:33:01.144Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.-$$Lambda$GeckoSessionTestRule$2$sIbRNaZJgAu-QrUVWSGD8JbPSWM.run(lambda)
[task 2020-02-23T16:33:01.144Z] 16:33:01 INFO - org.mozilla.geckoview.test | at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:1950)
[task 2020-02-23T16:33:01.144Z] 16:33:01 INFO - org.mozilla.geckoview.test | at android.os.Handler.handleCallback(Handler.java:751)
[task 2020-02-23T16:33:01.144Z] 16:33:01 INFO - org.mozilla.geckoview.test | at android.os.Handler.dispatchMessage(Handler.java:95)
[task 2020-02-23T16:33:01.145Z] 16:33:01 INFO - org.mozilla.geckoview.test | at android.os.Looper.loop(Looper.java:154)
[task 2020-02-23T16:33:01.145Z] 16:33:01 INFO - org.mozilla.geckoview.test | at android.app.ActivityThread.main(ActivityThread.java:6077)
[task 2020-02-23T16:33:01.145Z] 16:33:01 INFO - org.mozilla.geckoview.test | at java.lang.reflect.Method.invoke(Native Method)
[task 2020-02-23T16:33:01.145Z] 16:33:01 INFO - org.mozilla.geckoview.test | at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2020-02-23T16:33:01.145Z] 16:33:01 INFO - org.mozilla.geckoview.test | at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2020-02-23T16:33:01.145Z] 16:33:01 INFO - org.mozilla.geckoview.test |
[task 2020-02-23T16:33:01.145Z] 16:33:01 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
[task 2020-02-23T16:33:01.145Z] 16:33:01 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: test=autoFill_navigation
[task 2020-02-23T16:33:01.146Z] 16:33:01 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: class=org.mozilla.geckoview.test.AccessibilityTest
[task 2020-02-23T16:33:01.146Z] 16:33:01 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stack=java.lang.AssertionError: Password auto-fill count should match
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | Expected: <4>
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | but: was <2>
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.Assert.assertThat(Assert.java:956)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.checkThat(GeckoSessionTestRule.java:801)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.BaseSessionTest.assertThat(BaseSessionTest.kt:81)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.AccessibilityTest.autoFill_navigation(AccessibilityTest.kt:1117)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at java.lang.reflect.Method.invoke(Native Method)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at androidx.test.internal.runner.junit4.statement.RunBefores.evaluate(RunBefores.java:80)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at androidx.test.internal.runner.junit4.statement.RunAfters.evaluate(RunAfters.java:61)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2.lambda$evaluate$0$GeckoSessionTestRule$2(GeckoSessionTestRule.java:1282)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.-$$Lambda$GeckoSessionTestRule$2$sIbRNaZJgAu-QrUVWSGD8JbPSWM.run(lambda)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:1950)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at android.os.Handler.handleCallback(Handler.java:751)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at android.os.Handler.dispatchMessage(Handler.java:95)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at android.os.Looper.loop(Looper.java:154)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at android.app.ActivityThread.main(ActivityThread.java:6077)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at java.lang.reflect.Method.invoke(Native Method)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2020-02-23T16:33:01.150Z] 16:33:01 INFO - org.mozilla.geckoview.test | at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2020-02-23T16:33:01.151Z] 16:33:01 INFO - org.mozilla.geckoview.test |
[task 2020-02-23T16:33:01.151Z] 16:33:01 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: current=14
[task 2020-02-23T16:33:01.151Z] 16:33:01 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS_CODE: -2
[task 2020-02-23T16:33:01.151Z] 16:33:01 WARNING - TEST-UNEXPECTED-FAIL | org.mozilla.geckoview.test.AccessibilityTest.autoFill_navigation | java.lang.AssertionError: Password auto-fill count should match
[task 2020-02-23T16:33:01.151Z] 16:33:01 INFO - TEST-INFO took 3521ms

Comment 1

[Intermittent Failures Robot]

1 failures in 4045 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1617475&startday=2020-02-17&endday=2020-02-23&tree=all

Comment 2

[Intermittent Failures Robot]

1 failures in 5233 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1617475&startday=2020-02-24&endday=2020-03-01&tree=all

Comment 3

[Intermittent Failures Robot]

1 failures in 4955 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1617475&startday=2020-03-16&endday=2020-03-22&tree=all

Comment 4

[Intermittent Failures Robot]

1 failures in 5423 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1617475&startday=2020-04-27&endday=2020-05-03&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 3967 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1617475&startday=2021-03-22&endday=2021-03-28&tree=all

Comment 6

[[ex-Mozilla] Agi Sferro | :agi]

6c6f5da9-bf33-4082-a19d-7d99e8083d97 Mass rename intermittents due to Bug 1723034.

Comment 7

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 8

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=371798627&repo=autoland

Comment 9

[Intermittent Failures Robot]

31 failures in 756 pushes (0.041 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 27
• mozilla-central: 3
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 12
  • opt: 12
• android-em-7-0-x86_64-shippable-lite-qr: 4
  • opt: 4
• android-em-7-0-x86_64-qr: 8
  • opt: 8
• android-em-7-0-x86_64-shippable-qr: 7
  • opt: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1617475&startday=2022-03-22&endday=2022-03-22&tree=all

Comment 10

[Intermittent Failures Robot]

43 failures in 691 pushes (0.062 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 38
• mozilla-central: 4
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 15
  • opt: 15
• android-em-7-0-x86_64-shippable-qr: 7
  • opt: 7
• android-em-7-0-x86_64-shippable-lite-qr: 3
  • opt: 3
• android-em-7-0-x86_64-lite-qr: 18
  • opt: 18

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1617475&startday=2022-03-23&endday=2022-03-23&tree=all

Comment 11

[Intermittent Failures Robot]

93 failures in 3341 pushes (0.028 failures/push) were associated with this bug in the last 7 days.

This is the #8 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 82
• mozilla-central: 8
• try: 3

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 38
  • opt: 38
• android-em-7-0-x86_64-qr: 29
  • opt: 29
• android-em-7-0-x86_64-shippable-lite-qr: 8
  • opt: 8
• android-em-7-0-x86_64-shippable-qr: 18
  • opt: 18

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1617475&startday=2022-03-21&endday=2022-03-27&tree=all

Comment 12

[Andreea Pavel [:apavel]]

No failures since the 25th

Comment 13

[Intermittent Failures Robot]

18 failures in 666 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 17
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 8
  • opt: 8
• android-em-7-0-x86_64-qr: 4
  • opt: 4
• android-em-7-0-x86_64-shippable-qr: 5
  • opt: 5
• android-em-7-0-x86_64-shippable-lite-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1617475&startday=2022-03-30&endday=2022-03-30&tree=all

Comment 14

[Intermittent Failures Robot]

20 failures in 3323 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 19
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 9
  • opt: 9
• android-em-7-0-x86_64-shippable-lite-qr: 2
  • opt: 2
• android-em-7-0-x86_64-qr: 4
  • opt: 4
• android-em-7-0-x86_64-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1617475&startday=2022-03-28&endday=2022-04-03&tree=all

Comment 15

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.