Closed Bug 1598172 Opened 6 years ago Closed 6 years ago

Intermittent org.mozilla.geckoview.test.AutofillDelegateTest#autofillCommit | status -2

Categories

(GeckoView :: General, defect, P5)

Product:
GeckoView
Component:
General
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED WORKSFORME

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure, Whiteboard: [retriggered])

Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=277295262&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ClU9LpS5SJOrXS-jzRctcg/runs/0/artifacts/public/logs/live_backing.log

[task 2019-11-20T23:52:32.031Z] 23:52:32 INFO - TEST-START | org.mozilla.geckoview.test.AutofillDelegateTest.autofillCommit
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: numtests=580
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stream=
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | Error in autofillCommit(org.mozilla.geckoview.test.AutofillDelegateTest):
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | java.lang.AssertionError: Values should match
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | Expected: <1>
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | but: was <0>
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.junit.Assert.assertThat(Assert.java:956)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.checkThat(GeckoSessionTestRule.java:797)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.BaseSessionTest.assertThat(BaseSessionTest.kt:76)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.AutofillDelegateTest$autofillCommit$2.onAutofill(AutofillDelegateTest.kt:87)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at java.lang.reflect.Method.invoke(Native Method)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.forCallbacksDuringWait(GeckoSessionTestRule.java:1661)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.waitUntilCalled(GeckoSessionTestRule.java:1476)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.waitUntilCalled(GeckoSessionTestRule.java:1428)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.AutofillDelegateTest.autofillCommit(AutofillDelegateTest.kt:62)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at java.lang.reflect.Method.invoke(Native Method)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2.lambda$evaluate$0$GeckoSessionTestRule$2(GeckoSessionTestRule.java:1266)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.-$$Lambda$GeckoSessionTestRule$2$mzZNnl5Bu5F2_4xGxj0DHU4J33I.run(lambda)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:1950)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at android.os.Handler.handleCallback(Handler.java:751)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at android.os.Handler.dispatchMessage(Handler.java:95)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at android.os.Looper.loop(Looper.java:154)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at android.app.ActivityThread.main(ActivityThread.java:6077)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at java.lang.reflect.Method.invoke(Native Method)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test |
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: test=autofillCommit
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: class=org.mozilla.geckoview.test.AutofillDelegateTest
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stack=java.lang.AssertionError: Values should match
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | Expected: <1>
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | but: was <0>
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
[task 2019-11-20T23:52:32.439Z] 23:52:32 INFO - org.mozilla.geckoview.test | at org.junit.Assert.assertThat(Assert.java:956)

Component: Raptor → General
Product: Testing → GeckoView
Version: Version 3 → unspecified

Retrigger range: https://tinyurl.com/wno8bz2

Whiteboard: [retriggered]

(In reply to Cosmin Sabou [:CosminS] from comment #2)

Sam please take this into account when re-landing Bug 1388674.

Thanks Cosmin, I'll add it to the list :)
I don't know much about geckoview or this test suite, but at glance it looks like the test needs to dispatch an input event on the password field before calling submit() on the form. MattN, do you know? The other option is just to set the signon.userInputRequiredToCapture.enabled pref false.

Flags: needinfo?(sfoster) → needinfo?(MattN+bmo)

(In reply to Sam Foster [:sfoster] (he/him) from comment #3)

(In reply to Cosmin Sabou [:CosminS] from comment #2)

Sam please take this into account when re-landing Bug 1388674.

Thanks Cosmin, I'll add it to the list :)
I don't know much about geckoview or this test suite, but at glance it looks like the test needs to dispatch an input event on the password field before calling submit() on the form. MattN, do you know?

Yeah, ideally the test would use setUserInput but it seems like an extension is what receives the message and I don't know if it has chrome-privileges so it may not have access to that method: https://searchfox.org/mozilla-central/rev/3483fb259b4edbe4594cfcc3911db97d5441b67d/mobile/android/geckoview/src/androidTest/assets/web_extensions/test-support/test-support.js#11,15

The other option is just to set the signon.userInputRequiredToCapture.enabled pref false.

I think that's what we can do for now. Looks like we can copy https://searchfox.org/mozilla-central/rev/3483fb259b4edbe4594cfcc3911db97d5441b67d/mobile/android/geckoview/src/androidTest/java/org/mozilla/geckoview/test/AutofillDelegateTest.kt#34

Flags: needinfo?(MattN+bmo)

Try push to test setting that pref.

Above try push doesn't show this failure.

:Mattn, should I just add that signon.userInputRequiredToCapture.enabled patch to mine on bug 1388674, or do you want to land it here?

Flags: needinfo?(MattN+bmo)

I uploaded it as https://phabricator.services.mozilla.com/D54801 on your bug. Feel free to re-order it.

Status: NEW → RESOLVED
Closed: 6 years ago
Flags: needinfo?(MattN+bmo)
Resolution: --- → WORKSFORME

6c6f5da9-bf33-4082-a19d-7d99e8083d97 Mass rename intermittents due to Bug 1723034.

Summary: Intermittent org.mozilla.geckoview.test.AutofillDelegateTest.autofillCommit | status -2 → Intermittent org.mozilla.geckoview.test.AutofillDelegateTest#autofillCommit | status -2
You need to log in before you can comment on or make changes to this bug.