Closed Bug 1502087 Opened 6 years ago Closed 5 years ago

Intermittent org.mozilla.geckoview.test.AccessibilityTest#testScroll | status -2

Categories

(GeckoView :: General, defect, P3)

defect

Tracking

(geckoview64 wontfix, firefox64 wontfix, firefox65 fixed)

RESOLVED WORKSFORME
mozilla65
Tracking Status
geckoview64 --- wontfix
firefox64 --- wontfix
firefox65 --- fixed

People

(Reporter: gbrown, Assigned: eeejay)

References

(Blocks 1 open bug)

Details

(Keywords: intermittent-failure, Whiteboard: [stockwell disabled])

Attachments

(1 file)

This is a frequent intermittent failure seen only on the Android 7.0 x86 test platform:

https://treeherder.mozilla.org/logviewer.html#?job_id=207740453&repo=mozilla-central&lineNumber=1660

[task 2018-10-25T10:39:27.264Z] 10:39:27     INFO -  TEST-START | org.mozilla.geckoview.test.AccessibilityTest.testScroll
[task 2018-10-25T10:39:27.763Z] 10:39:27     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: numtests=373
[task 2018-10-25T10:39:27.763Z] 10:39:27     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stream=
[task 2018-10-25T10:39:27.764Z] 10:39:27     INFO -  org.mozilla.geckoview.test | Error in testScroll(org.mozilla.geckoview.test.AccessibilityTest):
[task 2018-10-25T10:39:27.764Z] 10:39:27     INFO -  org.mozilla.geckoview.test | java.lang.AssertionError: View is scrolled to the beginning
[task 2018-10-25T10:39:27.764Z] 10:39:27     INFO -  org.mozilla.geckoview.test | Expected: <0>
[task 2018-10-25T10:39:27.764Z] 10:39:27     INFO -  org.mozilla.geckoview.test |      but: was <4>
[task 2018-10-25T10:39:27.764Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
[task 2018-10-25T10:39:27.764Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.Assert.assertThat(Assert.java:956)
[task 2018-10-25T10:39:27.765Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
[task 2018-10-25T10:39:27.765Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
[task 2018-10-25T10:39:27.765Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
[task 2018-10-25T10:39:27.765Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.checkThat(GeckoSessionTestRule.java:893)
[task 2018-10-25T10:39:27.765Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.BaseSessionTest.assertThat(BaseSessionTest.kt:52)
[task 2018-10-25T10:39:27.765Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.AccessibilityTest$testScroll$4.onScrolled(AccessibilityTest.kt:565)
[task 2018-10-25T10:39:27.766Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2018-10-25T10:39:27.766Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.forCallbacksDuringWait(GeckoSessionTestRule.java:1817)
[task 2018-10-25T10:39:27.766Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.waitUntilCalled(GeckoSessionTestRule.java:1641)
[task 2018-10-25T10:39:27.766Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.waitUntilCalled(GeckoSessionTestRule.java:1593)
[task 2018-10-25T10:39:27.766Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.AccessibilityTest.testScroll(AccessibilityTest.kt:562)
[task 2018-10-25T10:39:27.767Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2018-10-25T10:39:27.767Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
[task 2018-10-25T10:39:27.767Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
[task 2018-10-25T10:39:27.767Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
[task 2018-10-25T10:39:27.767Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
[task 2018-10-25T10:39:27.767Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at android.support.test.internal.runner.junit4.statement.RunBefores.evaluate(RunBefores.java:80)
[task 2018-10-25T10:39:27.767Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at android.support.test.internal.runner.junit4.statement.RunAfters.evaluate(RunAfters.java:61)
[task 2018-10-25T10:39:27.768Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$4$1.run(GeckoSessionTestRule.java:1435)
[task 2018-10-25T10:39:27.768Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:1950)
[task 2018-10-25T10:39:27.768Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.handleCallback(Handler.java:751)
[task 2018-10-25T10:39:27.768Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.dispatchMessage(Handler.java:95)
[task 2018-10-25T10:39:27.768Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at android.os.Looper.loop(Looper.java:154)
[task 2018-10-25T10:39:27.768Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at android.app.ActivityThread.main(ActivityThread.java:6077)
[task 2018-10-25T10:39:27.768Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2018-10-25T10:39:27.769Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2018-10-25T10:39:27.769Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2018-10-25T10:39:27.769Z] 10:39:27     INFO -  org.mozilla.geckoview.test |
[task 2018-10-25T10:39:27.769Z] 10:39:27     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
[task 2018-10-25T10:39:27.769Z] 10:39:27     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: test=testScroll
[task 2018-10-25T10:39:27.769Z] 10:39:27     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: class=org.mozilla.geckoview.test.AccessibilityTest
[task 2018-10-25T10:39:27.770Z] 10:39:27     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stack=java.lang.AssertionError: View is scrolled to the beginning
[task 2018-10-25T10:39:27.770Z] 10:39:27     INFO -  org.mozilla.geckoview.test | Expected: <0>
[task 2018-10-25T10:39:27.770Z] 10:39:27     INFO -  org.mozilla.geckoview.test |      but: was <4>
[task 2018-10-25T10:39:27.770Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
[task 2018-10-25T10:39:27.770Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.Assert.assertThat(Assert.java:956)
[task 2018-10-25T10:39:27.770Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
[task 2018-10-25T10:39:27.770Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
[task 2018-10-25T10:39:27.770Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
[task 2018-10-25T10:39:27.771Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.checkThat(GeckoSessionTestRule.java:893)
[task 2018-10-25T10:39:27.771Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.BaseSessionTest.assertThat(BaseSessionTest.kt:52)
[task 2018-10-25T10:39:27.771Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.AccessibilityTest$testScroll$4.onScrolled(AccessibilityTest.kt:565)
[task 2018-10-25T10:39:27.771Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2018-10-25T10:39:27.771Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.forCallbacksDuringWait(GeckoSessionTestRule.java:1817)
[task 2018-10-25T10:39:27.771Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.waitUntilCalled(GeckoSessionTestRule.java:1641)
[task 2018-10-25T10:39:27.772Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.waitUntilCalled(GeckoSessionTestRule.java:1593)
[task 2018-10-25T10:39:27.772Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.AccessibilityTest.testScroll(AccessibilityTest.kt:562)
[task 2018-10-25T10:39:27.772Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2018-10-25T10:39:27.772Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
[task 2018-10-25T10:39:27.772Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
[task 2018-10-25T10:39:27.772Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
[task 2018-10-25T10:39:27.773Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
[task 2018-10-25T10:39:27.773Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at android.support.test.internal.runner.junit4.statement.RunBefores.evaluate(RunBefores.java:80)
[task 2018-10-25T10:39:27.773Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at android.support.test.internal.runner.junit4.statement.RunAfters.evaluate(RunAfters.java:61)
[task 2018-10-25T10:39:27.773Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$4$1.run(GeckoSessionTestRule.java:1435)
[task 2018-10-25T10:39:27.773Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:1950)
[task 2018-10-25T10:39:27.773Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.handleCallback(Handler.java:751)
[task 2018-10-25T10:39:27.774Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.dispatchMessage(Handler.java:95)
[task 2018-10-25T10:39:27.774Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at android.os.Looper.loop(Looper.java:154)
[task 2018-10-25T10:39:27.774Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at android.app.ActivityThread.main(ActivityThread.java:6077)
[task 2018-10-25T10:39:27.774Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2018-10-25T10:39:27.774Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2018-10-25T10:39:27.774Z] 10:39:27     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2018-10-25T10:39:27.774Z] 10:39:27     INFO -  org.mozilla.geckoview.test |
[task 2018-10-25T10:39:27.775Z] 10:39:27     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: current=14
[task 2018-10-25T10:39:27.775Z] 10:39:27     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS_CODE: -2
[task 2018-10-25T10:39:27.775Z] 10:39:27  WARNING -  TEST-UNEXPECTED-FAIL | org.mozilla.geckoview.test.AccessibilityTest.testScroll | status -2
Summary: org.mozilla.geckoview.test.AccessibilityTest.testScroll | status -2 → Intermittent org.mozilla.geckoview.test.AccessibilityTest.testScroll | status -2
Assignee: nobody → eitan
Priority: -- → P3
It looks like a previous test has an input focus and this test starts
when the scheduled animated ZoomToRect starts (via GeckoView:ZoomToInput). Then it interferes with the expected scroll events in this test.

There might be a deeper bug here (the unload from a previous page should not affect the current APZC). There might also be a way to do better cleanup on the text edit tests that mess with this one. But it's tricky because we don't get a callback when ZoomToInput is done.. (TextInputDelegate.restartInput won't do).
Attachment #9020963 - Flags: review?(snorp)
Attachment #9020963 - Flags: review?(snorp) → review+
Keywords: checkin-needed
Pushed by nerli@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/8a49abaefd77
Don't reuse session for AccessibilityTest.testScroll. r=snorp
Keywords: checkin-needed
:eeejay -- Thanks so much for looking at this. Unfortunately, testScroll continues to fail after this change:

https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&tier=1%2C2%2C3&searchStr=junit&selectedJob=208938342&revision=d378f97755ea43ae3474a38e2fbe7e8515c7b175
Flags: needinfo?(eitan)
Crap. That's another problem with ReuseSession(false)..

I'll come up with a followup soon.
Flags: needinfo?(eitan)
https://hg.mozilla.org/mozilla-central/rev/8a49abaefd77
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → FIXED
Target Milestone: --- → Firefox 65
Depends on: 1503728
64=wontfix because we don't need to uplift this fix for Focus 8.0's GV 64 beta test
(In reply to Eitan Isaacson [:eeejay] from comment #5)
> Crap. That's another problem with ReuseSession(false)..
> 
> I'll come up with a followup soon.

Failures continue after bug 1503728:

https://treeherder.mozilla.org/logviewer.html#?job_id=210155730&repo=mozilla-inbound

File a new bug? Re-open this one?
Flags: needinfo?(eitan)
Are there still failures? This shows that nothing came up again after 11/2

https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2018-10-10&endday=2018-11-09&tree=all&page=1&page_size=20&bug=1502087
Flags: needinfo?(eitan) → needinfo?(gbrown)
The geckoview-junit tests on Android 7.0 x86 are running as tier 3 tasks currently (because they keep failing): That means they are hidden by default and not sheriffed. Failures are not starred by sheriffs, so they don't show up in the intermittent-failures reports. (I have starred a few, so there are some, but I haven't done any lately.)


You can view the tasks on mozilla-central with:

https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&tier=1%2C2%2C3&searchStr=android%2C7.%2C0%2Cgeckoview-junit


In the most recent runs, it looks like testScroll is hanging:

https://treeherder.mozilla.org/logviewer.html#?job_id=210879504&repo=mozilla-central&lineNumber=1537

[task 2018-11-09T18:48:13.736Z] 18:48:13     INFO -  TEST-START | org.mozilla.geckoview.test.AccessibilityTest.testScroll
[task 2018-11-09T19:27:59.484Z] 19:27:59  WARNING -  TEST-UNEXPECTED-TIMEOUT | runjunit.py | Timed out after 2400 seconds
Flags: needinfo?(gbrown)
See Also: → 1506276
This has got very high occurrence or perma failure with the landing of bug 1510214.
Note that comment 14/15 applied to failures on Android 4.3, which had been running reliably.

Coincidentally, bug 1506276 disabled this test shortly after it started failing on Android 4.3 -- it is no longer running.
status-geckoview64=wontfix
Whiteboard: [stockwell needswork:owner]
Whiteboard: [stockwell needswork:owner] → [stockwell disabled]
Product: Firefox for Android → GeckoView
Target Milestone: Firefox 65 → mozilla65

Resolving as WFM because this test failure has not repeated in over three months.

Status: REOPENED → RESOLVED
Closed: 6 years ago5 years ago
Resolution: --- → WORKSFORME

6c6f5da9-bf33-4082-a19d-7d99e8083d97 Mass rename intermittents due to Bug 1723034.

Summary: Intermittent org.mozilla.geckoview.test.AccessibilityTest.testScroll | status -2 → Intermittent org.mozilla.geckoview.test.AccessibilityTest#testScroll | status -2
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: