1574361 - Perma org.mozilla.geckoview.test.WebNotificationTest.onShowNotification | status -2 when Gecko 70 merges to Beta on 2019-08-26

Status: VERIFIED FIXED

(GeckoView :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: opoprus [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=261893679&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/RNNkd7wYSQa9TtQD6qlIkg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2019-08-16T00:14:08.448Z] 00:14:08 INFO - TEST-START | org.mozilla.geckoview.test.WebNotificationTest.onShowNotification
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: numtests=497
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stream=
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | Error in onShowNotification(org.mozilla.geckoview.test.WebNotificationTest):
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | java.lang.AssertionError: Permission should be granted
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | Expected: "granted"
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | but: was "default"
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.junit.Assert.assertThat(Assert.java:956)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.checkThat(GeckoSessionTestRule.java:806)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.BaseSessionTest.assertThat(BaseSessionTest.kt:70)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.WebNotificationTest.setup(WebNotificationTest.kt:23)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at java.lang.reflect.Method.invoke(Native Method)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at android.support.test.internal.runner.junit4.statement.RunBefores.evaluate(RunBefores.java:76)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2.lambda$evaluate$0$GeckoSessionTestRule$2(GeckoSessionTestRule.java:1267)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.-$$Lambda$GeckoSessionTestRule$2$mzZNnl5Bu5F2_4xGxj0DHU4J33I.run(lambda)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:1950)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at android.os.Handler.handleCallback(Handler.java:751)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at android.os.Handler.dispatchMessage(Handler.java:95)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at android.os.Looper.loop(Looper.java:154)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at android.app.ActivityThread.main(ActivityThread.java:6077)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at java.lang.reflect.Method.invoke(Native Method)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test |
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: test=onShowNotification
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: class=org.mozilla.geckoview.test.WebNotificationTest
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stack=java.lang.AssertionError: Permission should be granted
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | Expected: "granted"
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | but: was "default"
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.junit.Assert.assertThat(Assert.java:956)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
[task 2019-08-16T00:14:09.052Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
[task 2019-08-16T00:14:09.053Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.checkThat(GeckoSessionTestRule.java:806)
[task 2019-08-16T00:14:09.053Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.BaseSessionTest.assertThat(BaseSessionTest.kt:70)
[task 2019-08-16T00:14:09.053Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.WebNotificationTest.setup(WebNotificationTest.kt:23)
[task 2019-08-16T00:14:09.053Z] 00:14:09 INFO - org.mozilla.geckoview.test | at java.lang.reflect.Method.invoke(Native Method)
[task 2019-08-16T00:14:09.053Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
[task 2019-08-16T00:14:09.053Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
[task 2019-08-16T00:14:09.054Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
[task 2019-08-16T00:14:09.054Z] 00:14:09 INFO - org.mozilla.geckoview.test | at android.support.test.internal.runner.junit4.statement.RunBefores.evaluate(RunBefores.java:76)
[task 2019-08-16T00:14:09.055Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2.lambda$evaluate$0$GeckoSessionTestRule$2(GeckoSessionTestRule.java:1267)
[task 2019-08-16T00:14:09.055Z] 00:14:09 INFO - org.mozilla.geckoview.test | at org.mozilla.geckoview.test.rule.-$$Lambda$GeckoSessionTestRule$2$mzZNnl5Bu5F2_4xGxj0DHU4J33I.run(lambda)
[task 2019-08-16T00:14:09.055Z] 00:14:09 INFO - org.mozilla.geckoview.test | at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:1950)
[task 2019-08-16T00:14:09.055Z] 00:14:09 INFO - org.mozilla.geckoview.test | at android.os.Handler.handleCallback(Handler.java:751)
[task 2019-08-16T00:14:09.055Z] 00:14:09 INFO - org.mozilla.geckoview.test | at android.os.Handler.dispatchMessage(Handler.java:95)
[task 2019-08-16T00:14:09.055Z] 00:14:09 INFO - org.mozilla.geckoview.test | at android.os.Looper.loop(Looper.java:154)
[task 2019-08-16T00:14:09.055Z] 00:14:09 INFO - org.mozilla.geckoview.test | at android.app.ActivityThread.main(ActivityThread.java:6077)
[task 2019-08-16T00:14:09.056Z] 00:14:09 INFO - org.mozilla.geckoview.test | at java.lang.reflect.Method.invoke(Native Method)
[task 2019-08-16T00:14:09.056Z] 00:14:09 INFO - org.mozilla.geckoview.test | at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2019-08-16T00:14:09.056Z] 00:14:09 INFO - org.mozilla.geckoview.test | at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2019-08-16T00:14:09.056Z] 00:14:09 INFO - org.mozilla.geckoview.test |
[task 2019-08-16T00:14:09.056Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: current=468
[task 2019-08-16T00:14:09.056Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS_CODE: -2
[task 2019-08-16T00:14:09.056Z] 00:14:09 WARNING - TEST-UNEXPECTED-FAIL | org.mozilla.geckoview.test.WebNotificationTest.onShowNotification | status -2
[task 2019-08-16T00:14:09.056Z] 00:14:09 INFO - TEST-INFO took 606ms
[task 2019-08-16T00:14:09.056Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: numtests=497
[task 2019-08-16T00:14:09.057Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stream=
[task 2019-08-16T00:14:09.057Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
[task 2019-08-16T00:14:09.057Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: test=onCloseNotification
[task 2019-08-16T00:14:09.057Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: class=org.mozilla.geckoview.test.WebNotificationTest
[task 2019-08-16T00:14:09.059Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: current=469
[task 2019-08-16T00:14:09.059Z] 00:14:09 INFO - org.mozilla.geckoview.test | INSTRUMENTATION_STATUS_CODE: 1

Comment 1

[Intermittent Failures Robot]

3 failures in 4839 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• android-em-7-0-x86_64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1574361&startday=2019-08-12&endday=2019-08-18&tree=all

Comment 2

[Intermittent Failures Robot]

21 failures in 5073 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• try: 14
• autoland: 5

Platform breakdown:

• android-em-7-0-x86_64: 21

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1574361&startday=2019-08-19&endday=2019-08-25&tree=all

Comment 3

[Bogdan Tara[:bogdan_tara | bogdant]]

This seems to perma fail on today's beta simulation:
https://treeherder.mozilla.org/#/jobs?repo=try&selectedJob=263870317&revision=054cba7223bc44f9e4bea4a788e9b0854602feae&searchStr=geckoview-junit-e10s%2C%28gv-junit%29

Comment 4

[Noemi Erli[:noemi_erli]]

This seems to be permafailing on beta simulation since 22nd of August:
https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=471a9a6c94f7847e8dde2e2434d96bee8e17d779&selectedJob=262904177

Chris, could this be related to https://bugzilla.mozilla.org/show_bug.cgi?id=1533057?
https://hg.mozilla.org/integration/autoland/rev/2d59ce318c46327d78c46c00086ea847223c383c

Comment 5

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Agi, can you check why this is failing on beta, please?

Comment 6

[Intermittent Failures Robot]

51 failures in 5047 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #33 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• try: 39
• mozilla-beta: 12

Platform breakdown:

• android-em-7-0-x86_64: 51

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1574361&startday=2019-08-26&endday=2019-09-01&tree=all

Comment 7

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

dom.webnotifications.requireinteraction.enabled is only true on Nightly: https://searchfox.org/mozilla-central/rev/9415ecf29ba1acbef9381335e0ecde5916ca4073/modules/libpref/init/StaticPrefList.yaml#2513-2516

The test assumes it's always true: https://searchfox.org/mozilla-central/rev/9415ecf29ba1acbef9381335e0ecde5916ca4073/mobile/android/geckoview/src/androidTest/java/org/mozilla/geckoview/test/WebNotificationTest.kt#53

Comment 8

[[ex-Mozilla] Agi Sferro | :agi]

Sounds like an easy fix, thanks for looking at it aryx. I'll send a patch soon.

Comment 9

[[ex-Mozilla] Agi Sferro | :agi]

Attachment: Bug 1574361 - Don't assume value of requireInteraction in tests.

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ee3c8a5445ff
Don't assume value of requireInteraction in tests. r=snorp

Comment 11

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/ee3c8a5445ff

Comment 12

[Noemi Erli[:noemi_erli]]

Verified in today's beta-sim: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception&revision=cb853226098e88a353228488821cf30d3c106ad0&searchStr=android%2C7.0%2Cx86-64%2Cdebug%2Ctest-android-em-7.0-x86_64%2Fdebug-geckoview-junit-e10s%2C%28gv-junit%29%2C&selectedJob=265315003

Comment 14

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/releases/mozilla-beta/rev/8524ee3fe5d4

Comment 15

[Intermittent Failures Robot]

13 failures in 4408 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 9
• mozilla-beta: 4

Platform breakdown:

• android-em-7-0-x86_64: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1574361&startday=2019-09-02&endday=2019-09-08&tree=all