1634056 - Perma late beta org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared | java.lang.AssertionError: Private mode storage value still set when Gecko 77 merges to Beta on 2020-05-04

Reporter

Description

•

4 years ago

Central as beta-sim: https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&selectedTaskRun=LAfkv4jET1C1ybTzqBvvrQ-0&resultStatus=testfailed%2Cbusted%2Cexception&author=csabou%40mozilla.com&fromchange=56f7ac5216096e0cedd404ce32f2c2296ffba163&tochange=2eaf4ae7a038df49405ed53f8826aadbf163fa76&searchStr=android%2C7.0%2Cx86-64%2Copt%2Ctest-android-em-7.0-x86_64%2Fopt-geckoview-junit-e10s-multi-e10s%2C%28gv-junit-e10s-multi%29

Failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=299981108&repo=try

[task 2020-04-29T12:35:03.110Z] 12:35:03     INFO -  TEST-START | org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared
[task 2020-04-29T12:35:09.420Z] 12:35:09     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: numtests=714
[task 2020-04-29T12:35:09.421Z] 12:35:09     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stream=
[task 2020-04-29T12:35:09.422Z] 12:35:09     INFO -  org.mozilla.geckoview.test | Error in privateModeStorageShared(org.mozilla.geckoview.test.PrivateModeTest):
[task 2020-04-29T12:35:09.423Z] 12:35:09     INFO -  org.mozilla.geckoview.test | java.lang.AssertionError: Private mode storage value still set
[task 2020-04-29T12:35:09.424Z] 12:35:09     INFO -  org.mozilla.geckoview.test | Expected: "private"
[task 2020-04-29T12:35:09.424Z] 12:35:09     INFO -  org.mozilla.geckoview.test |      but: was "null"
[task 2020-04-29T12:35:09.424Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
[task 2020-04-29T12:35:09.424Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.Assert.assertThat(Assert.java:956)
[task 2020-04-29T12:35:09.424Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
[task 2020-04-29T12:35:09.424Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
[task 2020-04-29T12:35:09.424Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
[task 2020-04-29T12:35:09.425Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.checkThat(GeckoSessionTestRule.java:801)
[task 2020-04-29T12:35:09.425Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.BaseSessionTest.assertThat(BaseSessionTest.kt:81)
[task 2020-04-29T12:35:09.425Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared(PrivateModeTest.kt:80)
[task 2020-04-29T12:35:09.425Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2020-04-29T12:35:09.426Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
[task 2020-04-29T12:35:09.427Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
[task 2020-04-29T12:35:09.427Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
[task 2020-04-29T12:35:09.427Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
[task 2020-04-29T12:35:09.428Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2.lambda$evaluate$0$GeckoSessionTestRule$2(GeckoSessionTestRule.java:1284)
[task 2020-04-29T12:35:09.428Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.-$$Lambda$GeckoSessionTestRule$2$sIbRNaZJgAu-QrUVWSGD8JbPSWM.run(lambda)
[task 2020-04-29T12:35:09.428Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:1950)
[task 2020-04-29T12:35:09.428Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.handleCallback(Handler.java:751)
[task 2020-04-29T12:35:09.428Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.dispatchMessage(Handler.java:95)
[task 2020-04-29T12:35:09.428Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at android.os.Looper.loop(Looper.java:154)
[task 2020-04-29T12:35:09.429Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at android.app.ActivityThread.main(ActivityThread.java:6077)
[task 2020-04-29T12:35:09.429Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2020-04-29T12:35:09.429Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2020-04-29T12:35:09.429Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test |
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: test=privateModeStorageShared
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: class=org.mozilla.geckoview.test.PrivateModeTest
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stack=java.lang.AssertionError: Private mode storage value still set
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | Expected: "private"
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test |      but: was "null"
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.Assert.assertThat(Assert.java:956)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.checkThat(GeckoSessionTestRule.java:801)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.BaseSessionTest.assertThat(BaseSessionTest.kt:81)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared(PrivateModeTest.kt:80)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2.lambda$evaluate$0$GeckoSessionTestRule$2(GeckoSessionTestRule.java:1284)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.-$$Lambda$GeckoSessionTestRule$2$sIbRNaZJgAu-QrUVWSGD8JbPSWM.run(lambda)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:1950)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.handleCallback(Handler.java:751)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.dispatchMessage(Handler.java:95)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at android.os.Looper.loop(Looper.java:154)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at android.app.ActivityThread.main(ActivityThread.java:6077)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test |
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: current=386
[task 2020-04-29T12:35:09.430Z] 12:35:09     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS_CODE: -2
[task 2020-04-29T12:35:09.431Z] 12:35:09  WARNING -  TEST-UNEXPECTED-FAIL | org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared | java.lang.AssertionError: Private mode storage value still set
[task 2020-04-29T12:35:09.431Z] 12:35:09     INFO -  TEST-INFO took 6320ms

This looks to be from Bug 1625845 https://hg.mozilla.org/mozilla-central/rev/ea15e5bb899e834b695670b2bfbe308095a1ee15#l3.35.
Sebastian, Christoph, could you have a look over this? Thank you.

Flags: needinfo?(sstreich)

Flags: needinfo?(ckerschb)

Cosmin Sabou [:CosminS]

Reporter

Updated

•

4 years ago

Regressed by: 1625845

Christoph Kerschbaumer [:ckerschb]

Comment 1

•

4 years ago

Basti is going to take a look!

Flags: needinfo?(ckerschb)

Pascal Chevrel:pascalc

Updated

•

4 years ago

tracking-firefox77: ? → +

Christoph Kerschbaumer [:ckerschb]

Updated

•

4 years ago

Assignee: nobody → sstreich

Status: NEW → ASSIGNED

Priority: -- → P1

Whiteboard: [domsecurity-active]

Sebastian Streich [:sstreich]

Comment 2

•

4 years ago

on it :)

Flags: needinfo?(sstreich)

Sebastian Streich [:sstreich]

Comment 3

•

4 years ago

Attached file Bug 1634056 - Pass GetURI failure in hasFirstpartyStorageAccess r=ckerschb (obsolete) — Details

Cosmin Sabou [:CosminS]

Reporter

Comment 5

•

4 years ago

Sebastian, looks like the patch is not working on late beta: https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception&author=opoprus%40mozilla.com&fromchange=0523f1a1202f25b722c54dc086c3e6e6d0b37996&searchStr=android%2C7.0%2Cx86-64%2Copt%2Ctest-android-em-7.0-x86_64%2Fopt-geckoview-junit-e10s-multi-e10s%2C%28gv-junit-e10s-multi%29&selectedTaskRun=FEP1SIc2SOG8cA6EGPD0xA-0
Failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=300374223&repo=try

Flags: needinfo?(sstreich)

Summary: Perma TEST-UNEXPECTED-FAIL | org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared | java.lang.AssertionError: Private mode storage value still set when Gecko 77 merges to Beta on 2020-05-04 → Perma late beta TEST-UNEXPECTED-FAIL | org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared | java.lang.AssertionError: Private mode storage value still set when Gecko 77 merges to Beta on 2020-05-04

Sebastian Streich [:sstreich]

Comment 6

•

4 years ago

Sorry im a bit confused. - Looking at the Failure log of your try run with the patch the test seems to pass now:
From:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=300371402&repo=try&lineNumber=7875

task 2020-05-01T12:21:06.471Z] 12:21:06     INFO -  TEST-START | org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared
[task 2020-05-01T12:21:10.182Z] 12:21:10     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: numtests=716
[task 2020-05-01T12:21:10.182Z] 12:21:10     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stream=.
[task 2020-05-01T12:21:10.182Z] 12:21:10     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
[task 2020-05-01T12:21:10.182Z] 12:21:10     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: test=privateModeStorageShared
[task 2020-05-01T12:21:10.182Z] 12:21:10     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: class=org.mozilla.geckoview.test.PrivateModeTest
[task 2020-05-01T12:21:10.182Z] 12:21:10     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: current=386
[task 2020-05-01T12:21:10.182Z] 12:21:10     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS_CODE: 0
[task 2020-05-01T12:21:10.182Z] 12:21:10     INFO -  TEST-PASS | org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared | took 3707ms

Flags: needinfo?(sstreich)

Cosmin Sabou [:CosminS]

Reporter

Comment 7

•

4 years ago

Yes, it passes on early beta and still fails on late beta. Late beta means after beta 5, the configuration gets changed from early to late beta. that disables some features developers still want to test with more people (on the beta channel, compared to Nightly) but is not ready to ship in the next release yet. Treeher link for late beta simulation.
So the late beta failure log is: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=300374223&repo=try&lineNumber=7944

[task 2020-05-01T12:28:17.903Z] 12:28:17     INFO -  TEST-START | org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared
[task 2020-05-01T12:28:18.704Z] 12:28:18     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: numtests=716
[task 2020-05-01T12:28:18.704Z] 12:28:18     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stream=
[task 2020-05-01T12:28:18.704Z] 12:28:18     INFO -  org.mozilla.geckoview.test | Error in privateModeStorageShared(org.mozilla.geckoview.test.PrivateModeTest):
[task 2020-05-01T12:28:18.704Z] 12:28:18     INFO -  org.mozilla.geckoview.test | java.lang.AssertionError: Private mode storage value still set
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | Expected: "private"
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test |      but: was "null"
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.Assert.assertThat(Assert.java:956)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.checkThat(GeckoSessionTestRule.java:801)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.BaseSessionTest.assertThat(BaseSessionTest.kt:82)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared(PrivateModeTest.kt:80)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2.lambda$evaluate$0$GeckoSessionTestRule$2(GeckoSessionTestRule.java:1284)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.-$$Lambda$GeckoSessionTestRule$2$sIbRNaZJgAu-QrUVWSGD8JbPSWM.run(lambda)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:1950)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.handleCallback(Handler.java:751)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.dispatchMessage(Handler.java:95)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at android.os.Looper.loop(Looper.java:154)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at android.app.ActivityThread.main(ActivityThread.java:6077)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test |
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: test=privateModeStorageShared
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: class=org.mozilla.geckoview.test.PrivateModeTest
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stack=java.lang.AssertionError: Private mode storage value still set
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | Expected: "private"
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test |      but: was "null"
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.Assert.assertThat(Assert.java:956)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector$1.call(ErrorCollector.java:65)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkSucceeds(ErrorCollector.java:78)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.ErrorCollector.checkThat(ErrorCollector.java:63)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule.checkThat(GeckoSessionTestRule.java:801)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.BaseSessionTest.assertThat(BaseSessionTest.kt:82)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared(PrivateModeTest.kt:80)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2.lambda$evaluate$0$GeckoSessionTestRule$2(GeckoSessionTestRule.java:1284)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.-$$Lambda$GeckoSessionTestRule$2$sIbRNaZJgAu-QrUVWSGD8JbPSWM.run(lambda)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:1950)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.handleCallback(Handler.java:751)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.dispatchMessage(Handler.java:95)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at android.os.Looper.loop(Looper.java:154)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at android.app.ActivityThread.main(ActivityThread.java:6077)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test |
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: current=386
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS_CODE: -2
[task 2020-05-01T12:28:18.711Z] 12:28:18  WARNING -  TEST-UNEXPECTED-FAIL | org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared | java.lang.AssertionError: Private mode storage value still set
[task 2020-05-01T12:28:18.711Z] 12:28:18     INFO -  TEST-INFO took 805ms ```

Flags: needinfo?(sstreich)

Julien Cristau [:jcristau]

Updated

•

4 years ago

status-firefox78: --- → affected

tracking-firefox78: --- → +

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Comment 8

•

4 years ago

Sebastian, Christoph, the affected code reaches the late beta stage on Wednesday. First beta build which will ship to users gets build in the night from Thursday to Friday. Can you check once more how to fix this?

Flags: needinfo?(ckerschb)

Christoph Kerschbaumer [:ckerschb]

Comment 9

•

4 years ago

(In reply to Sebastian Hengst [:aryx] (needinfo on intermittent or backout) from comment #8)

Sebastian, Christoph, the affected code reaches the late beta stage on Wednesday. First beta build which will ship to users gets build in the night from Thursday to Friday. Can you check once more how to fix this?

Yes, on it - sorry!

Sebastian Streich [:sstreich]

Comment 10

•

4 years ago

Hey! - I've updated the patch on phab, could we get another beta-sim run with it? If that one does not work aswell, i think we should back out the patch until we have a better solution. Right now there shouldnt be any other patches depending on it.

Flags: needinfo?(sstreich)

Flags: needinfo?(csabou)

Flags: needinfo?(ckerschb)

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Comment 11

•

4 years ago

The patch doesn't fix the issue: https://treeherder.mozilla.org/#/jobs?repo=try&revision=28308dbe7e41898629db0314da1b1c8d04e78e93&selectedTaskRun=cWswypcaTLGykTwkLqbLqg-0

Flags: needinfo?(csabou)

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Updated

•

4 years ago

Flags: needinfo?(sstreich)

Sebastian Streich [:sstreich]

Comment 12

•

4 years ago

Can we get the patch backed out in that case?

Flags: needinfo?(sstreich)

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Comment 13

•

4 years ago

Push the backout of bug 1625845 for 77 beta. Shall it get also backed out from central or is the goal to find a fix in the next 4 weeks?

Flags: needinfo?(sstreich)

Christoph Kerschbaumer [:ckerschb]

Comment 14

•

4 years ago

(In reply to Sebastian Hengst [:aryx] (needinfo on intermittent or backout) from comment #13)

Push the backout of bug 1625845 for 77 beta. Shall it get also backed out from central or is the goal to find a fix in the next 4 weeks?

Please also back it out from Beta too - thanks!

Flags: needinfo?(sstreich)

Christoph Kerschbaumer [:ckerschb]

Comment 15

•

4 years ago

(In reply to Christoph Kerschbaumer [:ckerschb] from comment #14)

(In reply to Sebastian Hengst [:aryx] (needinfo on intermittent or backout) from comment #13)

Push the backout of bug 1625845 for 77 beta. Shall it get also backed out from central or is the goal to find a fix in the next 4 weeks?

Please also back it out from central too - thanks!

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Comment 16

•

4 years ago

Fixed by backout of bug 1625845.

Status: ASSIGNED → RESOLVED

Closed: 4 years ago

status-firefox77: affected → fixed

status-firefox78: affected → fixed

Resolution: --- → FIXED

Target Milestone: --- → mozilla78

Phabricator Automation

Updated

•

4 years ago

Attachment #9144663 - Attachment is obsolete: true

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Comment 17

•

4 years ago

This test suite variant actually got added in bug 1622060. Aaron, can you look into this? It's failing on late betas.

Status: RESOLVED → REOPENED

status-firefox77: fixed → affected

status-firefox78: fixed → affected

Flags: needinfo?(aklotz)

Resolution: FIXED → ---

Target Milestone: mozilla78 → ---

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Updated

•

4 years ago

Regressed by: 1622060
No longer regressed by: 1625845

BMO Automation

Updated

•

4 years ago

Has Regression Range: --- → yes

(No longer employed by Mozilla) Aaron Klotz

Comment 18

•

4 years ago

We're not shipping this variant yet.

status-firefox77: affected → disabled

Flags: needinfo?(aklotz)

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Comment 19

•

4 years ago

But it's running in automation. Can the job return to green?

Flags: needinfo?(aklotz)

Summary: Perma late beta TEST-UNEXPECTED-FAIL | org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared | java.lang.AssertionError: Private mode storage value still set when Gecko 77 merges to Beta on 2020-05-04 → Perma late beta org.mozilla.geckoview.test.PrivateModeTest.privateModeStorageShared | java.lang.AssertionError: Private mode storage value still set when Gecko 77 merges to Beta on 2020-05-04

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Updated

•

4 years ago

Keywords: intermittent-failure

(No longer employed by Mozilla) Aaron Klotz

Comment 20

•

4 years ago

I filed bug 1639334 to turn this off in beta. It's a test variant, like the Fission tests; e10s-multi is turned on for this test suite and only for this test suite. It is not yet shipping by default.

Flags: needinfo?(aklotz)

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Updated

•

4 years ago

Depends on: 1639334

BugBot [:suhaib / :marco/ :calixte]

Comment 21

•

4 years ago

The severity field is not set for this bug.
:ckerschb, could you have a look please?

For more information, please visit auto_nag documentation.

Flags: needinfo?(ckerschb)

Christoph Kerschbaumer [:ckerschb]

Updated

•

4 years ago

Severity: -- → S3

Flags: needinfo?(ckerschb)

Comment hidden (Intermittent Failures Robot)

Julien Cristau [:jcristau]

Updated

•

4 years ago

status-firefox78: affected → disabled

Comment hidden (Intermittent Failures Robot)

Sebastian Streich [:sstreich]

Updated

•

4 years ago

Assignee: sstreich → nobody

Comment hidden (Intermittent Failures Robot)

Christoph Kerschbaumer [:ckerschb]

Comment 27

•

3 years ago

Cosmin, I think we can close this one, right?

Flags: needinfo?(csabou)

BugBot [:suhaib / :marco/ :calixte]

Updated

•

3 years ago

Keywords: regression

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Updated

•

3 years ago

Status: REOPENED → RESOLVED

Closed: 4 years ago → 3 years ago

Flags: needinfo?(csabou)

Resolution: --- → FIXED

Target Milestone: --- → mozilla78