1557035 - Perma tier2 testSessionOOMSave | failed to verify session JSON - org.mozilla.gecko.tests.SessionTest$AssertException: Assertion failed: principal in JSON matches session principal | got eyIzIjp7fX0=, expected SmIS26zLEdO3ZQBgsLbOywAAAAAAAAAAwAAAAAAAAEY=

Status: RESOLVED FIXED

(Firefox for Android Graveyard :: Testing, defect)

Description

[Treeherder Bug Filer]

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=250120241&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/E1znf_i0QPW-TQ98x9gmPA/runs/0/artifacts/public/logs/live_backing.log

---

task 2019-06-05T11:24:44.957Z] 11:24:44 INFO - TEST-START | testSessionOOMSave
[task 2019-06-05T11:25:17.100Z] 11:25:17 INFO - GECKO | EventExpecter: no longer listening for Content:PageShow
[task 2019-06-05T11:25:47.851Z] 11:25:47 INFO - GECKO | EventExpecter: no longer listening for Content:DOMContentLoaded
[task 2019-06-05T11:25:47.852Z] 11:25:47 INFO - GECKO | EventExpecter: no longer listening for Content:DOMTitleChanged

[task 2019-06-05T11:30:04.293Z] 11:30:04 INFO - TEST-PASS | testSessionOOMSave | URL in JSON matches session URL - about:home should equal about:home
[task 2019-06-05T11:30:04.293Z] 11:30:04 INFO - Buffered messages finished
[task 2019-06-05T11:30:04.294Z] 11:30:04 WARNING - TEST-UNEXPECTED-FAIL | testSessionOOMSave | failed to verify session JSON - org.mozilla.gecko.tests.SessionTest$AssertException: Assertion failed: principal in JSON matches session principal | got eyIzIjp7fX0=, expected SmIS26zLEdO3ZQBgsLbOywAAAAAAAAAAwAAAAAAAAEY=
[task 2019-06-05T11:30:04.294Z] 11:30:04 INFO - at org.mozilla.gecko.tests.SessionTest$NonFatalAsserter.ok(SessionTest.java:412)
[task 2019-06-05T11:30:04.295Z] 11:30:04 INFO - at org.mozilla.gecko.FennecMochitestAssert.is(FennecMochitestAssert.java:150)
[task 2019-06-05T11:30:04.295Z] 11:30:04 INFO - at org.mozilla.gecko.tests.SessionTest.verifySessionJSON(SessionTest.java:382)
[task 2019-06-05T11:30:04.295Z] 11:30:04 INFO - at org.mozilla.gecko.tests.SessionTest$VerifyJSONCondition.isSatisfied(SessionTest.java:317)
[task 2019-06-05T11:30:04.296Z] 11:30:04 INFO - at com.robotium.solo.Waiter.waitForCondition(Waiter.java:526)
[task 2019-06-05T11:30:04.296Z] 11:30:04 INFO - at com.robotium.solo.Solo.waitForCondition(Solo.java:711)
[task 2019-06-05T11:30:04.296Z] 11:30:04 INFO - at org.mozilla.gecko.tests.testSessionOOMSave.testSessionOOMSave(testSessionOOMSave.java:58)
[task 2019-06-05T11:30:04.296Z] 11:30:04 INFO - at java.lang.reflect.Method.invokeNative(Native Method)
[task 2019-06-05T11:30:04.297Z] 11:30:04 INFO - at java.lang.reflect.Method.invoke(Method.java:525)
[task 2019-06-05T11:30:04.297Z] 11:30:04 INFO - at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
[task 2019-06-05T11:30:04.297Z] 11:30:04 INFO - at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
[task 2019-06-05T11:30:04.297Z] 11:30:04 INFO - at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
[task 2019-06-05T11:30:04.298Z] 11:30:04 INFO - at org.mozilla.gecko.tests.BaseRobocopTest.runTest(BaseRobocopTest.java:188)
[task 2019-06-05T11:30:04.298Z] 11:30:04 INFO - at junit.framework.TestCase.runBare(TestCase.java:134)
[task 2019-06-05T11:30:04.298Z] 11:30:04 INFO - at junit.framework.TestResult$1.protect(TestResult.java:115)
[task 2019-06-05T11:30:04.298Z] 11:30:04 INFO - at junit.framework.TestResult.runProtected(TestResult.java:133)
[task 2019-06-05T11:30:04.298Z] 11:30:04 INFO - at junit.framework.TestResult.run(TestResult.java:118)
[task 2019-06-05T11:30:04.298Z] 11:30:04 INFO - at junit.framework.TestCase.run(TestCase.java:124)
[task 2019-06-05T11:30:04.299Z] 11:30:04 INFO - at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
[task 2019-06-05T11:30:04.300Z] 11:30:04 INFO - at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
[task 2019-06-05T11:30:04.300Z] 11:30:04 INFO - at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554)
[task 2019-06-05T11:30:04.300Z] 11:30:04 INFO - at org.mozilla.gecko.FennecInstrumentationTestRunner.onStart(FennecInstrumentationTestRunner.java:66)
[task 2019-06-05T11:30:04.300Z] 11:30:04 INFO - at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701)
[task 2019-06-05T11:30:04.300Z] 11:30:04 INFO - 0 ERROR Exception caught during test! - junit.framework.AssertionFailedError: TEST-UNEXPECTED-FAIL | testSessionOOMSave | failed to verify session JSON - org.mozilla.gecko.tests.SessionTest$AssertException: Assertion failed: principal in JSON matches session principal | got eyIzIjp7fX0=, expected SmIS26zLEdO3ZQBgsLbOywAAAAAAAAAAwAAAAAAAAEY=

Comment 1

[Geoff Brown [:gbrown]]

Once testSessionFilePreservation was disabled in bug 1556667, testSessionOOMSave started perma-failing with a very similar error message. Should we disable this one too, for now?

Comment 2

[Jonathan Kingston [:jkt] he/him]

Looks the same yeah, I haven't had issues myself with Nightly however I'm trying to verify with someone from the fennec team. The test appears almost identical though.

Comment 3

[Jonathan Kingston [:jkt] he/him]

Hey JanH, I'm not sure if you are around etc. I was told you might know more about where these tests get their session data from?
Thanks

Comment 4

[Geoff Brown [:gbrown]]

Attachment: Bug 1557035 - Skip perma-failing robocop testSessionOOMSave; r=jkt

Comment 5

[Jan Henning [:JanH]]

Hope this helps as a pointer: https://hg.mozilla.org/mozilla-central/annotate/155a7e2117e575ff6de6caa3dfe5b076cb455ae1/mobile/android/tests/browser/robocop/src/org/mozilla/gecko/tests/SessionTest.java#l70

Comment 6

[Jonathan Kingston [:jkt] he/him]

Attachment: Bug 1557035 - Changing android hardcoded system principal session to fix tests. r?janh

Comment 7

[Intermittent Failures Robot]

47 failures in 5197 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

This is the #42 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 47

Platform breakdown:

• android-em-4-3-armv7-api16: 47

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1557035&startday=2019-06-03&endday=2019-06-09&tree=all

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/12d4df6de36e
Changing android hardcoded system principal session to fix tests. r=JanH

Comment 9

[Raul Gurzau (:RaulG)]

https://hg.mozilla.org/mozilla-central/rev/12d4df6de36e

Comment 10

[Intermittent Failures Robot]

14 failures in 4753 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 11
• try: 3

Platform breakdown:

• android-em-4-3-armv7-api16: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1557035&startday=2019-06-10&endday=2019-06-16&tree=all