Closed Bug 1769742 Opened 2 years ago Closed 2 years ago

Intermittent org.mozilla.geckoview.test.GeckoSessionTestRuleTest#evaluateJS_canTimeout | java.lang.AssertionError: Expected exception: org.mozilla.geckoview.test.util.UiThreadUtils$TimeoutException

Categories

(GeckoView :: Sandboxing, defect, P5)

Unspecified
All

Tracking

(firefox-esr91 unaffected, firefox-esr102 wontfix, firefox100 unaffected, firefox101 unaffected, firefox102 wontfix, firefox103 wontfix, firefox104 wontfix, firefox105 fixed)

RESOLVED FIXED
105 Branch
Tracking Status
firefox-esr91 --- unaffected
firefox-esr102 --- wontfix
firefox100 --- unaffected
firefox101 --- unaffected
firefox102 --- wontfix
firefox103 --- wontfix
firefox104 --- wontfix
firefox105 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: m_kato)

References

(Regression)

Details

(Keywords: assertion, intermittent-failure, regression, Whiteboard: [retriggered][fission:android:m2][stockwell unknown])

Attachments

(2 files)

Filed by: nfay [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=378335858&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PS_nUxuqT6u4ovujoK7fUQ/runs/0/artifacts/public/logs/live_backing.log


[task 2022-05-17T11:45:04.841Z] 11:45:04     INFO -  TEST-START | org.mozilla.geckoview.test.GeckoSessionTestRuleTest#evaluateJS_canTimeout
[task 2022-05-17T11:45:05.098Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: numtests=916
[task 2022-05-17T11:45:05.098Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stream=
[task 2022-05-17T11:45:05.098Z] 11:45:05     INFO -  org.mozilla.geckoview.test | Error in evaluateJS_canTimeout(org.mozilla.geckoview.test.GeckoSessionTestRuleTest):
[task 2022-05-17T11:45:05.098Z] 11:45:05     INFO -  org.mozilla.geckoview.test | java.lang.AssertionError: Expected exception: org.mozilla.geckoview.test.util.UiThreadUtils$TimeoutException
[task 2022-05-17T11:45:05.098Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at org.junit.internal.runners.statements.ExpectException.evaluate(ExpectException.java:32)
[task 2022-05-17T11:45:05.099Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.Verifier$1.evaluate(Verifier.java:35)
[task 2022-05-17T11:45:05.099Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2.lambda$evaluate$0$org-mozilla-geckoview-test-rule-GeckoSessionTestRule$2(GeckoSessionTestRule.java:1460)
[task 2022-05-17T11:45:05.099Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2$$ExternalSyntheticLambda0.run(Unknown Source)
[task 2022-05-17T11:45:05.099Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:428)
[task 2022-05-17T11:45:05.099Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at java.util.concurrent.FutureTask.run(FutureTask.java:237)
[task 2022-05-17T11:45:05.099Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:1950)
[task 2022-05-17T11:45:05.099Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.handleCallback(Handler.java:751)
[task 2022-05-17T11:45:05.099Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.dispatchMessage(Handler.java:95)
[task 2022-05-17T11:45:05.100Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at android.os.Looper.loop(Looper.java:154)
[task 2022-05-17T11:45:05.100Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at android.app.ActivityThread.main(ActivityThread.java:6077)
[task 2022-05-17T11:45:05.100Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2022-05-17T11:45:05.100Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2022-05-17T11:45:05.100Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2022-05-17T11:45:05.100Z] 11:45:05     INFO -  org.mozilla.geckoview.test |
[task 2022-05-17T11:45:05.100Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
[task 2022-05-17T11:45:05.100Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: test=evaluateJS_canTimeout
[task 2022-05-17T11:45:05.100Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: class=org.mozilla.geckoview.test.GeckoSessionTestRuleTest
[task 2022-05-17T11:45:05.100Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stack=java.lang.AssertionError: Expected exception: org.mozilla.geckoview.test.util.UiThreadUtils$TimeoutException
[task 2022-05-17T11:45:05.101Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at org.junit.internal.runners.statements.ExpectException.evaluate(ExpectException.java:32)
[task 2022-05-17T11:45:05.101Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at org.junit.rules.Verifier$1.evaluate(Verifier.java:35)
[task 2022-05-17T11:45:05.101Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2.lambda$evaluate$0$org-mozilla-geckoview-test-rule-GeckoSessionTestRule$2(GeckoSessionTestRule.java:1460)
[task 2022-05-17T11:45:05.101Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2$$ExternalSyntheticLambda0.run(Unknown Source)
[task 2022-05-17T11:45:05.101Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:428)
[task 2022-05-17T11:45:05.101Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at java.util.concurrent.FutureTask.run(FutureTask.java:237)
[task 2022-05-17T11:45:05.102Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:1950)
[task 2022-05-17T11:45:05.102Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.handleCallback(Handler.java:751)
[task 2022-05-17T11:45:05.102Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at android.os.Handler.dispatchMessage(Handler.java:95)
[task 2022-05-17T11:45:05.102Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at android.os.Looper.loop(Looper.java:154)
[task 2022-05-17T11:45:05.102Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at android.app.ActivityThread.main(ActivityThread.java:6077)
[task 2022-05-17T11:45:05.102Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at java.lang.reflect.Method.invoke(Native Method)
[task 2022-05-17T11:45:05.102Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2022-05-17T11:45:05.102Z] 11:45:05     INFO -  org.mozilla.geckoview.test | 	at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2022-05-17T11:45:05.102Z] 11:45:05     INFO -  org.mozilla.geckoview.test |
[task 2022-05-17T11:45:05.103Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: current=241
[task 2022-05-17T11:45:05.103Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS_CODE: -2
[task 2022-05-17T11:45:05.103Z] 11:45:05     INFO -  Printing logcat for test:
[task 2022-05-17T11:45:05.163Z] 11:45:05     INFO -  05-17 11:45:04.026 E/GeckoSessionTestRule( 3415): test_start 1f0befec-3ff2-40ff-89cf-b127eb38b1ec evaluateJS_canTimeout(org.mozilla.geckoview.test.GeckoSessionTestRuleTest)
[task 2022-05-17T11:45:05.163Z] 11:45:05     INFO -  05-17 11:45:04.026 E/GeckoSessionTestRule( 3415): before prepareStatement evaluateJS_canTimeout(org.mozilla.geckoview.test.GeckoSessionTestRuleTest)
[task 2022-05-17T11:45:05.163Z] 11:45:05     INFO -  05-17 11:45:04.027 D/GeckoViewStartup( 3415): onEvent GeckoView:StorageDelegate:Attached
[task 2022-05-17T11:45:05.163Z] 11:45:05     INFO -  05-17 11:45:04.027 I/Gecko   ( 3415): nsWindow[0x7bb4918f2a00]::Create 0x0 [0 0 1 1]
<...>
[task 2022-05-17T11:45:05.166Z] 11:45:05     INFO -  05-17 11:45:04.276 E/GeckoSessionTestRule( 3415): 	at java.lang.reflect.Method.invoke(Native Method)
[task 2022-05-17T11:45:05.166Z] 11:45:05     INFO -  05-17 11:45:04.276 E/GeckoSessionTestRule( 3415): 	at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2022-05-17T11:45:05.166Z] 11:45:05     INFO -  05-17 11:45:04.276 E/GeckoSessionTestRule( 3415): 	at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2022-05-17T11:45:05.166Z] 11:45:05     INFO -  05-17 11:45:04.277 D/GeckoViewContent( 3415): handleEvent: DOMWindowClose
[task 2022-05-17T11:45:05.166Z] 11:45:05     INFO -  05-17 11:45:04.278 D/GeckoViewConsole( 3415): onEvent GeckoView:WebExtension:List null
[task 2022-05-17T11:45:05.166Z] 11:45:05     INFO -  05-17 11:45:04.281 I/Gecko   ( 3415): nsWindow[0x7bb4918f2a00]::Show 0
[task 2022-05-17T11:45:05.166Z] 11:45:05     INFO -  05-17 11:45:04.281 E/GeckoSessionTestRule( 3415): test_end c5ee677f-bc83-49bd-9e28-2d35f3d0f059 evaluateJS_canTimeout(org.mozilla.geckoview.test.GeckoSessionTestRuleTest)
[task 2022-05-17T11:45:05.167Z] 11:45:05  WARNING -  TEST-UNEXPECTED-FAIL | org.mozilla.geckoview.test.GeckoSessionTestRuleTest#evaluateJS_canTimeout | java.lang.AssertionError: Expected exception: org.mozilla.geckoview.test.util.UiThreadUtils$TimeoutException
[task 2022-05-17T11:45:05.167Z] 11:45:05     INFO -  TEST-INFO took 310ms
[task 2022-05-17T11:45:05.167Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: numtests=916
[task 2022-05-17T11:45:05.167Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stream=
[task 2022-05-17T11:45:05.167Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
[task 2022-05-17T11:45:05.167Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: test=waitUntilCalled_throwOnNotGeckoSessionInterface
[task 2022-05-17T11:45:05.167Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: class=org.mozilla.geckoview.test.GeckoSessionTestRuleTest
[task 2022-05-17T11:45:05.167Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: current=242
[task 2022-05-17T11:45:05.167Z] 11:45:05     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS_CODE: 1
[task 2022-05-17T11:45:05.167Z] 11:45:05     INFO -  TEST-START | org.mozilla.geckoview.test.GeckoSessionTestRuleTest#waitUntilCalled_throwOnNotGeckoSessionInterface
Flags: needinfo?(m_kato)
Regressed by: 1758800

Set release status flags based on info from the regressing bug 1758800

I think this is bug 1756049 rather than bug 1758800. Bug 1758800 doesn't change for window.alert() prompt.

Flags: needinfo?(m_kato)
Has Regression Range: --- → yes

Set release status flags based on info from the regressing bug 1758800

There have been 32 total failures in the last 7 days, recent failure log.
Affected platforms are:

  • android-em-7-0-x86_64-lite-qr
  • android-em-7-0-x86_64-qr
  • android-em-7-0-x86_64-shippable-lite-qr
  • android-em-7-0-x86_64-shippable-qr
[task 2022-06-25T09:16:28.907Z] 09:16:28     INFO -  TEST-START | org.mozilla.geckoview.test.GeckoSessionTestRuleTest#evaluateJS_canTimeout
[task 2022-06-25T09:16:28.995Z] 09:16:28     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: numtests=928
[task 2022-06-25T09:16:28.995Z] 09:16:28     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: stream=
[task 2022-06-25T09:16:28.996Z] 09:16:28     INFO -  org.mozilla.geckoview.test | Error in evaluateJS_canTimeout(org.mozilla.geckoview.test.GeckoSessionTestRuleTest):
[task 2022-06-25T09:16:28.996Z] 09:16:28     INFO -  org.mozilla.geckoview.test | java.lang.AssertionError: Expected exception: org.mozilla.geckoview.test.util.UiThreadUtils$TimeoutException
...
[task 2022-06-25T09:16:29.074Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): Error
[task 2022-06-25T09:16:29.074Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): java.lang.AssertionError: Expected exception: org.mozilla.geckoview.test.util.UiThreadUtils$TimeoutException
[task 2022-06-25T09:16:29.074Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): 	at org.junit.internal.runners.statements.ExpectException.evaluate(ExpectException.java:32)
[task 2022-06-25T09:16:29.074Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): 	at org.junit.rules.Verifier$1.evaluate(Verifier.java:35)
[task 2022-06-25T09:16:29.074Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2.lambda$evaluate$0$org-mozilla-geckoview-test-rule-GeckoSessionTestRule$2(GeckoSessionTestRule.java:1460)
[task 2022-06-25T09:16:29.075Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): 	at org.mozilla.geckoview.test.rule.GeckoSessionTestRule$2$$ExternalSyntheticLambda0.run(Unknown Source)
[task 2022-06-25T09:16:29.075Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:428)
[task 2022-06-25T09:16:29.075Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): 	at java.util.concurrent.FutureTask.run(FutureTask.java:237)
[task 2022-06-25T09:16:29.075Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): 	at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:1950)
[task 2022-06-25T09:16:29.075Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): 	at android.os.Handler.handleCallback(Handler.java:751)
[task 2022-06-25T09:16:29.076Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): 	at android.os.Handler.dispatchMessage(Handler.java:95)
[task 2022-06-25T09:16:29.076Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): 	at android.os.Looper.loop(Looper.java:154)
[task 2022-06-25T09:16:29.076Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): 	at android.app.ActivityThread.main(ActivityThread.java:6077)
[task 2022-06-25T09:16:29.076Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): 	at java.lang.reflect.Method.invoke(Native Method)
[task 2022-06-25T09:16:29.076Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): 	at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:866)
[task 2022-06-25T09:16:29.077Z] 09:16:29     INFO -  06-25 09:16:28.083 E/GeckoSessionTestRule( 3348): 	at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:756)
[task 2022-06-25T09:16:29.077Z] 09:16:29     INFO -  06-25 09:16:28.084 D/GeckoViewContent( 3348): handleEvent: DOMWindowClose
[task 2022-06-25T09:16:29.077Z] 09:16:29     INFO -  06-25 09:16:28.084 D/GeckoViewConsole( 3348): onEvent GeckoView:WebExtension:List null
[task 2022-06-25T09:16:29.077Z] 09:16:29     INFO -  06-25 09:16:28.085 E/GeckoSessionTestRule( 3348): test_end c5ee677f-bc83-49bd-9e28-2d35f3d0f059 evaluateJS_canTimeout(org.mozilla.geckoview.test.GeckoSessionTestRuleTest)
[task 2022-06-25T09:16:29.077Z] 09:16:29  WARNING -  TEST-UNEXPECTED-FAIL | org.mozilla.geckoview.test.GeckoSessionTestRuleTest#evaluateJS_canTimeout | java.lang.AssertionError: Expected exception: org.mozilla.geckoview.test.util.UiThreadUtils$TimeoutException
[task 2022-06-25T09:16:29.077Z] 09:16:29     INFO -  TEST-INFO took 151ms
Flags: needinfo?(amoya)
Whiteboard: [retriggered] → [retriggered][stockwell needswork:owner]

If this is a regression from Fission bug 1756049, we should fix this test soon.

Flags: needinfo?(amoya)
Regressed by: 1756049
No longer regressed by: 1758800
Whiteboard: [retriggered][stockwell unknown] → [retriggered][stockwell unknown] [fission:android:m2]

Set release status flags based on info from the regressing bug 1756049

:agi, since you are the author of the regressor, bug 1756049, could you take a look?
For more information, please visit auto_nag documentation.

Flags: needinfo?(agi)

Moving Android Fission bugs to the new GeckoView::Sandboxing component.

Component: General → Sandboxing

(In reply to Release mgmt bot [:suhaib / :marco/ :calixte] from comment #15)

:agi, since you are the author of the regressor, bug 1756049, could you take a look?

Agi no longer works at Mozilla, so I'm clearing the needinfo. This regression is an intermittent test failure, so it's not urgent. The GeckoView team will investigate this test failure as part of the Android Fission project.

Flags: needinfo?(agi)
Whiteboard: [retriggered][stockwell unknown] [fission:android:m2] → [retriggered][stockwell needswork:owner] [fission:android:m2]

Hmm, I guess that alert prompt seems to be closed by finalize unexpectedly.

When looking failure log, Error while prompting entry is found.

[task 2022-07-23T21:43:18.978Z] 21:43:18     INFO -  07-23 21:43:17.382 D/Prompts ( 3438): handleEvent alert
[task 2022-07-23T21:43:18.978Z] 21:43:18     INFO -  07-23 21:43:17.427 D/ServiceAllocator( 3438): org.mozilla.gecko.process.GeckoChildProcessServices$tab29 updateBindings: IDLE priority, 6 importance, 0 successful binds, 0 failed binds, 2 successful unbinds
[task 2022-07-23T21:43:18.978Z] 21:43:18     INFO -  07-23 21:43:18.133 W/GeckoViewPrompter(12865): Error while prompting: undefined

When this failure occurs, before GeckoView junit test catches Java exceptions, prompt is closed by nsIAndroidEventFinalizer via content's unload. So this is a timing issue.

I think that we shouldn't use alert() content script for evaluateJS_canTimeout. I am looking another way.

Assignee: nobody → m_kato

Actually, evaluateJS_canTimeout test uses alert() to time out.

But when this test is failure, alert prompt is closed by calling reject
callback during timed out. Then, gv-junit cannot detect TimeoutException.
Since this reject callback is called by nsIAndroidEventFinalizer, I think
that using alert isn't good for evaluateJS_canTimeout.

So I would like to use other way instead of something prompt.

Pushed by m_kato@ga2.so-net.ne.jp:
https://hg.mozilla.org/integration/autoland/rev/db7b2e9c6d7a
evaluateJS_canTimeout shouldn't use alert(). r=geckoview-reviewers,calu
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Target Milestone: --- → 105 Branch

This is still happening on autoland: https://treeherder.mozilla.org/logviewer?job_id=385577571&repo=autoland
Can you please take a look?

Status: RESOLVED → REOPENED
Flags: needinfo?(m_kato)
Resolution: FIXED → ---
Target Milestone: 105 Branch → ---

(In reply to Cristian Tuns from comment #27)

This is still happening on autoland: https://treeherder.mozilla.org/logviewer?job_id=385577571&repo=autoland
Can you please take a look?

Original issue is fixed by my landing. But new failure is another reason. I think that this is test frame work issue, not this test.

[task 2022-07-27T13:50:19.609Z] 13:50:19     INFO -  org.mozilla.geckoview.test | Error in evaluateJS_canTimeout(org.mozilla.geckoview.test.GeckoSessionTestRuleTest):
...
[task 2022-07-27T13:50:19.612Z] 13:50:19     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS: class=org.mozilla.geckoview.test.GeckoSessionTestRuleTest

We got right exception, but INSTRUMENTATION_STATUS_CODE is -2 (failed)

[task 2022-07-27T13:50:19.614Z] 13:50:19     INFO -  org.mozilla.geckoview.test | INSTRUMENTATION_STATUS_CODE: -2

Also, android log has the following.

[task 2022-07-27T13:50:19.675Z] 13:50:19     INFO -  07-27 13:50:19.509 E/GeckoSessionTestRule( 3448): test_end c5ee677f-bc83-49bd-9e28-2d35f3d0f059 evaluateJS_canTimeout(org.mozilla.geckoview.test.GeckoSessionTestRuleTest)
[task 2022-07-27T13:50:19.675Z] 13:50:19  WARNING -  TEST-UNEXPECTED-FAIL | org.mozilla.geckoview.test.GeckoSessionTestRuleTest#evaluateJS_canTimeout | org.mozilla.geckoview.test.util.UiThreadUtils$TimeoutException: Timed out after 1000ms

So altough we get TimeoutException, why is INSTRUMENTATION_STATUS_CODE incorrect?

Flags: needinfo?(m_kato)

Set release status flags based on info from the regressing bug 1756049

Hmm, I cannot reproduce this on my environment. (I could reproduce previous failures on my env)

This exception (new failure) occurs in clean up of junit test. Although evaluateJS_canTimeout sets small timeout value, cleanupExtensions affects this setting. When If cleanupExtensions spends more time, this may occurs...

Actually, default timeout of geckoview junit is 3000ms, but we can change it
by @TimeoutMillis.

When changing timeout value, the timeout of clean up function such as
cleanupExtensions is also changed. So if @TimeoutMillis is small, cleanup
may be failed due to timeout.

So we shouldn't apply @TimeoutMillis on clean up. I guess bug 1606702 and bug
1607631 are same root cause too.

Pushed by m_kato@ga2.so-net.ne.jp:
https://hg.mozilla.org/integration/autoland/rev/20d44319acb2
Don't affect TimeoutMillis annotation to test clean up. r=geckoview-reviewers,calu
Status: REOPENED → RESOLVED
Closed: 2 years ago2 years ago
Resolution: --- → FIXED
Target Milestone: --- → 105 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: