1710808 - Intermittent Android TEST-UNEXPECTED-CRASH | /html/cross-origin-opener-policy/<random> | expected OK

Status: RESOLVED INCOMPLETE

(Core :: DOM: Core & HTML, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=339475707&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/GZJP0Ws9Sh-YN4BIect0rw/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-05-12T08:44:43.191Z] 08:44:43     INFO - TEST-START | /html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https.html
[task 2021-05-12T08:44:43.200Z] 08:44:43     INFO - Closing window 330
[task 2021-05-12T08:47:53.206Z] 08:47:53     INFO - Browser not responding, setting status to CRASH
[task 2021-05-12T08:47:53.330Z] 08:47:53     INFO - TEST-UNEXPECTED-CRASH | /html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https.html | expected OK
[task 2021-05-12T08:47:53.331Z] 08:47:53     INFO - TEST-INFO took 190138ms
[task 2021-05-12T08:47:53.459Z] 08:47:53 CRITICAL - Test harness output was not a valid structured log message: 
[task 2021-05-12T08:47:53.459Z] 08:47:53 CRITICAL - Exception ignored in: <bound method Marionette.__del__ of <marionette_driver.marionette.Marionette object at 0x7fb7e3d1be80>>
[task 2021-05-12T08:47:53.459Z] 08:47:53 CRITICAL - Traceback (most recent call last):
[task 2021-05-12T08:47:53.460Z] 08:47:53 CRITICAL -   File "/builds/worker/workspace/build/venv/lib/python3.6/site-packages/marionette_driver/marionette.py", line 536, in __del__
[task 2021-05-12T08:47:53.460Z] 08:47:53 CRITICAL -     self.cleanup()
[task 2021-05-12T08:47:53.460Z] 08:47:53 CRITICAL -   File "/builds/worker/workspace/build/venv/lib/python3.6/site-packages/marionette_driver/marionette.py", line 521, in cleanup
[task 2021-05-12T08:47:53.460Z] 08:47:53 CRITICAL -     self.delete_session()
[task 2021-05-12T08:47:53.461Z] 08:47:53 CRITICAL -   File "/builds/worker/workspace/build/venv/lib/python3.6/site-packages/marionette_driver/marionette.py", line 1228, in delete_session
[task 2021-05-12T08:47:53.461Z] 08:47:53 CRITICAL -     self._send_message("WebDriver:DeleteSession")
[task 2021-05-12T08:47:53.462Z] 08:47:53 CRITICAL -   File "/builds/worker/workspace/build/venv/lib/python3.6/site-packages/marionette_driver/decorators.py", line 27, in _
[task 2021-05-12T08:47:53.462Z] 08:47:53 CRITICAL -     return func(*args, **kwargs)
[task 2021-05-12T08:47:53.462Z] 08:47:53 CRITICAL -   File "/builds/worker/workspace/build/venv/lib/python3.6/site-packages/marionette_driver/marionette.py", line 621, in _send_message
[task 2021-05-12T08:47:53.463Z] 08:47:53 CRITICAL -     msg = self.client.request(name, params)
[task 2021-05-12T08:47:53.463Z] 08:47:53 CRITICAL -   File "/builds/worker/workspace/build/venv/lib/python3.6/site-packages/marionette_driver/transport.py", line 292, in request
[task 2021-05-12T08:47:53.463Z] 08:47:53 CRITICAL -     return self.receive()
[task 2021-05-12T08:47:53.464Z] 08:47:53 CRITICAL -   File "/builds/worker/workspace/build/venv/lib/python3.6/site-packages/marionette_driver/transport.py", line 178, in receive
[task 2021-05-12T08:47:53.464Z] 08:47:53 CRITICAL -     if len(remaining) == int(length):
[task 2021-05-12T08:47:53.464Z] 08:47:53 CRITICAL - ValueError: invalid literal for int() with base 10: b'own","forced"'
[task 2021-05-12T08:47:53.702Z] 08:47:53     INFO - STDOUT: cleanup aborted: Unable to remount device
[task 2021-05-12T08:47:53.854Z] 08:47:53     INFO - Closing logging queue
[task 2021-05-12T08:47:53.854Z] 08:47:53     INFO - queue closed
[task 2021-05-12T08:47:53.856Z] 08:47:53     INFO - STDOUT: cleanup aborted: Unable to remount device
[task 2021-05-12T08:47:53.880Z] 08:47:53     INFO - Setting up ssl
[task 2021-05-12T08:47:53.901Z] 08:47:53     INFO - certutil | b''
[task 2021-05-12T08:47:53.924Z] 08:47:53     INFO - certutil | b''
[task 2021-05-12T08:47:53.939Z] 08:47:53     INFO - certutil | b'\nCertificate Nickname                                         Trust Attributes\n                                                             SSL,S/MIME,JAR/XPI\n\nweb-platform-tests                                           CT,, \n'
[task 2021-05-12T08:47:54.907Z] 08:47:54     INFO - adb Granting important runtime permissions to org.mozilla.geckoview.test
[task 2021-05-12T08:47:56.291Z] 08:47:56     INFO - adb launch_application: am start -W -n org.mozilla.geckoview.test/org.mozilla.geckoview.test.TestRunnerActivity -a android.intent.action.MAIN --es env0 MOZ_CRASHREPORTER=1 --es env1 MOZ_CRASHREPORTER_NO_REPORT=1 --es env2 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env3 MOZ_HIDE_RESULTS_TABLE=1 --es env4 MOZ_IN_AUTOMATION=1 --es env5 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --es env6 R_LOG_LEVEL=6 --es env7 R_LOG_DESTINATION=stderr --es env8 R_LOG_VERBOSE=1 --es env9 MOZ_PROCESS_LOG=/tmp/tmpdt2vnmckpidlog --es env10 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env11 STYLO_THREADS=1 --es env12 MOZ_WEBRENDER=0 --es arg0 -no-remote --es arg1 -profile --es arg2 /data/local/tmp/test_root/profile --es arg3 --marionette --es arg4 about:blank --ez use_multiprocess True
[task 2021-05-12T08:47:57.245Z] 08:47:57     INFO - Starting runner```

Comment 1

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

There are a bunch of Android web-platform-test crashes (at least the newer ones) in html/cross-origin-opener-policy/.

Jens, Christoph, are you aware of changes which would explain this?

Comment 7

[Intermittent Failures Robot]

23 failures in 3061 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 17
• mozilla-central: 6

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 9
  • debug: 9
• android-em-7-0-x86_64: 11
  • debug: 9
  • opt: 2
• android-em-7-0-x86_64-shippable: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1710808&startday=2021-05-17&endday=2021-05-23&tree=all

Comment 8

[Jens Stutte [:jstutte]]

In the ones I looked at I see:

[task 2021-05-26T13:59:26.558Z] 13:59:26     INFO - Closing window 1cc37f2c-2a69-42b6-a385-92815d52226e
[task 2021-05-26T14:02:36.561Z] 14:02:36     INFO - Browser not responding, setting status to CRASH

a timeout of 250 sec which might just indicate some slow execution ? Can we increase this timeout for Android to see if this changes something?
The random nature (it fails with many different tests) might indicate, that we see some sort of real hang, though, but just to be sure.

Comment 9

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

(In reply to Jens Stutte [:jstutte] from comment #8)

Can we increase this timeout for Android to see if this changes something?

Comment 10

[Intermittent Failures Robot]

20 failures in 2908 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 13
• mozilla-central: 7

Platform and build breakdown:

• android-em-7-0-x86_64: 11
  • debug: 7
  • opt: 4
• android-em-7-0-x86_64-qr: 8
  • debug: 6
  • opt: 2
• android-em-7-0-x86_64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1710808&startday=2021-05-24&endday=2021-05-30&tree=all

Comment 11

[Intermittent Failures Robot]

23 failures in 3065 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• autoland: 19

Platform and build breakdown:

• android-em-7-0-x86_64: 10
  • debug: 5
  • opt: 5
• android-em-7-0-x86_64-qr: 12
  • debug: 10
  • opt: 2
• android-em-7-0-x86_64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1710808&startday=2021-05-31&endday=2021-06-06&tree=all

Comment 12

[Intermittent Failures Robot]

20 failures in 3502 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 16
• mozilla-central: 4

Platform and build breakdown:

• android-em-7-0-x86_64: 6
  • opt: 4
  • debug: 2
• android-em-7-0-x86_64-qr: 13
  • debug: 12
  • opt: 1
• android-em-7-0-x86_64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1710808&startday=2021-06-07&endday=2021-06-13&tree=all

Comment 13

[Intermittent Failures Robot]

14 failures in 2888 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 12
• mozilla-central: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 9
  • opt: 5
  • debug: 4
• android-em-7-0-x86_64: 4
  • debug: 4
• android-em-7-0-x86_64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1710808&startday=2021-06-14&endday=2021-06-20&tree=all

Comment 14

[Intermittent Failures Robot]

23 failures in 3115 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 22
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 13
  • debug: 11
  • opt: 2
• android-em-7-0-x86_64: 10
  • opt: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1710808&startday=2021-06-21&endday=2021-06-27&tree=all

Comment 15

[Intermittent Failures Robot]

5 failures in 723 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 4
  • debug: 4
• android-em-7-0-x86_64: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1710808&startday=2021-06-28&endday=2021-07-04&tree=all

Comment 16

[Intermittent Failures Robot]

5 failures in 2387 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 4

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 1
  • opt: 1
• android-em-7-0-x86_64: 3
  • opt: 3
• android-em-7-0-x86_64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1710808&startday=2021-07-05&endday=2021-07-11&tree=all

Comment 17

[Intermittent Failures Robot]

1 failures in 2940 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-em-7-0-x86_64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1710808&startday=2021-07-19&endday=2021-07-25&tree=all

Comment 18

[James Graham [:jgraham]]

A lot of these tests have been marked as [OK, TIMEOUT] in the metadata, so although we don't see the problem anymore, I think the underlying issue hasn't been resolved. Although some of these are android-only a lot also seem to intermittently timeout on other platforms.

The tests seem to already have a long timeout, so although we can increase the timeout of the tests on a try build (e.g. by doing something like --timeout-multiplier=10 when constructing the wpt command line arguments), I don't think we should look at a longer timeout as a solution here; it's already using the highest timeout we have and it's not just debug builds that are failing. So if it's just execution time that's an issue we need to update the tests to do less per file. But I think we should actually investigate the failures because I think it's more likely to be a real hang.

Comment 19

[Jens Stutte [:jstutte]]

Hi Hsin-Yi, it would be indeed a good effort to slowly clarify the status of some of those tests. The upside is that in the last 7 months we had no more cases here. We could start with the tests from the bugs that have been duped here.

Comment 20

[Hsin-Yi Tsai (she/her) [:hsinyi]]

(In reply to Jens Stutte [:jstutte] from comment #19)

Hi Hsin-Yi, it would be indeed a good effort to slowly clarify the status of some of those tests. The upside is that in the last 7 months we had no more cases here. We could start with the tests from the bugs that have been duped here.

Thanks for bringing to my radar. Let me take it to team backlog discussion!

Comment 21

[Christoph Kerschbaumer [:ckerschb}]

(In reply to Hsin-Yi Tsai [:hsinyi] from comment #20)

Thanks for bringing to my radar. Let me take it to team backlog discussion!

It seems this is on the radar of the DOM: Core team.

Comment 22

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.