1487124 - Permafailing Android testing/marionette/harness/marionette_harness/tests/unit/test_screenshot.py TestScreenCaptureContent.test_capture_vertical_bounds | UnknownException: [Exception... "Failure" nsresult: "0x80004005 (NS_ERROR_FAILURE)"

Status: RESOLVED WONTFIX

(Remote Protocol :: Marionette, defect, P3)

Description

[Treeherder Bug Filer]

Filed by: toros [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=196448647&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/bK84YzvaRqubUkQL-yxO_Q/runs/0/artifacts/public/logs/live_backing.log

[task 2018-08-29T13:48:56.074Z] 13:48:56     INFO -  TEST-START | testing/marionette/harness/marionette_harness/tests/unit/test_screenshot.py TestScreenCaptureContent.test_capture_tab_already_closed
[task 2018-08-29T13:49:00.257Z] 13:49:00     INFO -  TEST-SKIP | testing/marionette/harness/marionette_harness/tests/unit/test_screenshot.py TestScreenCaptureContent.test_capture_tab_already_closed | took 4182ms
[task 2018-08-29T13:49:00.986Z] 13:49:00     INFO -  TEST-START | testing/marionette/harness/marionette_harness/tests/unit/test_screenshot.py TestScreenCaptureContent.test_capture_vertical_bounds
[task 2018-08-29T13:49:17.217Z] 13:49:17  WARNING -  TEST-UNEXPECTED-ERROR | testing/marionette/harness/marionette_harness/tests/unit/test_screenshot.py TestScreenCaptureContent.test_capture_vertical_bounds | UnknownException: [Exception... "Failure"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: chrome://marionette/content/capture.js :: capture.canvas :: line 156"  data: no]
[task 2018-08-29T13:49:17.217Z] 13:49:17     INFO -  stacktrace:
[task 2018-08-29T13:49:17.218Z] 13:49:17     INFO -  	capture.canvas@chrome://marionette/content/capture.js:156:3
[task 2018-08-29T13:49:17.218Z] 13:49:17     INFO -  	capture.element@chrome://marionette/content/capture.js:51:10
[task 2018-08-29T13:49:17.219Z] 13:49:17     INFO -  	takeScreenshot@chrome://marionette/content/listener.js:1547:14
[task 2018-08-29T13:49:17.219Z] 13:49:17     INFO -  	dispatch/</req<@chrome://marionette/content/listener.js:482:14
[task 2018-08-29T13:49:17.219Z] 13:49:17     INFO -  	dispatch/<@chrome://marionette/content/listener.js:477:15
[task 2018-08-29T13:49:17.220Z] 13:49:17     INFO -  Traceback (most recent call last):
[task 2018-08-29T13:49:17.220Z] 13:49:17     INFO -    File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_harness/marionette_test/testcases.py", line 159, in run
[task 2018-08-29T13:49:17.220Z] 13:49:17     INFO -      testMethod()
[task 2018-08-29T13:49:17.220Z] 13:49:17     INFO -    File "/builds/worker/workspace/build/tests/marionette/tests/testing/marionette/harness/marionette_harness/tests/unit/test_screenshot.py", line 299, in test_capture_vertical_bounds
[task 2018-08-29T13:49:17.221Z] 13:49:17     INFO -      screenshot = self.marionette.screenshot()
[task 2018-08-29T13:49:17.221Z] 13:49:17     INFO -    File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_driver/marionette.py", line 1938, in screenshot
[task 2018-08-29T13:49:17.221Z] 13:49:17     INFO -      body, key="value")
[task 2018-08-29T13:49:17.222Z] 13:49:17     INFO -    File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_driver/decorators.py", line 26, in _
[task 2018-08-29T13:49:17.223Z] 13:49:17     INFO -      return func(*args, **kwargs)
[task 2018-08-29T13:49:17.223Z] 13:49:17     INFO -    File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_driver/marionette.py", line 755, in _send_message
[task 2018-08-29T13:49:17.223Z] 13:49:17     INFO -      self._handle_error(err)
[task 2018-08-29T13:49:17.224Z] 13:49:17     INFO -    File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_driver/marionette.py", line 775, in _handle_error
[task 2018-08-29T13:49:17.224Z] 13:49:17     INFO -      raise errors.lookup(error)(message, stacktrace=stacktrace)
[task 2018-08-29T13:49:17.225Z] 13:49:17     INFO -  TEST-INFO took 16231ms

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+1]]

It's a new test as brought in via bug 1485730. Given that this only fails on Android we might want to just disable it on that platform for now. As it looks like the maximum allowed dimensions are way smaller due to lesser memory availability.

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Attachment: [marionette] Skip test_capture_vertical_bounds on Android

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/034adef609b9
[marionette] Skip test_capture_vertical_bounds on Android. r=whimboo

Comment 5

[Arthur Iakab [arthur_iakab]]

https://hg.mozilla.org/mozilla-central/rev/034adef609b9

Comment 6

[Intermittent Failures Robot]

27 failures in 537 pushes (0.05 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-central: 4
* autoland: 8
* mozilla-inbound: 15

Platform breakdown:
* android-em-4-3-armv7-api16: 27

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1487124&startday=2018-08-29&endday=2018-08-29&tree=all

Comment 7

[Eliza Balazs [:ebalazs_]]

Last failure log its from 29.08: https://treeherder.mozilla.org/logviewer.html#?job_id=196530582&repo=mozilla-central&lineNumber=1719

Comment 8

[Henrik Skupin [:whimboo][⌚️UTC+1]]

(In reply to Eliza Balazs [:ebalazs_] from comment #7)
> Last failure log its from 29.08:
> https://treeherder.mozilla.org/logviewer.html#?job_id=196530582&repo=mozilla-
> central&lineNumber=1719

Correct, as you can see above the test got skipped.

Comment 9

[Intermittent Failures Robot]

27 failures in 2545 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 4
* mozilla-inbound: 15
* autoland: 8

Platform breakdown:
* android-em-4-3-armv7-api16: 27

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1487124&startday=2018-08-27&endday=2018-09-02&tree=all

Comment 10

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Lets try to unskip once Mn jobs run on the faster Android 7.0 x86 platform.

Comment 11

[Intermittent Failures Robot]

3 failures in 2981 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 3

Platform breakdown:

• osx-10-10: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1487124&startday=2019-02-25&endday=2019-03-03&tree=all

Comment 12

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Interestingly this failed for deskop and not mobile where we usually have the 32768px working. Lets see how this goes over the next days.

Comment 13

[Henrik Skupin [:whimboo][⌚️UTC+1]]

This is still present with bug 1500509 fixed now.

Comment 14

[Intermittent Failures Robot]

1 failures in 4839 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1487124&startday=2019-08-12&endday=2019-08-18&tree=all

Comment 15

[Henrik Skupin [:whimboo][⌚️UTC+1]]

The failure here actually happened in ctx.drawWindow. The call to this API will go away with my work on bug 1559592. We should try to re-enable the test once this bug is fixed.

Comment 16

[Henrik Skupin [:whimboo][⌚️UTC+1]]

As discovered by tnikkel over on bug 1574935 this could also be very likely a OOM situation, and it fails way earlier because it's even less memory available as on a desktop 32-bit system.

Now with bug 1559592 the situation will become even worse given that two copies of this large screen capture have to be kept in memory. We will use bug 1574935 to discuss how to improve the situation.

Comment 17

[Henrik Skupin [:whimboo][⌚️UTC+1]]

This failure will most likely also affect GeckoView but we are not going to add support for that to marionette harness. As such this test won't run under this job anymore.