1504201 - Intermittent Linux Mn testing/marionette/harness/marionette_harness/tests/unit/test_screenshot.py TestScreenCaptureChrome.test_formats | AssertionError: u'10a9988c502034662c801565ca05b9c154b933824b2f88849cab0e3e2b492da2' != '92b10dd07e1767c396f6

Status: RESOLVED FIXED

(Testing :: Marionette Client and Harness, defect, P1)

Description

[Treeherder Bug Filer]

Filed by: ebalazs [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=209411710&repo=try

https://queue.taskcluster.net/v1/task/Ndn7c1ssSUSvu2oo0VFpTQ/runs/0/artifacts/public/logs/live_backing.log

This started on beta simulations, more frequent on late beta:
https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=e336ee10c816dddea2e5fb889718fce0ea33e1fe&selectedJob=209411710 
Failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=209411710&repo=try&lineNumber=29493

Failed to gather test failure debug: Browsing context has been discarded
[task 2018-11-02T12:11:42.976Z] 12:11:42  WARNING - stacktrace:
[task 2018-11-02T12:11:42.977Z] 12:11:42  WARNING - 	WebDriverError@chrome://marionette/content/error.js:179:5
[task 2018-11-02T12:11:42.977Z] 12:11:42  WARNING - 	NoSuchWindowError@chrome://marionette/content/error.js:411:5
[task 2018-11-02T12:11:42.978Z] 12:11:42  WARNING - 	assert.that/<@chrome://marionette/content/assert.js:401:13
[task 2018-11-02T12:11:42.979Z] 12:11:42  WARNING - 	assert.open@chrome://marionette/content/assert.js:157:10
[task 2018-11-02T12:11:42.981Z] 12:11:42  WARNING - 	GeckoDriver.prototype.getPageSource@chrome://marionette/content/driver.js:1146:15
[task 2018-11-02T12:11:42.982Z] 12:11:42  WARNING - 	despatch@chrome://marionette/content/server.js:291:20
[task 2018-11-02T12:11:42.983Z] 12:11:42  WARNING - 	execute@chrome://marionette/content/server.js:264:11
[task 2018-11-02T12:11:42.984Z] 12:11:42  WARNING - 	onPacket/<@chrome://marionette/content/server.js:237:15
[task 2018-11-02T12:11:42.985Z] 12:11:42  WARNING - 	onPacket@chrome://marionette/content/server.js:236:8
[task 2018-11-02T12:11:42.986Z] 12:11:42  WARNING - 	_onJSONObjectReady/<@chrome://marionette/content/transport.js:490:9
[task 2018-11-02T12:11:42.987Z] 12:11:42  WARNING - 
[task 2018-11-02T12:11:42.988Z] 12:11:42     INFO - TEST-UNEXPECTED-FAIL | testing/marionette/harness/marionette_harness/tests/unit/test_screenshot.py TestScreenCaptureChrome.test_formats | AssertionError: u'10a9988c502034662c801565ca05b9c154b933824b2f88849cab0e3e2b492da2' != '92b10dd07e1767c396f652d93a9720fd8b79b1c2e453b7b7eb2818e4f225cdef'
[task 2018-11-02T12:11:42.989Z] 12:11:42     INFO - Traceback (most recent call last):
[task 2018-11-02T12:11:42.990Z] 12:11:42     INFO -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_harness/marionette_test/testcases.py", line 159, in run
[task 2018-11-02T12:11:42.990Z] 12:11:42     INFO -     testMethod()
[task 2018-11-02T12:11:42.991Z] 12:11:42     INFO -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_harness/marionette_test/decorators.py", line 152, in skip_wrapper
[task 2018-11-02T12:11:42.992Z] 12:11:42     INFO -     return test_item(self, *args, **kwargs)
[task 2018-11-02T12:11:42.993Z] 12:11:42     INFO -   File "/builds/worker/workspace/build/tests/marionette/tests/testing/marionette/harness/marionette_harness/tests/unit/test_screenshot.py", line 224, in test_formats
[task 2018-11-02T12:11:42.993Z] 12:11:42     INFO -     self.assert_formats()
[task 2018-11-02T12:11:42.994Z] 12:11:42     INFO -   File "/builds/worker/workspace/build/tests/marionette/tests/testing/marionette/harness/marionette_harness/tests/unit/test_screenshot.py", line 93, in assert_formats
[task 2018-11-02T12:11:42.995Z] 12:11:42     INFO -     self.assertEqual(hash1, hashlib.sha256(screenshot_image).hexdigest())
[task 2018-11-02T12:11:42.996Z] 12:11:42     INFO - TEST-INFO took 243ms
[task 2018-11-02T12:11:42.997Z] 12:11:42     INFO -  1541160702963	Marionette	TRACE	132 -> [0,35,"WebDriver:GetChromeWindowHandles",{}]
[task 2018-11-02T12:11:42.998Z] 12:11:42     INFO -  1541160702964	Marionette	TRACE	132 <- [1,35,null,["3","339"]]
[task 2018-11-02T12:11:42.998Z] 12:11:42     INFO -  1541160702980	Marionette	TRACE	132 -> [0,36,"WebDriver:SwitchToWindow",{"focus":true,"name":"339"}]
[task 2018-11-02T12:11:43.000Z] 12:11:43     INFO -  1541160702982	Marionette	TRACE	132 <- [1,36,null,{"value":null}]
[task 2018-11-02T12:11:43.001Z] 12:11:43     INFO -  1541160702984	Marionette	TRACE	132 -> [0,37,"WebDriver:CloseChromeWindow",{}]
[task 2018-11-02T12:11:43.003Z] 12:11:43     INFO -  1541160702995	Marionette	DEBUG	Received observer notification message-manager-disconnect
[task 2018-11-02T12:11:43.004Z] 12:11:43     INFO -  1541160703000	Marionette	TRACE	132 <- [1,37,null,["3"]]
[task 2018-11-02T12:11:43.005Z] 12:11:43     INFO -  1541160703002	Marionette	TRACE	132 -> [0,38,"WebDriver:SwitchToWindow",{"focus":true,"name":"3"}]
[task 2018-11-02T12:11:43.006Z] 12:11:43     INFO -  1541160703003	Marionette	TRACE	132 <- [1,38,null,{"value":null}]
[task 2018-11-02T12:11:43.018Z] 12:11:43     INFO -  1541160703009	Marionette	TRACE	132 -> [0,39,"WebDriver:GetChromeWindowHandles",{}]
[task 2018-11-02T12:11:43.020Z] 12:11:43     INFO -  1541160703010	Marionette	TRACE	132 <- [1,39,null,["3"]]
[task 2018-11-02T12:11:43.021Z] 12:11:43     INFO -  1541160703011	Marionette	TRACE	132 -> [0,40,"WebDriver:GetWindowHandles",{}]
[task 2018-11-02T12:11:43.021Z] 12:11:43     INFO -  1541160703011	Marionette	TRACE	132 <- [1,40,null,["2147483911"]]
[task 2018-11-02T12:11:43.027Z] 12:11:43     INFO -  1541160703013	Marionette	TRACE	132 -> [0,41,"WebDriver:DeleteSession",{}]

Comment 1

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

This is for a beta simulation and all failures so far are on Linux opt platforms.

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Is that the first beta simulation? If not did it already fail before? I also see Linux64 opt failing.

Comment 3

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Did you mean "Linux64 debug"? Yes, had added some retriggers to that.

The issue didn't affect yesterday's simulations: https://treeherder.mozilla.org/#/jobs?repo=try&revision=7f1e42a7de915ec3547461676e7fabe9751d8431&searchStr=linux%2Cmarionette

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Do you have a list of commits for mozilla-central, which have been landed between those two beta simulations? That would help me a lot. Thanks.

Comment 5

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Pushlog: https://hg.mozilla.org/mozilla-central/pushloghtml?fromchange=3cff4bff1c9d&tochange=a6493a0b53a3

The mozilla-central revisions on which the beta simulations are based can be found in https://docs.google.com/document/d/1826JIk4zfT1fXt115Blvho635bjsGjR7KO0dVq3yBn8/edit# or by clicking at the bottom revision of a beta simulation and then on the parent revision.

Comment 6

[Intermittent Failures Robot]

36 failures in 2978 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* try: 36

Platform breakdown:
* linux32: 1
* linux64: 8
* linux64-nightly: 11
* linux64-devedition: 9
* linux32-devedition: 1
* linux32-nightly: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-10-29&endday=2018-11-04&tree=all

Comment 7

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Attachment: patch_no_truncation.diff

As discussed in our WebDriver meeting yesterday it is very hard for me to track down this failure because it only happens for beta simulations. Also by default we truncate the logs, and as such the screenshot data is not fully visible in the logs, which makes it impossible to diagnose what's wrong. 

Sebastian, mind adding the following patch to the next beta simulation? It will give us some more insight into the screenshots for the failing test file.

Comment 8

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

No difference in the test output with the patch applied: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=fd277cf69dfce5debec4102c24a580301dd8ef69&selectedJob=210288823

Comment 9

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Sure, I didn't expect a change in failures. But as I mentioned the logs are more verbose now which should allow us to see what's going on. So lets have a look...

Comment 10

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Attachment: screensho1.png

Comment 11

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Attachment: screenshot2.png

Comment 12

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Both attached screenshots should be identical, but in the first one the richlistitem hasn't been selected yet. Note that this entry has the attribute `selected="true"` set and should automatically be selected when the dialog is opened. Here the code:

https://searchfox.org/mozilla-central/source/testing/marionette/chrome/test_dialog.xul

Given that nothing changed on our side lately, I wonder if this might be a regression in Firefox caused by some XBL/XUL removal work?

Sebastian, could someone from SV may do a bisect for the integration branch merges by backfilling the merge commits from the pushlog in comment 5? I would kind appreciate this help. Thanks!

Comment 13

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Bisecting shows this starts after bug 1362774 landed.

Comment 14

[:Gijs (he/him)]

You should wait with comparing things until the window has been activated / received focus.

Comment 15

[Intermittent Failures Robot]

39 failures in 3007 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #35 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* try: 38
* mozilla-inbound: 1

Platform breakdown:
* linux64-devedition: 6
* linux32-nightly: 4
* linux64: 9
* linux64-nightly: 9
* linux32: 6
* linux32-devedition: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-11-05&endday=2018-11-11&tree=all

Comment 16

[Intermittent Failures Robot]

43 failures in 2917 pushes (0.015 failures/push) were associated with this bug in the last 7 days.

This is the #26 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* try: 43

Platform breakdown:
* linux64-nightly: 4
* macosx64-devedition: 1
* linux32-nightly: 4
* linux64: 10
* linux64-devedition: 8
* linux32: 6
* linux32-devedition: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-11-12&endday=2018-11-18&tree=all

Comment 17

[Intermittent Failures Robot]

35 failures in 2387 pushes (0.015 failures/push) were associated with this bug in the last 7 days.

This is the #38 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* try: 35

Platform breakdown:
* linux64: 10
* linux32: 4
* linux64-nightly: 4
* linux32-nightly: 7
* linux32-devedition: 7
* linux64-devedition: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-11-19&endday=2018-11-25&tree=all

Comment 18

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Comment on attachment 9022903 [details] [diff] [review]
patch_no_truncation.diff

Review of attachment 9022903 [details] [diff] [review]:
-----------------------------------------------------------------

I think it will be good to have this enabled by default for the screenshot tests, so that we can identify problems way easier and not have to request special pushes with this patch being applied.

Comment 19

[Henrik Skupin [:whimboo][⌚️UTC+1]]

(In reply to :Gijs (he/him) from comment #14)
> You should wait with comparing things until the window has been activated /
> received focus.

That's what I did with my patch on bug 1507803 and which landed on central on Nov 23rd. But there are still problems with beta sims as it looks like.

I will have a look again once the patch as attached got landed, and I can more easily investigate those failures.

Comment 20

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Also how is bug 1362774 related here, which is marked to be the reason of the regression? It sounds only to be related to initial browsers. But the test failing here is using a XUL window/dialog without any browsers attached:

https://searchfox.org/mozilla-central/source/testing/marionette/chrome/test_dialog.xul

Comment 21

[:Gijs (he/him)]

(In reply to Henrik Skupin (:whimboo) from comment #20)
> Also how is bug 1362774 related here, which is marked to be the reason of
> the regression?

I don't know the exact details, but you can refer to the discussion in bug 1492480.

> It sounds only to be related to initial browsers. But the
> test failing here is using a XUL window/dialog without any browsers attached:
> 
> https://searchfox.org/mozilla-central/source/testing/marionette/chrome/
> test_dialog.xul

But there's a main browser window open, and your test opens the dialog repeatedly. I bet focus is not returning to the original browser window between you closing 1 dialog and opening the next, and as a result the focus event happens once the new window is open, meaning it loses focus.

Comment 22

[:Gijs (he/him)]

(In reply to :Gijs (he/him) from comment #21)
> as a result the focus event happens once the new window is open, meaning it loses focus.

So, to be clear, what you expect is:

1) browser window focuses
2) open dialog
3) dialog gains focus
4) dialog closed
5) browser window focused
6) you open another dialog
7) next dialog gets focused.


Instead, (5) happens after (6) and you end up with an unfocused dialog.

This can be fixed by waiting for focus/activate on the parent browser window when closing the dialog.

Also note that https://searchfox.org/mozilla-central/source/testing/marionette/client/marionette_driver/marionette.py#1498 only sends a message and doesn't wait for that message to have been acted upon.

Comment 23

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/74b45418136b
"Intermittent Linux Mn testing/marionette/harness/marionette_harness/tests/unit/test_screenshot.py TestScreenCaptureChrome.test_formats | AssertionError: u'10a9988c502034662c801565ca05b9c154b933824b2f88849cab0e3e2b492da2' != '92b10dd07e1767c396f6" r=ato

Comment 24

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Thanks Gijs! I will have a look at it tomorrow. Now that it is not related to opening a new window, it looks like to be related to the `WebDriver:switchToWindow` command. So it might have to wait for bug 1335085.

Comment 25

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/74b45418136b

Comment 26

[Intermittent Failures Robot]

34 failures in 2808 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* try: 34

Platform breakdown:
* linux32: 7
* linux64-devedition: 5
* linux64: 6
* linux32-nightly: 4
* linux64-nightly: 6
* linux32-devedition: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-11-26&endday=2018-12-02&tree=all

Comment 27

[Intermittent Failures Robot]

17 failures in 206 pushes (0.083 failures/push) were associated with this bug yesterday.

Repository breakdown:
* try: 5
* mozilla-beta: 12

Platform breakdown:
* linux32-devedition: 4
* linux64-devedition: 2
* linux64-nightly: 3
* linux32-nightly: 4
* linux32: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-12-03&endday=2018-12-03&tree=all

Comment 28

[Intermittent Failures Robot]

58 failures in 1862 pushes (0.031 failures/push) were associated with this bug in the last 7 days.

This is the #13 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* try: 40
* mozilla-beta: 18

Platform breakdown:
* linux32-devedition: 12
* linux32: 8
* linux64-nightly: 7
* linux32-nightly: 8
* linux64: 14
* linux64-devedition: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-12-03&endday=2018-12-09&tree=all

Comment 29

[Intermittent Failures Robot]

17 failures in 315 pushes (0.054 failures/push) were associated with this bug yesterday.

Repository breakdown:
* try: 6
* mozilla-beta: 10
* autoland: 1

Platform breakdown:
* linux32-nightly: 2
* linux32-devedition: 4
* linux64-nightly: 1
* linux32: 2
* linux64: 5
* linux64-devedition: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-12-10&endday=2018-12-10&tree=all

Comment 30

[Intermittent Failures Robot]

17 failures in 454 pushes (0.037 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* try: 5
* mozilla-beta: 12

Platform breakdown:
* linux64-nightly: 3
* linux32: 2
* linux32-devedition: 3
* linux64-devedition: 3
* linux64: 3
* linux32-nightly: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-12-13&endday=2018-12-13&tree=all

Comment 31

[Intermittent Failures Robot]

62 failures in 2485 pushes (0.025 failures/push) were associated with this bug in the last 7 days.

This is the #16 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* try: 21
* autoland: 1
* mozilla-beta: 40

Platform breakdown:
* linux32: 8
* linux32-nightly: 9
* linux64-nightly: 10
* linux32-devedition: 14
* linux64-devedition: 7
* linux64: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-12-10&endday=2018-12-16&tree=all

Comment 32

[Intermittent Failures Robot]

24 failures in 441 pushes (0.054 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-beta: 16
* try: 8

Platform breakdown:
* linux64: 3
* linux32: 2
* linux32-devedition: 5
* linux64-devedition: 4
* linux64-nightly: 4
* linux32-nightly: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-12-20&endday=2018-12-20&tree=all

Comment 33

[Intermittent Failures Robot]

71 failures in 2648 pushes (0.027 failures/push) were associated with this bug in the last 7 days.

This is the #15 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-beta: 41
* try: 30

Platform breakdown:
* linux64-devedition: 11
* linux32-devedition: 12
* linux32: 10
* linux64: 12
* linux32-nightly: 14
* linux64-nightly: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-12-17&endday=2018-12-23&tree=all

Comment 34

[Intermittent Failures Robot]

54 failures in 1008 pushes (0.054 failures/push) were associated with this bug in the last 7 days.

This is the #7 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-beta: 12
* try: 42

Platform breakdown:
* linux64: 13
* linux32-devedition: 8
* linux32: 8
* linux64-nightly: 7
* linux32-nightly: 7
* linux64-devedition: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-12-24&endday=2018-12-30&tree=all

Comment 35

[Intermittent Failures Robot]

23 failures in 181 pushes (0.127 failures/push) were associated with this bug yesterday.

Repository breakdown:
* try: 9
* mozilla-beta: 14

Platform breakdown:
* linux64: 10
* linux32-nightly: 2
* linux64-devedition: 3
* linux64-nightly: 3
* linux32: 2
* linux32-devedition: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-12-31&endday=2018-12-31&tree=all

Comment 36

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Given that I will still need a bit to fix the underlying bugs, I propose that we just skip this test on both integration branches and beta for now.

I will make sure to have this fixed as soon as possible.

Comment 37

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Attachment: skip patch

Comment 38

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/75b067260e38
[marionette] Temporarily skip TestScreenCaptureChrome.test_formats on Linux. r=whimboo

Comment 39

[Bogdan Tara[:bogdan_tara | bogdant]]

https://hg.mozilla.org/mozilla-central/rev/75b067260e38

Comment 40

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Sebastian, when the next merge simulation works fine and this failure is gone, can we please uplift the skip patch to mozilla-beta?

Comment 41

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/releases/mozilla-beta/rev/0864e90347bf

Comment 42

[Intermittent Failures Robot]

56 failures in 1668 pushes (0.034 failures/push) were associated with this bug in the last 7 days.

This is the #13 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* try: 25
* mozilla-beta: 31

Platform breakdown:
* linux32-nightly: 12
* linux64: 16
* linux32: 5
* linux64-nightly: 8
* linux64-devedition: 8
* linux32-devedition: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504201&startday=2018-12-31&endday=2019-01-06&tree=all

Comment 43

[Henrik Skupin [:whimboo][⌚️UTC+1]]

We should try to re-enable this test now that bug 1335085 has been fixed.

Try: https://treeherder.mozilla.org/#/jobs?repo=try&revision=32c34ebd1d6e2a0f06e2bcd43fe706f02a494358

Comment 44

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Attachment: Bug 1504201 - [marionette] Re-enable test TestScreenCaptureChrome.test_formats. r=#webdriver

Comment 45

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/59b4cb737397
[marionette] Re-enable test TestScreenCaptureChrome.test_formats. r=webdriver-reviewers,ato

Comment 46

[Arthur Iakab [arthur_iakab]]

https://hg.mozilla.org/mozilla-central/rev/59b4cb737397

Comment 47

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Please uplift this test-only patch to beta. Thanks.

Comment 48

[Oana Pop-Rus]

https://hg.mozilla.org/releases/mozilla-beta/rev/b4a6eae77dce

Comment 49

[BMO Automation]

Moving bug to Testing::Marionette Client and Harness component per bug 1815831.