1583315 - Intermittent browser/components/shell/test/test_headless_screenshot.html | Firefox process should exit with code 0 - got 1, expected +0

Status: RESOLVED INCOMPLETE

(Firefox :: Headless, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: csabou [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=268001292&repo=mozilla-beta
Full log: https://queue.taskcluster.net/v1/task/JkNo9EefTlWl1O8LXwI9tQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2019-09-23T17:30:07.331Z] 17:30:07 INFO - TEST-PASS | browser/components/shell/test/test_headless_screenshot.html | Screenshot should not be an empty file
[task 2019-09-23T17:30:07.331Z] 17:30:07 INFO - Buffered messages finished
[task 2019-09-23T17:30:07.332Z] 17:30:07 INFO - TEST-UNEXPECTED-FAIL | browser/components/shell/test/test_headless_screenshot.html | Firefox process should exit with code 0 - got 1, expected +0
[task 2019-09-23T17:30:07.332Z] 17:30:07 INFO - SimpleTest.is@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:322:16
[task 2019-09-23T17:30:07.332Z] 17:30:07 INFO - runFirefox@chrome://mochitests/content/chrome/browser/components/shell/test/test_headless_screenshot.html:47:7
[task 2019-09-23T17:30:07.332Z] 17:30:07 INFO - TEST-PASS | browser/components/shell/test/test_headless_screenshot.html | A screenshot should be saved as screenshot.png

Comment 1

[Intermittent Failures Robot]

1 failures in 4530 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform breakdown:

• windows10-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2019-09-23&endday=2019-09-29&tree=all

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 3

[Daniel Varga [:dvarga]]

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=287012198&repo=mozilla-beta&lineNumber=1223

Comment 4

[Intermittent Failures Robot]

1 failures in 2190 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform breakdown:

• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-01-27&endday=2020-02-02&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 4690 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-02-10&endday=2020-02-16&tree=all

Comment 6

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 7

[Natalia Csoregi [:nataliaCs]]

https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=297371396&repo=autoland&lineNumber=1402

Comment 8

[Intermittent Failures Robot]

2 failures in 4528 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• windows10-64-shippable: 1
• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-04-13&endday=2020-04-19&tree=all

Comment 9

[Intermittent Failures Robot]

3 failures in 5582 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• macosx1014-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-04-20&endday=2020-04-26&tree=all

Comment 10

[Intermittent Failures Robot]

4 failures in 5488 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform breakdown:

• windows10-64: 1
• windows7-32: 2
• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-05-11&endday=2020-05-17&tree=all

Comment 11

[Intermittent Failures Robot]

1 failures in 5458 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-05-25&endday=2020-05-31&tree=all

Comment 12

[Intermittent Failures Robot]

3 failures in 4949 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• windows7-32: 1
• macosx1014-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-06-01&endday=2020-06-07&tree=all

Comment 13

[Intermittent Failures Robot]

15 failures in 979 pushes (0.015 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• mozilla-central: 2

Platform breakdown:

• windows7-32: 14
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-06-12&endday=2020-06-12&tree=all

Comment 14

[Atila Butkovits]

There were 44 failures in the last 7 days on
-windows7-32 debug
-windows10-64 debug

Recent failure log:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=306267229&repo=autoland&lineNumber=2429

[task 2020-06-14T00:58:10.170Z] 00:58:10 INFO - TEST-PASS | browser/components/shell/test/test_headless_screenshot.html | Firefox process should exit with code 0
[task 2020-06-14T00:58:10.170Z] 00:58:10 INFO - TEST-PASS | browser/components/shell/test/test_headless_screenshot.html | A screenshot should be saved in the tmp directory
[task 2020-06-14T00:58:10.170Z] 00:58:10 INFO - TEST-PASS | browser/components/shell/test/test_headless_screenshot.html | Screenshot should be 1234 pixels wide
[task 2020-06-14T00:58:10.171Z] 00:58:10 INFO - Buffered messages logged at 00:57:52
[task 2020-06-14T00:58:10.171Z] 00:58:10 INFO - TEST-PASS | browser/components/shell/test/test_headless_screenshot.html | Firefox process should exit with code 0
[task 2020-06-14T00:58:10.171Z] 00:58:10 INFO - TEST-PASS | browser/components/shell/test/test_headless_screenshot.html | A screenshot should not be saved
[task 2020-06-14T00:58:10.172Z] 00:58:10 INFO - Buffered messages finished
[task 2020-06-14T00:58:10.172Z] 00:58:10 INFO - TEST-UNEXPECTED-FAIL | browser/components/shell/test/test_headless_screenshot.html | Firefox process should exit with code 0 - got 1, expected +0

Brendan, could you take a look?

Comment 15

[Cristina Coroiu [:ccoroiu]]

Started retriggers:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=Windows%2C7%2Cdebug%2CMochitests%2Cwithout%2Ce10s%2Ctest-windows7-32%2Fdebug-mochitest-chrome-1proc-2%2CM-1proc%28c2%29&tochange=12624e4520a150f2bc597f361efd94f64365a8df&fromchange=3d1e9c77a42dec977bd7a22e2668af56b2587145&selectedTaskRun=N0BxNy9aTsCVYmBVC7DVmQ.0

Up to:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=Windows%2C7%2Cdebug%2CMochitests%2Cwithout%2Ce10s%2Ctest-windows7-32%2Fdebug-mochitest-chrome-1proc-2%2CM-1proc%28c2%29&tochange=8a4360db7cbe3808d6466a5ad7807cb95ca47eb3&fromchange=8a1c8747a43bcff68aea85eaf83baab854382f1d&selectedTaskRun=GiZtkFNNS8-lRA1k2Wl0VQ.0

Comment 16

[Razvan Maries]

Based on https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=Windows%2C7%2Cdebug%2CMochitests%2Cwithout%2Ce10s%2Ctest-windows7-32%2Fdebug-mochitest-chrome-1proc-1%2CM-1proc%28c1%29&tochange=f8a46fbea1f665dc8a76ec4ad6d1dbd3d8c82b7f&fromchange=cee3a0f1d1c8dfb08f05504d3beed3011183be67&selectedTaskRun=ZHeAwXR_RQi02whsaTmDXg.0 I think bug 1642236 is the culprit.

Jonathan, could you take a look?

Comment 17

[Intermittent Failures Robot]

49 failures in 5211 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

This is the #31 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 43
• try: 2
• mozilla-central: 4

Platform breakdown:

• windows7-32: 38
• windows10-64: 10
• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-06-08&endday=2020-06-14&tree=all

Comment 18

[Intermittent Failures Robot]

42 failures in 4035 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #36 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 33
• mozilla-central: 6
• try: 3

Platform breakdown:

• windows7-32: 42

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-06-15&endday=2020-06-21&tree=all

Comment 19

[Brendan Dahl [:bdahl]]

Nothing has changed in the headless code that I know about. I'll leave this for jwatt.

Comment 20

[Intermittent Failures Robot]

52 failures in 5252 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #29 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 46
• mozilla-central: 6

Platform breakdown:

• windows7-32: 46
• windows10-64-shippable: 2
• windows10-64: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-06-22&endday=2020-06-28&tree=all

Comment 21

[Dorel Luca [:dluca]]

This bug failed 52 times in the last 7 days. Occurs on macosx1014-64, windows10-64, windows10-64-shippable and windows7-32 on debug and opt build types.

Recent log:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=308536933&repo=mozilla-central&lineNumber=2681

Comment 22

[Intermittent Failures Robot]

50 failures in 4516 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #27 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 38
• try: 3
• mozilla-central: 9

Platform breakdown:

• windows7-32: 47
• windows10-64: 2
• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-06-29&endday=2020-07-05&tree=all

Comment 23

[Intermittent Failures Robot]

29 failures in 1037 pushes (0.028 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• try: 3
• autoland: 24
• mozilla-central: 2

Platform breakdown:

• windows7-32: 29

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-07-08&endday=2020-07-08&tree=all

Comment 24

[Intermittent Failures Robot]

21 failures in 993 pushes (0.021 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 18
• mozilla-central: 3

Platform breakdown:

• windows7-32: 21

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-07-09&endday=2020-07-09&tree=all

Comment 25

[Intermittent Failures Robot]

22 failures in 1064 pushes (0.021 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 20
• mozilla-central: 2

Platform breakdown:

• windows7-32: 18
• windows10-64: 2
• windows10-64-shippable: 1
• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-07-10&endday=2020-07-10&tree=all

Comment 26

[Atila Butkovits]

There are 103 failures in the past week on windows7-32, windows10-64-shippable, macosx1014-64 and windows10-64 on opt and debug builds.

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=309421319&repo=autoland&lineNumber=1703

Comment 27

[Intermittent Failures Robot]

114 failures in 5265 pushes (0.022 failures/push) were associated with this bug in the last 7 days.

This is the #7 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 96
• try: 4
• mozilla-central: 14

Platform breakdown:

• windows7-32: 105
• windows10-64: 6
• windows10-64-shippable: 1
• macosx1014-64: 1
• windows7-32-mingwclang: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-07-06&endday=2020-07-12&tree=all

Comment 28

[Jonathan Watt [:jwatt]]

(In reply to Razvan Maries from comment #16)

Based on https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=Windows%2C7%2Cdebug%2CMochitests%2Cwithout%2Ce10s%2Ctest-windows7-32%2Fdebug-mochitest-chrome-1proc-1%2CM-1proc%28c1%29&tochange=f8a46fbea1f665dc8a76ec4ad6d1dbd3d8c82b7f&fromchange=cee3a0f1d1c8dfb08f05504d3beed3011183be67&selectedTaskRun=ZHeAwXR_RQi02whsaTmDXg.0 I think bug 1642236 is the culprit.

As best I can tell, the screenshotting functionality does not use the print code. Rather it seems to use drawWindow:

https://searchfox.org/mozilla-central/rev/af5cff556a9482d7aa2267a82f2ccfaf18e797e9/browser/components/shell/ScreenshotChild.jsm#43

Besides that, the tests being loaded will have been taking the code paths that that bug 1642236 enforced. So I don't think that bug can be at fault here.

Looking at the log there's a crash occuring under DoWriteAtomicEvent::Run(). I looked at the other bugs in the regression range, but nothing jumps out as being an obvious culprit.

Comment 29

[Intermittent Failures Robot]

28 failures in 702 pushes (0.04 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 27
• mozilla-central: 1

Platform breakdown:

• windows7-32: 25
• windows10-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-07-16&endday=2020-07-16&tree=all

Comment 30

[Narcis Beleuzu [:NarcisB]]

Attachment: Bug 1583315 - Disable test_headless_screenshot.html on Windows. r?#intermittent-reviewers

Comment 31

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ea8c357d5c6b
Disable test_headless_screenshot.html on Windows. r=jmaher

Comment 32

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/ea8c357d5c6b

Comment 33

[Intermittent Failures Robot]

92 failures in 4014 pushes (0.023 failures/push) were associated with this bug in the last 7 days.

This is the #8 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 74
• mozilla-central: 11
• try: 7

Platform breakdown:

• windows10-64: 16
• windows7-32: 76

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-07-13&endday=2020-07-19&tree=all

Comment 34

[Intermittent Failures Robot]

1 failures in 3410 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-09-07&endday=2020-09-13&tree=all

Comment 35

[Intermittent Failures Robot]

1 failures in 4019 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform breakdown:

• linux1804-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-09-21&endday=2020-09-27&tree=all

Comment 36

[Intermittent Failures Robot]

1 failures in 4275 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583315&startday=2020-10-26&endday=2020-11-01&tree=all

Comment 37

[Intermittent Failures Robot]

1 failures in 1479 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1583315&startday=2020-11-23&endday=2020-11-29&tree=all

Comment 38

[Intermittent Failures Robot]

2 failures in 3712 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• autoland: 1

Platform breakdown:

• macosx1014-64-qr: 1
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1583315&startday=2020-11-30&endday=2020-12-06&tree=all

Comment 39

[Intermittent Failures Robot]

1 failures in 3421 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform breakdown:

• linux1804-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1583315&startday=2020-12-14&endday=2020-12-20&tree=all

Comment 40

[Intermittent Failures Robot]

2 failures in 2956 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform breakdown:

• linux1804-64-shippable-qr: 1
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1583315&startday=2021-01-04&endday=2021-01-10&tree=all

Comment 41

[Intermittent Failures Robot]

1 failures in 3810 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1583315&startday=2021-01-11&endday=2021-01-17&tree=all

Comment 42

[Intermittent Failures Robot]

1 failures in 3737 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1583315&startday=2021-02-15&endday=2021-02-21&tree=all

Comment 43

[Intermittent Failures Robot]

1 failures in 3683 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1583315&startday=2021-03-01&endday=2021-03-07&tree=all

Comment 44

[Intermittent Failures Robot]

1 failures in 4622 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1583315&startday=2021-03-08&endday=2021-03-14&tree=all

Comment 45

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.