1400728 - Permaorange JSDCov toolkit/modules/subprocess/test/xpcshell/test_subprocess.js | xpcshell return code: 0

Status: RESOLVED FIXED

(Core :: XPCOM, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: dluca [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=131625323&repo=mozilla-central

https://queue.taskcluster.net/v1/task/T31VQcWaQ_-N_kthnCRF7w/runs/0/artifacts/public/test_info//xpcshell-coverage_errorsummary.log

Comment 1

[Intermittent Failures Robot]

2 failures in 1032 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 2

Platform breakdown:
* linux64-jsdcov: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400728&startday=2017-09-11&endday=2017-09-17&tree=all

Comment 2

[Intermittent Failures Robot]

33 failures in 943 pushes (0.035 failures/push) were associated with this bug in the last 7 days.   

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-central: 32
* try: 1

Platform breakdown:
* linux64-jsdcov: 33

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400728&startday=2017-09-18&endday=2017-09-24&tree=all

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

:gmierz, this is another jsdcov specific failure (probably perma fail), did we have similar failures in the past, does this test make sense to run in jsdcov?

Comment 4

[Greg Mierzwinski [:sparky]]

We've had a failure in another test for processes but that was on linux64-ccov: https://bugzilla.mozilla.org/show_bug.cgi?id=1394989 

This is the first that I've seen for jsdcov. The test is only testing 'SubProcess' from what I see. In my opinion, this stuff should get coverage from other testing because it looks like something that could be useful in many places. So I don't think there will be a loss of coverage if we skip it, but it does look like there is a lot being tested here so an opinion from the test author or component owner could be helpful. What do you think?

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

I believe skipping this for jsdcov sounds reasonable- :gmierz want to do that and r?jmaher ?

Comment 6

[Intermittent Failures Robot]

32 failures in 885 pushes (0.036 failures/push) were associated with this bug in the last 7 days.   

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-central: 32

Platform breakdown:
* linux64-jsdcov: 31
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400728&startday=2017-09-25&endday=2017-10-01&tree=all

Comment 7

[Intermittent Failures Robot]

16 failures in 824 pushes (0.019 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 16

Platform breakdown:
* linux64-jsdcov: 16

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400728&startday=2017-10-02&endday=2017-10-08&tree=all

Comment 8

[Greg Mierzwinski [:sparky]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=de29349e362fcd8fe4ce7ce37aa3b193e1846985

Comment 9

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1400728 - Disable 'test_subprocess.js' on linux64-jsdcov.

This patch prevents the test 'toolkit/modules/subprocess/test/xpcshell/test_subprocess.js' from running on linux64-jsdcov in the xpcshell suite.

Review commit: https://reviewboard.mozilla.org/r/187600/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/187600/

Comment 10

[Greg Mierzwinski [:sparky]]

Comment 8 has the test run for this.

I was looking at the other failure in this xpcshell chunk and it seems like it fails for the same reason as this test.

Comment 11

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 8916478 [details]
Bug 1400728 - Disable 'test_subprocess.js' on linux64-jsdcov.

https://reviewboard.mozilla.org/r/187600/#review192644

thanks Greg!

Comment 12

[Intermittent Failures Robot]

39 failures in 947 pushes (0.041 failures/push) were associated with this bug in the last 7 days.   

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-central: 39

Platform breakdown:
* linux64-jsdcov: 39

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400728&startday=2017-10-09&endday=2017-10-15&tree=all

Comment 13

[Joel Maher ( :jmaher ) (UTC -8)]

just landed the commit.

Comment 14

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/f35bb12c3bb5
Disable 'test_subprocess.js' on linux64-jsdcov. r=jmaher

Comment 15

[Stefan Hindli [:stefan_hindli]]

https://hg.mozilla.org/mozilla-central/rev/f35bb12c3bb5

Comment 16

[Intermittent Failures Robot]

10 failures in 864 pushes (0.012 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 10

Platform breakdown:
* linux64-jsdcov: 10

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400728&startday=2017-10-16&endday=2017-10-22&tree=all

Comment 17

[Intermittent Failures Robot]

1 failures in 765 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400728&startday=2018-04-02&endday=2018-04-08&tree=trunk