1435082 - Intermittent wpt Max restarts exceeded

Status: RESOLVED INCOMPLETE

(Testing :: web-platform-tests, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: archaeopteryx [at] coole-files.de

https://treeherder.mozilla.org/logviewer.html#?job_id=159863705&repo=autoland

https://queue.taskcluster.net/v1/task/EIHqJFGkQ36HOmZYrho9Cw/runs/0/artifacts/public/logs/live_backing.log

[task 2018-02-01T15:30:40.526Z] 15:30:40     INFO - TEST-START | /mixed-content/link-prefetch-tag/no-opt-in/same-host-http/top-level/no-redirect/blockable/no-opt-in-blocks.https.html
[task 2018-02-01T15:30:40.526Z] 15:30:40     INFO - TEST-SKIP | /mixed-content/link-prefetch-tag/no-opt-in/same-host-http/top-level/no-redirect/blockable/no-opt-in-blocks.https.html | took 2ms
[task 2018-02-01T15:30:40.526Z] 15:30:40     INFO - Starting http server on web-platform.test:8001
[task 2018-02-01T15:30:40.527Z] 15:30:40     INFO - Starting http server on web-platform.test:8443
[task 2018-02-01T15:31:32.676Z] 15:31:32     INFO - Setting up ssl
[task 2018-02-01T15:32:43.656Z] 15:32:43     INFO - certutil | 
[task 2018-02-01T15:33:46.481Z] 15:33:46     INFO - certutil | 
[task 2018-02-01T15:33:46.497Z] 15:33:46     INFO - certutil | 
[task 2018-02-01T15:33:46.498Z] 15:33:46     INFO - Certificate Nickname                                         Trust Attributes
[task 2018-02-01T15:33:46.498Z] 15:33:46     INFO -                                                              SSL,S/MIME,JAR/XPI
[task 2018-02-01T15:33:46.501Z] 15:33:46     INFO - 
[task 2018-02-01T15:33:46.501Z] 15:33:46     INFO - web-platform-tests                                           CT,, 
[task 2018-02-01T15:33:46.501Z] 15:33:46     INFO - 
[task 2018-02-01T15:33:46.501Z] 15:33:46     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmpYZWEOh.mozrunner
[task 2018-02-01T15:33:46.507Z] 15:33:46     INFO - Starting runner
[task 2018-02-01T15:33:47.454Z] 15:33:47     INFO - Browser exited with return code -15
[task 2018-02-01T15:33:57.455Z] 15:33:57  WARNING - Forcibly terminating runner process
[task 2018-02-01T15:33:57.463Z] 15:33:57  WARNING - u'stop': ()
[task 2018-02-01T15:34:08.749Z] 15:34:08     INFO - Setting up ssl
[task 2018-02-01T15:34:19.782Z] 15:34:19     INFO - certutil | 
[task 2018-02-01T15:34:31.312Z] 15:34:31     INFO - certutil | 
[task 2018-02-01T15:34:31.327Z] 15:34:31     INFO - certutil | 
[task 2018-02-01T15:34:31.327Z] 15:34:31     INFO - Certificate Nickname                                         Trust Attributes
[task 2018-02-01T15:34:31.328Z] 15:34:31     INFO -                                                              SSL,S/MIME,JAR/XPI
[task 2018-02-01T15:34:31.328Z] 15:34:31     INFO - 
[task 2018-02-01T15:34:31.328Z] 15:34:31     INFO - web-platform-tests                                           CT,, 
[task 2018-02-01T15:34:31.328Z] 15:34:31     INFO - 
[task 2018-02-01T15:34:41.915Z] 15:34:41     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmpJQtvIL.mozrunner
[task 2018-02-01T15:34:41.931Z] 15:34:41     INFO - Starting runner
[task 2018-02-01T15:34:57.500Z] 15:34:57     INFO - Browser exited with return code -15
[task 2018-02-01T15:35:07.502Z] 15:35:07  WARNING - Forcibly terminating runner process
[task 2018-02-01T15:35:07.505Z] 15:35:07  WARNING - u'stop': ()
[task 2018-02-01T15:35:22.433Z] 15:35:22     INFO - Setting up ssl
[task 2018-02-01T15:35:32.400Z] 15:35:32     INFO - certutil | 
[task 2018-02-01T15:35:38.621Z] 15:35:38     INFO - certutil | 
[task 2018-02-01T15:35:38.637Z] 15:35:38     INFO - certutil | 
[task 2018-02-01T15:35:38.637Z] 15:35:38     INFO - Certificate Nickname                                         Trust Attributes
[task 2018-02-01T15:35:38.637Z] 15:35:38     INFO -                                                              SSL,S/MIME,JAR/XPI
[task 2018-02-01T15:35:38.638Z] 15:35:38     INFO - 
[task 2018-02-01T15:35:38.638Z] 15:35:38     INFO - web-platform-tests                                           CT,, 
[task 2018-02-01T15:35:38.641Z] 15:35:38     INFO - 
[task 2018-02-01T15:35:46.023Z] 15:35:46     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmpIjn88N.mozrunner
[task 2018-02-01T15:35:46.039Z] 15:35:46     INFO - Starting runner
[task 2018-02-01T15:36:07.521Z] 15:36:07     INFO - Browser exited with return code -15
[task 2018-02-01T15:36:17.521Z] 15:36:17  WARNING - Forcibly terminating runner process
[task 2018-02-01T15:36:17.529Z] 15:36:17  WARNING - u'stop': ()
[task 2018-02-01T15:36:31.455Z] 15:36:31     INFO - Setting up ssl
[task 2018-02-01T15:36:34.293Z] 15:36:34     INFO - certutil | 
[task 2018-02-01T15:36:36.060Z] 15:36:36     INFO - certutil | 
[task 2018-02-01T15:36:36.068Z] 15:36:36     INFO - certutil | 
[task 2018-02-01T15:36:36.068Z] 15:36:36     INFO - Certificate Nickname                                         Trust Attributes
[task 2018-02-01T15:36:36.069Z] 15:36:36     INFO -                                                              SSL,S/MIME,JAR/XPI
[task 2018-02-01T15:36:36.069Z] 15:36:36     INFO - 
[task 2018-02-01T15:36:36.069Z] 15:36:36     INFO - web-platform-tests                                           CT,, 
[task 2018-02-01T15:36:36.069Z] 15:36:36     INFO - 
[task 2018-02-01T15:36:37.192Z] 15:36:37     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmpF41VZR.mozrunner
[task 2018-02-01T15:36:37.201Z] 15:36:37     INFO - Starting runner
[task 2018-02-01T15:37:17.535Z] 15:37:17     INFO - Browser exited with return code -15
[task 2018-02-01T15:37:27.537Z] 15:37:27  WARNING - Forcibly terminating runner process
[task 2018-02-01T15:37:27.545Z] 15:37:27  WARNING - u'stop': ()
[task 2018-02-01T15:37:32.814Z] 15:37:32     INFO - Setting up ssl
[task 2018-02-01T15:37:36.526Z] 15:37:36     INFO - certutil | 
[task 2018-02-01T15:37:40.504Z] 15:37:40     INFO - certutil | 
[task 2018-02-01T15:37:40.520Z] 15:37:40     INFO - certutil | 
[task 2018-02-01T15:37:40.520Z] 15:37:40     INFO - Certificate Nickname                                         Trust Attributes
[task 2018-02-01T15:37:40.520Z] 15:37:40     INFO -                                                              SSL,S/MIME,JAR/XPI
[task 2018-02-01T15:37:40.520Z] 15:37:40     INFO - 
[task 2018-02-01T15:37:40.521Z] 15:37:40     INFO - web-platform-tests                                           CT,, 
[task 2018-02-01T15:37:40.521Z] 15:37:40     INFO - 
[task 2018-02-01T15:37:44.388Z] 15:37:44     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmpqnQIvu.mozrunner
[task 2018-02-01T15:37:44.405Z] 15:37:44     INFO - Starting runner
[task 2018-02-01T15:38:28.188Z] 15:38:28     INFO - Browser exited with return code -15
[task 2018-02-01T15:38:38.190Z] 15:38:38  WARNING - Forcibly terminating runner process
[task 2018-02-01T15:38:38.198Z] 15:38:38  WARNING - u'stop': ()
[task 2018-02-01T15:38:49.812Z] 15:38:49     INFO - Setting up ssl
[task 2018-02-01T15:38:58.386Z] 15:38:58     INFO - certutil | 
[task 2018-02-01T15:39:04.956Z] 15:39:04     INFO - certutil | 
[task 2018-02-01T15:39:04.977Z] 15:39:04     INFO - certutil | 
[task 2018-02-01T15:39:04.977Z] 15:39:04     INFO - Certificate Nickname                                         Trust Attributes
[task 2018-02-01T15:39:04.977Z] 15:39:04     INFO -                                                              SSL,S/MIME,JAR/XPI
[task 2018-02-01T15:39:04.978Z] 15:39:04     INFO - 
[task 2018-02-01T15:39:04.978Z] 15:39:04     INFO - web-platform-tests                                           CT,, 
[task 2018-02-01T15:39:04.978Z] 15:39:04     INFO - 
[task 2018-02-01T15:39:07.008Z] 15:39:07     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmppXjAbX.mozrunner
[task 2018-02-01T15:39:07.011Z] 15:39:07     INFO - Starting runner
[task 2018-02-01T15:39:38.234Z] 15:39:38     INFO - Browser exited with return code -15
[task 2018-02-01T15:39:48.234Z] 15:39:48  WARNING - Forcibly terminating runner process
[task 2018-02-01T15:39:48.244Z] 15:39:48  WARNING - u'stop': ()
[task 2018-02-01T15:39:48.245Z] 15:39:48    ERROR - Max restarts exceeded
[task 2018-02-01T15:39:48.246Z] 15:39:48     INFO - Got 0 unexpected results
[task 2018-02-01T15:39:48.247Z] 15:39:48     INFO - SUITE-END | took 547s

Comment 1

[Intermittent Failures Robot]

2 failures in 735 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 1
* autoland: 1

Platform breakdown:
* linux32: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1435082&startday=2018-01-29&endday=2018-02-04&tree=all

Comment 2

[Intermittent Failures Robot]

4 failures in 702 pushes (0.006 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2
* mozilla-central: 1
* mozilla-beta: 1

Platform breakdown:
* linux32: 2
* linux32-stylo-disabled: 1
* linux32-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1435082&startday=2018-02-05&endday=2018-02-11&tree=all

Comment 3

[Intermittent Failures Robot]

4 failures in 685 pushes (0.006 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 3
* autoland: 1

Platform breakdown:
* linux32: 3
* linux32-stylo-disabled: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1435082&startday=2018-02-12&endday=2018-02-18&tree=all

Comment 4

[Intermittent Failures Robot]

3 failures in 675 pushes (0.004 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2
* mozilla-inbound: 1

Platform breakdown:
* linux32: 2
* linux32-stylo-disabled: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1435082&startday=2018-02-19&endday=2018-02-25&tree=all

Comment 5

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 6

[Natalia Csoregi [:nataliaCs]]

https://treeherder.mozilla.org/logviewer.html#?job_id=178538703&repo=mozilla-inbound&lineNumber=1271

Comment 7

[Intermittent Failures Robot]

1 failures in 639 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2018-05-14&endday=2018-05-20&tree=trunk

Comment 8

[Dorel Luca [:dluca]]

Hi,

This bug had a huge spike in occurrence in the last 24 hours.

Most failures are on windows 7-32 and a few of them on windows 7-64, build type is opt and pgo.

Here is a recent log of the failure:
https://treeherder.mozilla.org/logviewer.html#?job_id=180539052&repo=mozilla-inbound

jgraham: Can you please take a look at this bug?

Comment 9

[Intermittent Failures Robot]

63 failures in 74 pushes (0.851 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 63

Platform breakdown:
* windows7-32: 52
* windows10-64: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2018-05-28&endday=2018-05-28&tree=trunk

Comment 10

[James Graham [:jgraham]]

Looks like this was a mislabled failure that got fixed.

Comment 11

[Intermittent Failures Robot]

63 failures in 655 pushes (0.096 failures/push) were associated with this bug in the last 7 days. 

This is the #19 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-inbound: 63

Platform breakdown:
* windows7-32: 52
* windows10-64: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2018-05-28&endday=2018-06-03&tree=trunk

Comment 12

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 13

[Eliza Balazs [:ebalazs_]]

Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=211394281&repo=autoland&lineNumber=2081

Comment 14

[Intermittent Failures Robot]

1 failures in 2917 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2018-11-12&endday=2018-11-18&tree=all

Comment 15

[Intermittent Failures Robot]

1 failures in 2387 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2018-11-19&endday=2018-11-25&tree=all

Comment 16

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 17

[Cosmin Sabou [:CosminS]]

https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=239837498&repo=autoland&lineNumber=1046

Comment 18

[Intermittent Failures Robot]

3 failures in 3025 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• windows7-32: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-04-08&endday=2019-04-14&tree=all

Comment 19

[Intermittent Failures Robot]

2 failures in 3031 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• osx-10-10-shippable: 1
• android-em-7-0-x86: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-04-22&endday=2019-04-28&tree=all

Comment 20

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 21

[Andrei Ciure[:aciure]]

New occurrence:

https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&resultStatus=testfailed%2Cbusted%2Cexception&classifiedState=unclassified&group_state=expanded&selectedJob=248072955&searchStr=android%2C7.0%2Cx86-64%2Copt%2Cweb%2Cplatform%2Ctests%2Ctest-android-em-7.0-x86_64%2Fopt-web-platform-tests-e10s-6%2Cw%28wpt6%29

Comment 22

[Intermittent Failures Robot]

3 failures in 4730 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform breakdown:

• android-em-7-0-x86_64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-05-20&endday=2019-05-26&tree=all

Comment 23

[Intermittent Failures Robot]

4 failures in 4337 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• mozilla-central: 3

Platform breakdown:

• android-em-7-0-x86: 1
• android-em-7-0-x86_64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-05-27&endday=2019-06-02&tree=all

Comment 24

[Intermittent Failures Robot]

1 failures in 5197 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-06-03&endday=2019-06-09&tree=all

Comment 25

[Intermittent Failures Robot]

2 failures in 4753 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• android-em-7-0-x86_64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-06-10&endday=2019-06-16&tree=all

Comment 26

[Intermittent Failures Robot]

15 failures in 2581 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 6
• autoland: 8
• mozilla-inbound: 1

Platform breakdown:

• android-em-7-0-x86_64: 4
• windows10-64-ccov: 3
• windows10-64: 2
• windows7-32-shippable: 3
• windows10-64-qr: 1
• windows7-32: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-06-17&endday=2019-06-23&tree=all

Comment 27

[Alexandru Michis [:malexandru]]

This has failed 34 times in the last 7 days on: android-em-7-0-x86_64 debug & opt, windows10-64 & windows10-64-ccov debug, windows10-64-qr opt & debug, windows10-64-shippable opt, windows7-32 opt & debug and windows7-32-shippable opt
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2019-06-21&endday=2019-06-28&tree=trunk&bug=1435082

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=253858823&repo=autoland&lineNumber=100818

05:21:25 INFO - TEST-PASS | leakcheck | tab no leaks detected!
05:21:25 INFO - Closing logging queue
05:21:25 INFO - queue closed
05:21:25 ERROR - Max restarts exceeded
05:21:25 INFO - PROCESS LEAKS c:\users\task_1561688441\appdata\local\temp\tmptr4hyi.mozrunner\runtests_leaks_3832.log
05:21:25 INFO - leakcheck | Processing log file c:\users\task_1561688441\appdata\local\temp\tmptr4hyi.mozrunner\runtests_leaks_3832.log for scope /mixed-content/module-data-worker-import/no-opt-in

Comment 28

[Intermittent Failures Robot]

32 failures in 4409 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 8
• mozilla-inbound: 4
• autoland: 17
• try: 3

Platform breakdown:

• windows7-32: 9
• android-em-7-0-x86_64: 9
• windows10-64-qr: 2
• windows10-64-shippable: 3
• windows7-32-shippable: 4
• windows10-64: 2
• windows10-64-ccov: 1
• windows10-64-devedition: 1
• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-06-24&endday=2019-06-30&tree=all

Comment 29

[Dorel Luca [:dluca]]

This has failed 34 times in the last 7 days on: android-em-7-0-x86_64 debug & opt, windows10-64 & windows10-64-ccov debug, windows10-64-qr opt & debug, windows10-64-shippable opt, windows7-32 opt & debug and windows7-32-shippable opt

Recent log:
https://treeherder.mozilla.org/logviewer.html#?job_id=255157521&repo=mozilla-inbound

Comment 30

[Intermittent Failures Robot]

36 failures in 3501 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 16
• try: 4
• mozilla-esr68: 1
• mozilla-central: 11
• mozilla-inbound: 4

Platform breakdown:

• android-em-7-0-x86_64: 9
• windows7-32: 4
• windows10-64: 7
• windows10-64-shippable: 7
• windows10-64-qr: 2
• windows10-64-ccov: 5
• windows10-64-shippable-qr: 1
• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-07-01&endday=2019-07-07&tree=all

Comment 31

[Intermittent Failures Robot]

31 failures in 893 pushes (0.035 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 29
• mozilla-inbound: 1
• mozilla-central: 1

Platform breakdown:

• android-em-7-0-x86_64: 30
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-07-11&endday=2019-07-11&tree=all

Comment 32

[Intermittent Failures Robot]

68 failures in 4710 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

This is the #31 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• try: 4
• mozilla-central: 14
• mozilla-inbound: 4
• autoland: 44
• mozilla-beta: 2

Platform breakdown:

• windows10-64: 9
• android-em-7-0-x86_64: 43
• windows10-64-ccov: 5
• windows7-32-shippable: 2
• windows7-32: 4
• windows10-64-shippable: 3
• windows10-64-qr: 1
• windows7-32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-07-08&endday=2019-07-14&tree=all

Comment 33

[Razvan Maries]

There are 62 total failures in the last 7 days: https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2019-07-10&endday=2019-07-17&tree=trunk&bug=1435082

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=256991417&repo=mozilla-central&lineNumber=99829

Comment 34

[James Graham [:jgraham]]

It seems like sometimes we're just not getting a marionette connection within the timeout. It could be that starting up forefox really does take longer than 360s on occasion, or we're somehow hitting a startup crash (although the builds seem to be started correctly at least some times).

Comment 35

[Intermittent Failures Robot]

31 failures in 4298 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 14
• mozilla-beta: 3
• autoland: 11
• try: 1
• mozilla-inbound: 2

Platform breakdown:

• windows10-64-qr: 4
• windows7-32-devedition: 1
• windows7-32: 3
• windows10-64-shippable: 3
• android-em-7-0-x86_64: 3
• windows10-64-shippable-qr: 1
• windows10-64: 8
• windows7-32-shippable: 2
• windows10-64-ccov: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-07-15&endday=2019-07-21&tree=all

Comment 36

[Andreea Pavel [:apavel]]

There are 23 total failures in the last 7 days on windows10-64 debug and opt, windows10-64-ccov debug, windows10-64-qr opt and windows7-32 debug.

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=258466756&repo=autoland&lineNumber=113222

[task 2019-07-26T10:59:40.684Z] 10:59:40 INFO - TEST-START | /referrer-policy/unset-referrer-policy/attr-referrer/same-origin/http-https/script-tag/swap-origin-redirect/upgrade-protocol.http.html
[task 2019-07-26T10:59:40.689Z] 10:59:40 INFO - Closing window 10737418241
[task 2019-07-26T10:59:40.699Z] 10:59:40 INFO - PID 6808 | [Parent 3548, Main Thread] WARNING: Constructing RangeBoundary with invalid value: 'mRef || aOffset == 0', file z:/build/build/src/obj-firefox/dist/include\mozilla/RangeBoundary.h, line 79
[task 2019-07-26T10:59:40.699Z] 10:59:40 INFO - PID 6808 | [Parent 3548, Main Thread] WARNING: Constructing RangeBoundary with invalid value: 'mRef || aOffset == 0', file z:/build/build/src/obj-firefox/dist/include\mozilla/RangeBoundary.h, line 79
[task 2019-07-26T10:59:40.699Z] 10:59:40 INFO - PID 6808 | [Child 8392, Main Thread] WARNING: No active window: file z:/build/build/src/js/xpconnect/src/XPCJSContext.cpp, line 664
[task 2019-07-26T10:59:40.745Z] 10:59:40 INFO - PID 6808 | [Parent 3548, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341

[task 2019-07-26T11:33:27.601Z] 11:33:27 INFO - nsTraceRefcnt::DumpStatistics: 817 entries
[task 2019-07-26T11:33:27.601Z] 11:33:27 INFO - TEST-PASS | leakcheck | tab no leaks detected!
[task 2019-07-26T11:33:27.602Z] 11:33:27 INFO - leakcheck | Processing leak log file c:\users\task_1564132537\appdata\local\temp\tmpaybz4t.mozrunner\runtests_leaks_10444_tab_pid4472.log
[task 2019-07-26T11:33:27.602Z] 11:33:27 INFO -
[task 2019-07-26T11:33:27.602Z] 11:33:27 INFO - == BloatView: ALL (cumulative) LEAK AND BLOAT STATISTICS, tab process 4472
[task 2019-07-26T11:33:27.602Z] 11:33:27 INFO -
[task 2019-07-26T11:33:27.602Z] 11:33:27 INFO - |<----------------Class--------------->|<-----Bytes------>|<----Objects---->|
[task 2019-07-26T11:33:27.602Z] 11:33:27 INFO - | | Per-Inst Leaked| Total Rem|
[task 2019-07-26T11:33:27.602Z] 11:33:27 INFO - 0 |TOTAL | 45 0| 37702 0|
[task 2019-07-26T11:33:27.607Z] 11:33:27 INFO -
[task 2019-07-26T11:33:27.607Z] 11:33:27 INFO - nsTraceRefcnt::DumpStatistics: 991 entries
[task 2019-07-26T11:33:27.608Z] 11:33:27 INFO - TEST-PASS | leakcheck | tab no leaks detected!
[task 2019-07-26T11:33:27.609Z] 11:33:27 INFO - Closing logging queue
[task 2019-07-26T11:33:27.609Z] 11:33:27 INFO - queue closed
[task 2019-07-26T11:33:27.609Z] 11:33:27 ERROR - Max restarts exceeded
[task 2019-07-26T11:33:27.609Z] 11:33:27 INFO - PROCESS LEAKS c:\users\task_1564132537\appdata\local\temp\tmpaybz4t.mozrunner\runtests_leaks_10444.log
[task 2019-07-26T11:33:27.609Z] 11:33:27 INFO - leakcheck | Processing log file c:\users\task_1564132537\appdata\local\temp\tmpaybz4t.mozrunner\runtests_leaks_10444.log for scope /referrer-policy/unset-referrer-policy/http-rp
[task 2019-07-26T11:33:27.610Z] 11:33:27 INFO - TEST-INFO | leakcheck | default process: leak threshold set at 51200 bytes
[task 2019-07-26T11:33:27.610Z] 11:33:27 INFO - TEST-INFO | leakcheck | plugin process: leak threshold set at 0 bytes
[task 2019-07-26T11:33:27.610Z] 11:33:27 INFO - TEST-INFO | leakcheck | tab process: leak threshold set at 10000 bytes
[task 2019-07-26T11:33:27.610Z] 11:33:27 INFO - TEST-INFO | leakcheck | gmplugin process: leak threshold set at 20000 bytes
[task 2019-07-26T11:33:27.610Z] 11:33:27 INFO - TEST-INFO | leakcheck | gpu process: leak threshold set at 0 bytes
[task 2019-07-26T11:33:27.610Z] 11:33:27 INFO - TEST-INFO | leakcheck | rdd process: leak threshold set at 400 bytes
[task 2019-07-26T11:33:27.610Z] 11:33:27 INFO - TEST-INFO | leakcheck | vr process: leak threshold set at 0 bytes
[task 2019-07-26T11:33:27.610Z] 11:33:27 INFO - TEST-INFO | leakcheck | socket process: leak threshold set at 0 bytes
[task 2019-07-26T11:33:27.610Z] 11:33:27 INFO - leakcheck | Processing leak log file c:\users\task_1564132537\appdata\local\temp\tmpaybz4t.mozrunner\runtests_leaks_10444.log

James is there something that can be done here?

Comment 37

[Intermittent Failures Robot]

24 failures in 4608 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 16
• try: 1
• mozilla-beta: 3
• autoland: 4

Platform breakdown:

• windows10-64-ccov: 9
• windows10-64: 3
• windows10-64-qr: 3
• windows10-64-shippable: 1
• windows7-32: 5
• windows7-32-shippable: 2
• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-07-22&endday=2019-07-28&tree=all

Comment 38

[James Graham [:jgraham]]

It's unclear if the problem here is just that we're even slower to start the browser than we expect, or if there's something more fundamental going on. I've tried a try push with the browser startup timeout increased [1], although come to think of it there may also be a timeout inside marionette. But if there's something more happening then just increasing the timeout won't help.

[1] https://treeherder.mozilla.org/#/jobs?repo=try&revision=70644ca043ebfea35f988be59ad681629a409460

Comment 39

[James Graham [:jgraham]]

It looks like the marionette startup timeout is already 120s, so I think it makes sense to increase the wptrunner value to just above that e.g. 130s (although the shutdown timeout seems to be 70s, so I think we want to keep the wptrunner value close to that).

Comment 40

[James Graham [:jgraham]]

That try push didn't fix the problem, so I'm not sure what's going on here. It looks like we try to restart the browser, wait 4 minutes or so, and then run the shutdown sequence. It claims marionette isn't connected so it's possible there's an error in that layer. Maybe a push with the marionette log level turned up would help?

Comment 41

[Intermittent Failures Robot]

25 failures in 4439 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• mozilla-inbound: 1
• mozilla-central: 8
• mozilla-beta: 4
• try: 2

Platform breakdown:

• windows7-32-shippable: 2
• windows7-32: 7
• windows10-64-ccov: 5
• android-em-7-0-x86_64: 2
• windows10-64-shippable: 4
• windows10-64: 2
• windows10-64-qr: 2
• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-07-29&endday=2019-08-04&tree=all

Comment 42

[Intermittent Failures Robot]

24 failures in 4666 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 11
• try: 1
• mozilla-inbound: 1
• mozilla-beta: 2
• autoland: 9

Platform breakdown:

• windows10-64-ccov: 6
• windows10-64: 6
• windows7-32: 5
• android-em-7-0-x86_64: 1
• windows10-64-shippable: 4
• windows10-64-devedition: 1
• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-08-05&endday=2019-08-11&tree=all

Comment 43

[Intermittent Failures Robot]

34 failures in 4839 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• try: 1
• autoland: 14
• mozilla-beta: 3
• mozilla-central: 13
• mozilla-inbound: 3

Platform breakdown:

• windows10-64-devedition: 1
• windows10-64-shippable: 3
• android-em-7-0-x86_64: 1
• windows10-64: 10
• windows10-64-ccov: 5
• windows10-64-shippable-qr: 1
• windows7-32: 10
• windows7-32-shippable: 1
• windows10-64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-08-12&endday=2019-08-18&tree=all

Comment 44

[Intermittent Failures Robot]

27 failures in 5073 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 14
• mozilla-central: 9
• try: 2
• mozilla-beta: 1
• mozilla-inbound: 1

Platform breakdown:

• windows10-64: 9
• windows10-64-qr: 2
• windows7-32: 8
• windows10-64-ccov: 4
• windows10-64-shippable: 2
• windows10-64-shippable-qr: 1
• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-08-19&endday=2019-08-25&tree=all

Comment 45

[Razvan Maries]

There are 22 total failures in the last 7 days: https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2019-08-20&endday=2019-08-27&tree=trunk&bug=1435082

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=263473327&repo=autoland&lineNumber=98750

Comment 46

[Intermittent Failures Robot]

20 failures in 5047 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 6
• mozilla-beta: 4
• mozilla-release: 1
• try: 2
• mozilla-inbound: 1

Platform breakdown:

• windows7-32: 6
• windows10-64-ccov: 4
• windows10-64: 3
• windows10-64-qr: 1
• windows7-32-shippable: 1
• windows10-64-shippable-qr: 1
• windows10-64-shippable: 3
• windows10-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-08-26&endday=2019-09-01&tree=all

Comment 47

[Intermittent Failures Robot]

20 failures in 4408 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 3
• mozilla-central: 5
• autoland: 3
• mozilla-inbound: 2
• try: 7

Platform breakdown:

• windows10-64: 6
• windows7-32: 4
• windows10-64-shippable: 2
• windows10-64-qr: 4
• windows10-64-shippable-qr: 2
• windows10-64-ccov: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-09-02&endday=2019-09-08&tree=all

Comment 48

[Intermittent Failures Robot]

21 failures in 4637 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 6
• autoland: 11
• try: 2
• mozilla-inbound: 1
• mozilla-beta: 1

Platform breakdown:

• windows10-64-ccov: 3
• windows7-32: 9
• windows10-64: 4
• windows10-64-shippable: 3
• windows10-64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-09-09&endday=2019-09-15&tree=all

Comment 49

[Intermittent Failures Robot]

11 failures in 4350 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• try: 2
• mozilla-release: 1
• mozilla-central: 4
• mozilla-beta: 3

Platform breakdown:

• windows7-32: 3
• windows10-64-shippable-qr: 1
• windows10-64-ccov: 1
• windows10-64-devedition: 2
• windows10-64-shippable: 2
• windows10-64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-09-16&endday=2019-09-22&tree=all

Comment 50

[Intermittent Failures Robot]

14 failures in 4530 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 5
• autoland: 6
• mozilla-central: 3

Platform breakdown:

• windows10-64-shippable: 1
• windows7-32: 3
• windows10-64-qr: 5
• windows10-64: 3
• windows10-64-ccov: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-09-23&endday=2019-09-29&tree=all

Comment 51

[Intermittent Failures Robot]

5 failures in 4292 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• mozilla-beta: 1
• mozilla-inbound: 1
• mozilla-release: 1

Platform breakdown:

• windows10-64-ccov: 2
• windows10-64-qr: 1
• windows10-64-shippable: 1
• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-09-30&endday=2019-10-06&tree=all

Comment 52

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 53

[Intermittent Failures Robot]

1 failures in 5444 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1435082&startday=2019-11-18&endday=2019-11-24&tree=all