1400580 - Intermittent TEST-UNEXPECTED-ERROR | damp | timeout

Status: RESOLVED INCOMPLETE

(DevTools :: Console, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: archaeopteryx [at] coole-files.de

https://treeherder.mozilla.org/logviewer.html#?job_id=131481341&repo=autoland

https://mozilla-releng-blobs.s3.amazonaws.com/blobs/Autoland/sha512/7292c49501f306be6752e989d39ec048410d0a9c7dce53c3327b675f268066d3299302a8242e6880a6247d4956ad98c58734d3a99f9af8d107eb02ad5125bbd1

08:26:32     INFO -  SUITE-START | Running 2 tests
08:26:32     INFO -  TEST-START | damp
08:26:32     INFO -  Initialising browser for damp test...
08:26:32     INFO -  Application command: /builds/slave/test/build/application/firefox/firefox  http://localhost:45957/getInfo.html -profile /tmp/tmpkEHyWm/profile
08:26:32     INFO -  TEST-INFO | started process 25764 (/builds/slave/test/build/application/firefox/firefox  http://localhost:45957/getInfo.html)
08:26:39     INFO -  TEST-INFO | 25764: exit 0
08:26:39     INFO -  Browser initialized.
08:26:39     INFO -  Running cycle 1/1 for damp test...
08:26:39     INFO -  Using env: {'DISPLAY': ':0',
08:26:39     INFO -   'HOME': '/home/cltbld',
08:26:39     INFO -   'JSGC_DISABLE_POISONING': '1',
08:26:39     INFO -   'LANG': 'en_US.UTF-8',
08:26:39     INFO -   'LANGUAGE': 'en_US:en',
08:26:39     INFO -   'LD_LIBRARY_PATH': '/builds/slave/test/build/application/firefox',
08:26:39     INFO -   'LOGNAME': 'cltbld',
08:26:39     INFO -   'MAIL': '/var/mail/cltbld',
08:26:39     INFO -   'MINIDUMP_SAVE_PATH': '/builds/slave/test/build/blobber_upload_dir',
08:26:39     INFO -   'MINIDUMP_STACKWALK': '/builds/slave/test/build/linux64-minidump_stackwalk',
08:26:39     INFO -   'MOZ_CRASHREPORTER': '1',
08:26:39     INFO -   'MOZ_CRASHREPORTER_NO_REPORT': '1',
08:26:39     INFO -   'MOZ_DISABLE_NONLOCAL_CONNECTIONS': '1',
08:26:39     INFO -   'MOZ_NO_REMOTE': '1',
08:26:39     INFO -   'MOZ_UPLOAD_DIR': '/builds/slave/test/build/blobber_upload_dir',
08:26:39     INFO -   'NODE_PATH': '/usr/lib/nodejs:/usr/lib/node_modules:/usr/share/javascript',
08:26:39     INFO -   'NO_EM_RESTART': '1',
08:26:39     INFO -   'PATH': '/builds/slave/test/build/venv/bin:/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games',
08:26:39     INFO -   'PROPERTIES_FILE': '/builds/slave/test/buildprops.json',
08:26:39     INFO -   'PWD': '/builds/slave/test',
08:26:39     INFO -   'PYTHONPATH': '/builds/slave/test/build/tests/talos',
08:26:39     INFO -   'RUST_BACKTRACE': 'full',
08:26:39     INFO -   'SCRIPTSPATH': '/builds/slave/test/scripts',
08:26:39     INFO -   'SHELL': '/bin/bash',
08:26:39     INFO -   'SHLVL': '1',
08:26:39     INFO -   'TERM': 'linux',
08:26:39     INFO -   'TMOUT': '86400',
08:26:39     INFO -   'USER': 'cltbld',
08:26:39     INFO -   'XDG_SESSION_COOKIE': '5cf47e208febbcd81da23b2e0000026f-1505574715.193907-2033749545',
08:26:39     INFO -   'XPCOM_DEBUG_BREAK': 'warn',
08:26:39     INFO -   '_': '/tools/buildbot/bin/python'}
08:26:39     INFO -  TEST-INFO | started process 26004 (/builds/slave/test/build/application/firefox/firefox -profile /tmp/tmpkEHyWm/profile -tp file:/builds/slave/test/build/tests/talos/talos/tests/devtools/damp.manifest.develop -tpchrome -tpnoisy -tploadnocache -tpcycles 1 -tppagecycles 25)
08:26:40     INFO -  PID 26004 |
08:26:40     INFO -  PID 26004 | (/builds/slave/test/build/application/firefox/firefox:26052): Pango-WARNING **: error opening config file '/home/cltbld/.pangorc': Permission denied
08:26:40     INFO -  PID 26004 |
08:26:50     INFO -  PID 26004 | RSS: Main: 157704192
08:26:50     INFO -  PID 26004 |
08:26:50     INFO -  PID 26004 |
08:26:50     INFO -  PID 26004 | (/builds/slave/test/build/application/firefox/firefox:26126): Pango-WARNING **: error opening config file '/home/cltbld/.pangorc': Permission denied
08:26:50     INFO -  PID 26004 |
08:26:52     INFO -  PID 26004 |
08:26:52     INFO -  PID 26004 | (/builds/slave/test/build/application/firefox/firefox:26179): Pango-WARNING **: error opening config file '/home/cltbld/.pangorc': Permission denied
08:26:52     INFO -  PID 26004 |
08:26:54     INFO -  PID 26004 |
08:26:54     INFO -  PID 26004 | (/builds/slave/test/build/application/firefox/firefox:26226): Pango-WARNING **: error opening config file '/home/cltbld/.pangorc': Permission denied
08:26:54     INFO -  PID 26004 |
08:26:55     INFO -  PID 26004 |
08:26:55     INFO -  PID 26004 | (/builds/slave/test/build/application/firefox/firefox:26280): Pango-WARNING **: error opening config file '/home/cltbld/.pangorc': Permission denied
08:26:55     INFO -  PID 26004 |
08:26:56     INFO -  PID 26004 |
08:26:56     INFO -  PID 26004 | (/builds/slave/test/build/application/firefox/firefox:26328): Pango-WARNING **: error opening config file '/home/cltbld/.pangorc': Permission denied
08:26:56     INFO -  PID 26004 |
08:26:57     INFO -  PID 26004 |
08:26:57     INFO -  PID 26004 | (/builds/slave/test/build/application/firefox/firefox:26375): Pango-WARNING **: error opening config file '/home/cltbld/.pangorc': Permission denied
08:26:57     INFO -  PID 26004 |
08:26:58     INFO -  PID 26004 |
08:26:58     INFO -  PID 26004 | (/builds/slave/test/build/application/firefox/firefox:26421): Pango-WARNING **: error opening config file '/home/cltbld/.pangorc': Permission denied
08:26:58     INFO -  PID 26004 |
08:27:00     INFO -  PID 26004 |
08:27:00     INFO -  PID 26004 | (/builds/slave/test/build/application/firefox/firefox:26469): Pango-WARNING **: error opening config file '/home/cltbld/.pangorc': Permission denied
08:27:00     INFO -  PID 26004 |
09:26:39     INFO -  Timeout waiting for test completion; killing browser...
09:26:39     INFO -  Terminating psutil.Process(pid=26004, name='firefox')
09:26:39     INFO -  PID 26004 | ExceptionHandler::WaitForContinueSignal waiting for continue signal...
09:26:39     INFO -  PID 26004 | ExceptionHandler::GenerateDump cloned child 27101
09:26:39     INFO -  PID 26004 | ExceptionHandler::SendContinueSignalToChild sent continue signal to child
09:26:39     INFO -  TEST-UNEXPECTED-ERROR | damp | timeout
09:26:39    ERROR -  Traceback (most recent call last):
09:26:39     INFO -    File "/builds/slave/test/build/tests/talos/talos/run_tests.py", line 281, in run_tests
09:26:39     INFO -      talos_results.add(mytest.runTest(browser_config, test))
09:26:39     INFO -    File "/builds/slave/test/build/tests/talos/talos/ttest.py", line 61, in runTest
09:26:39     INFO -      return self._runTest(browser_config, test_config, setup)
09:26:39     INFO -    File "/builds/slave/test/build/tests/talos/talos/ttest.py", line 209, in _runTest
09:26:39     INFO -      if counter_management else None),
09:26:39     INFO -    File "/builds/slave/test/build/tests/talos/talos/talos_process.py", line 130, in run_browser
09:26:39     INFO -      raise TalosError("timeout")
09:26:39     INFO -  TalosError: timeout

Comment 1

[Intermittent Failures Robot]

2 failures in 1032 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2

Platform breakdown:
* linux64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2017-09-11&endday=2017-09-17&tree=all

Comment 2

[Intermittent Failures Robot]

16 failures in 943 pushes (0.017 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 7
* mozilla-inbound: 5
* autoland: 4

Platform breakdown:
* linux64: 16

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2017-09-18&endday=2017-09-24&tree=all

Comment 3

[Intermittent Failures Robot]

39 failures in 885 pushes (0.044 failures/push) were associated with this bug in the last 7 days.   

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 16
* mozilla-central: 12
* mozilla-inbound: 11

Platform breakdown:
* linux64: 39

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2017-09-25&endday=2017-10-01&tree=all

Comment 4

[Intermittent Failures Robot]

2 failures in 824 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-beta: 2

Platform breakdown:
* linux64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2017-10-02&endday=2017-10-08&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 947 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-beta: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2017-10-09&endday=2017-10-15&tree=all

Comment 6

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bugmasters#Intermittent_Test_Failure_Cleanup

Comment 7

[Intermittent Failures Robot]

29 failures in 744 pushes (0.039 failures/push) were associated with this bug in the last 7 days. 

This is the #37 most frequent failure this week.   

Repository breakdown:
* mozilla-central: 14
* autoland: 10
* mozilla-inbound: 5

Platform breakdown:
* linux64: 29

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2017-11-20&endday=2017-11-26&tree=all

Comment 8

[Eliza Balazs [:ebalazs_]]

There are 48 failures in the last 7 days, with a spike from 25th -> 27th of Nov.
They occur on Linux x64 and the affected build types are pgo and opt.
Here is a recent log example: https://treeherder.mozilla.org/logviewer.html#?repo=autoland&job_id=148022423&lineNumber=2381
:rwood, can you please take a look?

Comment 9

[Robert Wood [:rwood]]

It happens much more often on PGO vs OPT, and the recent failures seem pretty consistent in failing at reloading of 'complicated.netmonitor' (the test is timing out after 60 minutes of waiting for that reload):

15:02:44     INFO -  PID 7372 | Reload page on 'complicated.performance'
15:02:45     INFO -  PID 7372 | Close toolbox on 'complicated.performance'
15:02:46     INFO -  PID 7372 |
15:02:46     INFO -  PID 7372 | (/builds/slave/test/build/application/firefox/firefox:13575): Pango-WARNING **: error opening config file '/home/cltbld/.pangorc': Permission denied
15:02:46     INFO -  PID 7372 |
15:02:47     INFO -  PID 7372 | Open toolbox on 'complicated.netmonitor'
15:02:48     INFO -  PID 7372 | Reload page on 'complicated.netmonitor'
16:00:25     INFO -  Timeout waiting for test completion; killing browser...
16:00:25     INFO -  Terminating psutil.Process(pid=7372, name='firefox')

:bgrins, any ideas here as to why reload of 'complicated.performance' could be failing?

Comment 10

[Brian Grinstead [:bgrins]]

(In reply to Robert Wood [:rwood] from comment #9)
> It happens much more often on PGO vs OPT, and the recent failures seem
> pretty consistent in failing at reloading of 'complicated.netmonitor' (the
> test is timing out after 60 minutes of waiting for that reload):
> 
> 15:02:44     INFO -  PID 7372 | Reload page on 'complicated.performance'
> 15:02:45     INFO -  PID 7372 | Close toolbox on 'complicated.performance'
> 15:02:46     INFO -  PID 7372 |
> 15:02:46     INFO -  PID 7372 |
> (/builds/slave/test/build/application/firefox/firefox:13575): Pango-WARNING
> **: error opening config file '/home/cltbld/.pangorc': Permission denied
> 15:02:46     INFO -  PID 7372 |
> 15:02:47     INFO -  PID 7372 | Open toolbox on 'complicated.netmonitor'
> 15:02:48     INFO -  PID 7372 | Reload page on 'complicated.netmonitor'
> 16:00:25     INFO -  Timeout waiting for test completion; killing browser...
> 16:00:25     INFO -  Terminating psutil.Process(pid=7372, name='firefox')
> 
> :bgrins, any ideas here as to why reload of 'complicated.performance' could
> be failing?

I think you mean 'complicated.netmonitor' reload? Forwarding the question to Alex as we've recently been making some changes as to what constitutes 'reload' in DAMP for various tools, although I don't see anything that looks particularly related for the netmonitor since Bug 1328553.

Comment 11

[Robert Wood [:rwood]]

Yes sorry, 'netmonitor', thanks!

Comment 12

[Intermittent Failures Robot]

40 failures in 792 pushes (0.051 failures/push) were associated with this bug in the last 7 days. 

This is the #20 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 22
* mozilla-inbound: 14
* mozilla-central: 3
* try: 1

Platform breakdown:
* linux64: 40

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2017-11-27&endday=2017-12-03&tree=all

Comment 13

[Alexandre Poirot [:ochameau]]

I think I identified something possibly wrong with this test while working on bug 1419327.
This huge spike of failure on November 26th is surprising, it looks like it regressed on this day and was fixed immediately?

Comment 14

[Intermittent Failures Robot]

2 failures in 889 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 2

Platform breakdown:
* linux64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2017-12-04&endday=2017-12-10&tree=all

Comment 15

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 16

[Andreea Pavel [:apavel]]

Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=157365676&repo=autoland&lineNumber=6647

20:52:33     INFO -  PID 1743 | [Child 9109, Chrome_ChildThread] WARNING: pipe error: Broken pipe: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 709
20:52:33     INFO -  PID 1743 | [Child 9109, Chrome_ChildThread] WARNING: pipe error: Broken pipe: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 709
20:52:33     INFO -  PID 1743 | [Child 9109, Chrome_ChildThread] WARNING: pipe error: Broken pipe: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 709
20:52:33     INFO -  PID 1743 | Open toolbox on 'complicated.performance'
20:52:34     INFO -  PID 1743 | Garbage collect
20:52:35     INFO -  PID 1743 | Reload page on 'complicated.performance'
20:52:36     INFO -  PID 1743 | Close toolbox on 'complicated.performance'
20:52:36     INFO -  PID 1743 | Garbage collect
20:52:37     INFO -  PID 1743 |
20:52:37     INFO -  PID 1743 | (/builds/slave/test/build/application/firefox/firefox:9760): Pango-WARNING **: error opening config file '/home/cltbld/.pangorc': Permission denied
20:52:37     INFO -  PID 1743 |
20:52:38     INFO -  PID 1743 | Open toolbox on 'complicated.netmonitor'
20:52:39     INFO -  PID 1743 | Garbage collect
20:52:39     INFO -  PID 1743 | Reload page on 'complicated.netmonitor'
21:48:51     INFO -  Timeout waiting for test completion; killing browser...
21:48:51     INFO -  Terminating psutil.Process(pid=1743, name='firefox')
21:48:51     INFO -  PID 1743 | ExceptionHandler::GenerateDump cloned child 10482
21:48:51     INFO -  PID 1743 | ExceptionHandler::SendContinueSignalToChild sent continue signal to child
21:48:51     INFO -  PID 1743 | ExceptionHandler::WaitForContinueSignal waiting for continue signal...
21:48:51     INFO -  TEST-UNEXPECTED-ERROR | damp | timeout
21:48:51    ERROR -  Traceback (most recent call last):
21:48:51     INFO -    File "/builds/slave/test/build/tests/talos/talos/run_tests.py", line 289, in run_tests
21:48:51     INFO -      talos_results.add(mytest.runTest(browser_config, test))
21:48:51     INFO -    File "/builds/slave/test/build/tests/talos/talos/ttest.py", line 62, in runTest
21:48:51     INFO -      return self._runTest(browser_config, test_config, setup)
21:48:51     INFO -    File "/builds/slave/test/build/tests/talos/talos/ttest.py", line 214, in _runTest
21:48:51     INFO -      debugger_args=browser_config['debugger_args']
21:48:51     INFO -    File "/builds/slave/test/build/tests/talos/talos/talos_process.py", line 139, in run_browser
21:48:51     INFO -      raise TalosError("timeout")
21:48:51     INFO -  TalosError: timeout
21:48:51     INFO -  TEST-INFO took 4502915ms
21:48:51     INFO -  SUITE-END | took 4502s
21:48:51     INFO -  PID 1743 | Sandbox: Unexpected EOF, op 0 flags 01101 path /tmp/GeckoChildCrash10085.extra
21:48:51    ERROR - Return code: 2
21:48:51  WARNING - setting return code to 2
21:48:51    ERROR - # TBPL FAILURE #
21:48:51     INFO - Running post-action listener: _package_coverage_data
21:48:51     INFO - Running post-action listener: _resource_record_post_action
21:48:51     INFO - [mozharness: 2018-01-19 05:48:51.940442Z] Finished run-tests step (success)
21:48:51     INFO - Running post-run listener: _resource_record_post_run
21:48:52     INFO - Total resource usage - Wall time: 4522s; CPU: 7.0%; Read bytes: 10911744; Write bytes: 513163264; Read time: 4120; Write time: 299708
21:48:52     INFO - TinderboxPrint: CPU usage<br/>6.8%
21:48:52     INFO - TinderboxPrint: I/O read bytes / time<br/>10,911,744 / 4,120
21:48:52     INFO - TinderboxPrint: I/O write bytes / time<br/>513,163,264 / 299,708
21:48:52     INFO - TinderboxPrint: CPU idle<br/>33,578.1 (93.2%)
21:48:52     INFO - TinderboxPrint: CPU system<br/>382.1 (1.1%)
21:48:52     INFO - TinderboxPrint: CPU user<br/>1,990.6 (5.5%)
21:48:52     INFO - TinderboxPrint: Swap in / out<br/>0 / 0
21:48:52     INFO - install - Wall time: 19s; CPU: 13.0%; Read bytes: 0; Write bytes: 7876608; Read time: 0; Write time: 1928

Comment 17

[Intermittent Failures Robot]

4 failures in 657 pushes (0.006 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 4

Platform breakdown:
* linux64: 4

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2018-01-15&endday=2018-01-21&tree=all

Comment 18

[Intermittent Failures Robot]

9 failures in 701 pushes (0.013 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 5
* mozilla-central: 2
* autoland: 2

Platform breakdown:
* linux64: 9

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2018-01-22&endday=2018-01-28&tree=all

Comment 20

[Intermittent Failures Robot]

9 failures in 735 pushes (0.012 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 5
* mozilla-central: 2
* mozilla-beta: 1
* autoland: 1

Platform breakdown:
* linux64: 8
* windows7-32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2018-01-29&endday=2018-02-04&tree=all

Comment 21

[Robert Wood [:rwood]]

On the new Windows 10 talos taskcluster hardware (see Bug 1431161) this issue (test hanging on damp 'complicated.netmonitor') happens consistently. In Bug 1431161 I'm going to turn off the 'complicated.netmonitor' part of the damp test.

Comment 22

[Robert Wood [:rwood]]

(In reply to Robert Wood [:rwood] from comment #21)
> On the new Windows 10 talos taskcluster hardware (see Bug 1431161) this
> issue (test hanging on damp 'complicated.netmonitor') happens consistently.
> In Bug 1431161 I'm going to turn off the 'complicated.netmonitor' part of
> the damp test.

See https://bugzilla.mozilla.org/show_bug.cgi?id=1431161#c14

Comment 23

[Intermittent Failures Robot]

3 failures in 702 pushes (0.004 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-beta: 3

Platform breakdown:
* windows7-32: 2
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2018-02-05&endday=2018-02-11&tree=all

Comment 24

[Intermittent Failures Robot]

3 failures in 685 pushes (0.004 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-beta: 2
* autoland: 1

Platform breakdown:
* linux64: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2018-02-12&endday=2018-02-18&tree=all

Comment 25

[Intermittent Failures Robot]

8 failures in 675 pushes (0.012 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 6
* mozilla-beta: 2

Platform breakdown:
* linux64: 4
* windows10-64: 3
* windows7-32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2018-02-19&endday=2018-02-25&tree=all

Comment 26

[Intermittent Failures Robot]

7 failures in 831 pushes (0.008 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 3
* autoland: 3
* mozilla-beta: 1

Platform breakdown:
* linux64: 3
* windows7-32: 2
* windows10-64: 1
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2018-02-26&endday=2018-03-04&tree=all

Comment 27

[Intermittent Failures Robot]

2 failures in 747 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-beta: 2

Platform breakdown:
* windows7-32: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2018-03-05&endday=2018-03-11&tree=all

Comment 28

[Intermittent Failures Robot]

1 failures in 814 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* windows7-32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400580&startday=2018-03-12&endday=2018-03-18&tree=all

Comment 29

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 30

[Natalia Csoregi [:nataliaCs]]

https://treeherder.mozilla.org/logviewer.html#?job_id=206035871&repo=autoland&lineNumber=3013

Comment 31

[Intermittent Failures Robot]

3 failures in 2759 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 3

Platform breakdown:
* windows10-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2018-10-15&endday=2018-10-21&tree=all

Comment 32

[Intermittent Failures Robot]

2 failures in 2584 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 2

Platform breakdown:
* windows10-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2018-10-22&endday=2018-10-28&tree=all

Comment 33

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 34

[Intermittent Failures Robot]

1 failures in 2808 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 1

Platform breakdown:
* linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2018-11-26&endday=2018-12-02&tree=all

Comment 35

[Cosmin Sabou [:CosminS]]

https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=221223199&repo=autoland&lineNumber=5262

Comment 36

[Intermittent Failures Robot]

1 failures in 2627 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2019-01-07&endday=2019-01-13&tree=all

Comment 37

[Intermittent Failures Robot]

1 failures in 2378 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2019-01-14&endday=2019-01-20&tree=all

Comment 38

[Intermittent Failures Robot]

8 failures in 2628 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 8

Platform breakdown:

• linux64-qr: 6
• linux64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2019-01-28&endday=2019-02-03&tree=all

Comment 39

[Intermittent Failures Robot]

1 failures in 2832 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2019-02-11&endday=2019-02-17&tree=all

Comment 40

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 41

[Cristian Brindusan [:cbrindusan]]

New occurrence:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=292110975&repo=try&lineNumber=9665

Comment 42

[Intermittent Failures Robot]

5 failures in 5483 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• mozilla-central: 1
• autoland: 3

Platform breakdown:

• windows10-64-shippable: 1
• windows10-64-shippable-qr: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2020-03-02&endday=2020-03-08&tree=all

Comment 43

[Florin Strugariu [:Bebe]]

:ochameau can you take a look over these intermittent failures ?

Comment 44

[Intermittent Failures Robot]

8 failures in 5336 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• autoland: 3
• try: 1

Platform breakdown:

• windows10-64-shippable: 2
• windows10-64-shippable-qr: 4
• windows10-64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2020-03-09&endday=2020-03-15&tree=all

Comment 45

[Intermittent Failures Robot]

4 failures in 4955 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1
• try: 2

Platform breakdown:

• windows10-64-qr: 1
• windows10-64-shippable-qr: 1
• windows10-64-shippable: 1
• linux64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2020-03-16&endday=2020-03-22&tree=all

Comment 46

[Intermittent Failures Robot]

1 failures in 4773 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2020-03-23&endday=2020-03-29&tree=all

Comment 47

[Intermittent Failures Robot]

2 failures in 5015 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• windows10-64-shippable-qr: 1
• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2020-03-30&endday=2020-04-05&tree=all

Comment 48

[Intermittent Failures Robot]

1 failures in 4823 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2020-04-06&endday=2020-04-12&tree=all

Comment 49

[Intermittent Failures Robot]

1 failures in 5423 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2020-04-27&endday=2020-05-03&tree=all

Comment 50

[Intermittent Failures Robot]

1 failures in 5276 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2020-05-04&endday=2020-05-10&tree=all

Comment 51

[Intermittent Failures Robot]

1 failures in 5488 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2020-05-11&endday=2020-05-17&tree=all

Comment 52

[Intermittent Failures Robot]

1 failures in 4035 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2020-06-15&endday=2020-06-21&tree=all

Comment 53

[Intermittent Failures Robot]

4 failures in 5252 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform breakdown:

• linux64-shippable: 2
• linux64-shippable-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1400580&startday=2020-06-22&endday=2020-06-28&tree=all

Comment 54

[Alexandre Poirot [:ochameau]]

This timeout doesn't seem to occur anymore, or is it triaged in another bug?

Comment 55

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 56

[Intermittent Failures Robot]

1 failures in 4327 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1400580&startday=2021-02-22&endday=2021-02-28&tree=all

Comment 57

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.