1613972 - Intermittent mozproxy File "mitmproxy/proxy/server.py", line 121, in handle

Status: RESOLVED DUPLICATE of bug 1677298

(Testing :: Mozbase, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: dvarga [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=287938976&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/NTeRNQncSXKxvKVEB3vuFg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-02-07T15:09:46.056Z] 15:09:46     INFO - switched to tab
[task 2020-02-07T15:09:46.064Z] 15:09:46     INFO - loading https://pinterest.com/
[task 2020-02-07T15:09:53.294Z] 15:09:53     INFO - loaded!
[task 2020-02-07T15:10:08.429Z] 15:10:08     INFO - switching to tab
[task 2020-02-07T15:10:08.431Z] 15:10:08     INFO - switched to tab
[task 2020-02-07T15:10:08.437Z] 15:10:08     INFO - loading https://twitter.com/BarackObama
[task 2020-02-07T15:10:09.625Z] 15:10:09    ERROR - mozproxy Traceback (most recent call last):
[task 2020-02-07T15:10:09.629Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/server.py", line 121, in handle
[task 2020-02-07T15:10:09.630Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/modes/http_proxy.py", line 9, in __call__
[task 2020-02-07T15:10:09.630Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/tls.py", line 286, in __call__
[task 2020-02-07T15:10:09.635Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/http1.py", line 83, in __call__
[task 2020-02-07T15:10:09.635Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/http.py", line 188, in __call__
[task 2020-02-07T15:10:09.636Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/http.py", line 260, in _process_flow
[task 2020-02-07T15:10:09.636Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/http.py", line 206, in handle_regular_connect
[task 2020-02-07T15:10:09.636Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/tls.py", line 281, in __call__
[task 2020-02-07T15:10:09.636Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/tls.py", line 369, in _establish_tls_with_client
[task 2020-02-07T15:10:09.637Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/tls.py", line 501, in _find_cert
[task 2020-02-07T15:10:09.637Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/certs.py", line 326, in get_cert
[task 2020-02-07T15:10:09.637Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/certs.py", line 156, in expire
[task 2020-02-07T15:10:09.637Z] 15:10:09    ERROR - mozproxy RuntimeError: dictionary changed size during iteration
[task 2020-02-07T15:10:09.637Z] 15:10:09    ERROR - mozproxy 
[task 2020-02-07T15:10:09.637Z] 15:10:09    ERROR - mozproxy mitmproxy has crashed!
[task 2020-02-07T15:10:09.638Z] 15:10:09    ERROR - mozproxy Please lodge a bug report at: https://github.com/mitmproxy/mitmproxy
[task 2020-02-07T15:10:09.639Z] 15:10:09    ERROR - mozproxy 127.0.0.1:45706: Traceback (most recent call last):
[task 2020-02-07T15:10:09.639Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/server.py", line 121, in handle
[task 2020-02-07T15:10:09.640Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/modes/http_proxy.py", line 9, in __call__
[task 2020-02-07T15:10:09.640Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/tls.py", line 286, in __call__
[task 2020-02-07T15:10:09.641Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/http1.py", line 83, in __call__
[task 2020-02-07T15:10:09.641Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/http.py", line 188, in __call__
[task 2020-02-07T15:10:09.642Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/http.py", line 260, in _process_flow
[task 2020-02-07T15:10:09.643Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/http.py", line 206, in handle_regular_connect
[task 2020-02-07T15:10:09.645Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/tls.py", line 281, in __call__
[task 2020-02-07T15:10:09.646Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/tls.py", line 369, in _establish_tls_with_client
[task 2020-02-07T15:10:09.647Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/proxy/protocol/tls.py", line 501, in _find_cert
[task 2020-02-07T15:10:09.647Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/certs.py", line 326, in get_cert
[task 2020-02-07T15:10:09.648Z] 15:10:09    ERROR - mozproxy   File "mitmproxy/certs.py", line 156, in expire
[task 2020-02-07T15:10:09.648Z] 15:10:09    ERROR - mozproxy RuntimeError: dictionary changed size during iteration
[task 2020-02-07T15:10:09.649Z] 15:10:09    ERROR - mozproxy 
[task 2020-02-07T15:10:13.956Z] 15:10:13     INFO - loaded!
[task 2020-02-07T15:10:29.152Z] 15:10:29     INFO - switching to tab
[task 2020-02-07T15:10:29.153Z] 15:10:29     INFO - switched to tab
[task 2020-02-07T15:10:29.153Z] 15:10:29     INFO - loading https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1

Comment 2

[Intermittent Failures Robot]

6 failures in 3364 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6

Platform breakdown:

• linux1804-64-qr: 3
• windows10-64-qr: 1
• windows7-32-shippable: 1
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-02-03&endday=2020-02-09&tree=all

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+1]]

This is all for AWSY tests and happens with mitmproxy 4.0.4. The code is here:
https://github.com/mitmproxy/mitmproxy/blob/v4.0.4/mitmproxy/proxy/server.py#L121

Are there any plans to upgrade to version 5.0.1?

Comment 4

[Florin Strugariu [:Bebe]]

Yes we should move to 5.0.1 as soon as possibile.
Bug 1614565 - [Mozproxy] Add mitmproxy 5.0.1 capability to mozproxy

Comment 5

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Maybe the upgrade will help, or at least will move the line in server.py. We should keep an eye on it.

Comment 6

[Intermittent Failures Robot]

16 failures in 4690 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 15
• try: 1

Platform breakdown:

• linux1804-64-shippable-qr: 4
• linux1804-64-qr: 1
• windows10-64-qr: 1
• windows10-64-shippable-qr: 2
• windows10-64: 3
• windows7-32: 2
• linux1804-64-shippable: 2
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-02-10&endday=2020-02-16&tree=all

Comment 7

[Intermittent Failures Robot]

15 failures in 4045 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11
• mozilla-central: 3
• try: 1

Platform breakdown:

• windows10-64-shippable: 1
• windows7-32: 3
• linux1804-64-shippable: 2
• linux1804-64-shippable-qr: 3
• linux1804-64: 1
• windows7-32-shippable: 1
• windows10-64-shippable-qr: 1
• windows10-64-qr: 2
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-02-17&endday=2020-02-23&tree=all

Comment 8

[Intermittent Failures Robot]

12 failures in 5233 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• autoland: 10
• mozilla-beta: 1

Platform breakdown:

• linux1804-64-shippable: 3
• linux1804-64-shippable-qr: 2
• windows10-64-shippable: 2
• windows7-32-shippable: 1
• windows7-32: 2
• macosx1014-64-shippable: 1
• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-02-24&endday=2020-03-01&tree=all

Comment 9

[Intermittent Failures Robot]

7 failures in 5483 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7

Platform breakdown:

• windows10-64-qr: 1
• linux1804-64-shippable-qr: 4
• linux1804-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-03-02&endday=2020-03-08&tree=all

Comment 10

[Intermittent Failures Robot]

6 failures in 5336 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• try: 1

Platform breakdown:

• windows7-32: 2
• windows10-64-qr: 2
• linux1804-64-shippable: 1
• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-03-09&endday=2020-03-15&tree=all

Comment 11

[Henrik Skupin [:whimboo][⌚️UTC+1]]

AWSY tests are still using mitmproxy 4.0.4:

[task 2020-03-15T20:08:00.506Z] 20:08:00     INFO - mozproxy mozproxy_dir used for mitmproxy downloads and exe files: Z:\task_1584302545\build\tests\html\testing\mozproxy
[task 2020-03-15T20:08:00.506Z] 20:08:00     INFO - mozproxy Playback tool: mitmproxy
[task 2020-03-15T20:08:00.506Z] 20:08:00     INFO - mozproxy Playback tool version: 4.0.4

Florin, can we get it updated to the new 5.x release, preferable on a new to file bug? Thanks.

Comment 12

[Florin Strugariu [:Bebe]]

@Henrick Thewe where some issues with mitmproxy last week but they should be fixed.

We will move to mitm 5.0.2 after is tested and everything works as expected...

Comment 13

[Intermittent Failures Robot]

7 failures in 4955 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• autoland: 5
• mozilla-central: 1

Platform breakdown:

• macosx1014-64-shippable: 1
• linux1804-64-shippable-qr: 3
• linux1804-64-shippable: 1
• windows10-64-shippable: 1
• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-03-16&endday=2020-03-22&tree=all

Comment 14

[Intermittent Failures Robot]

10 failures in 4773 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-beta: 2
• mozilla-central: 1

Platform breakdown:

• macosx1014-64-shippable: 2
• linux1804-64-shippable-qr: 4
• windows7-32-shippable: 1
• windows10-64-shippable: 2
• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-03-23&endday=2020-03-29&tree=all

Comment 15

[Intermittent Failures Robot]

13 failures in 5015 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11
• mozilla-central: 1
• mozilla-release: 1

Platform breakdown:

• windows10-64-shippable-qr: 3
• linux1804-64-shippable-qr: 6
• windows7-32-shippable: 2
• linux1804-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-03-30&endday=2020-04-05&tree=all

Comment 16

[Intermittent Failures Robot]

9 failures in 4823 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 1
• try: 1
• mozilla-beta: 1

Platform breakdown:

• linux1804-64-shippable-qr: 4
• windows10-64-shippable: 2
• windows7-32-shippable: 1
• linux1804-64: 1
• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-04-06&endday=2020-04-12&tree=all

Comment 17

[Intermittent Failures Robot]

8 failures in 4528 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• try: 2
• autoland: 3
• mozilla-beta: 1

Platform breakdown:

• linux1804-64-shippable: 2
• windows10-64-shippable: 2
• windows7-32-shippable: 2
• linux1804-64-shippable-qr: 1
• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-04-13&endday=2020-04-19&tree=all

Comment 18

[Intermittent Failures Robot]

16 failures in 5582 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 6
• try: 1
• mozilla-beta: 2

Platform breakdown:

• windows10-64-shippable: 2
• linux1804-64-shippable-qr: 4
• windows10-64: 1
• windows7-32-shippable: 2
• linux1804-64-shippable: 3
• windows10-64-shippable-qr: 2
• linux1804-64: 1
• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-04-20&endday=2020-04-26&tree=all

Comment 19

[Intermittent Failures Robot]

11 failures in 5423 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• try: 1
• autoland: 7

Platform breakdown:

• windows7-32-shippable: 4
• linux1804-64-shippable: 1
• windows10-64-shippable-qr: 1
• linux1804-64-shippable-qr: 2
• macosx1014-64-shippable: 2
• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-04-27&endday=2020-05-03&tree=all

Comment 20

[Intermittent Failures Robot]

11 failures in 5276 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• autoland: 6
• mozilla-central: 2
• mozilla-beta: 1

Platform breakdown:

• windows10-64-shippable: 3
• linux1804-64-shippable-qr: 4
• linux1804-64-shippable: 1
• windows7-32-shippable: 2
• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-05-04&endday=2020-05-10&tree=all

Comment 21

[Intermittent Failures Robot]

3 failures in 5488 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• linux1804-64-shippable-qr: 1
• macosx1014-64-shippable: 1
• linux1804-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-05-11&endday=2020-05-17&tree=all

Comment 22

[Intermittent Failures Robot]

4 failures in 4727 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 3

Platform breakdown:

• windows10-64-shippable-qr: 1
• macosx1014-64-shippable: 2
• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-05-18&endday=2020-05-24&tree=all

Comment 23

[Intermittent Failures Robot]

3 failures in 5458 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 1

Platform breakdown:

• windows10-64-shippable: 1
• windows10-64-shippable-qr: 1
• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-05-25&endday=2020-05-31&tree=all

Comment 24

[Intermittent Failures Robot]

5 failures in 4949 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 1

Platform breakdown:

• windows10-64-shippable: 1
• linux1804-64-shippable-qr: 1
• macosx1014-64-shippable: 2
• linux1804-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-06-01&endday=2020-06-07&tree=all

Comment 25

[Intermittent Failures Robot]

5 failures in 5211 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 2
• try: 1

Platform breakdown:

• linux1804-64-shippable-qr: 1
• windows10-64-shippable-qr: 1
• windows7-32-shippable: 2
• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-06-08&endday=2020-06-14&tree=all

Comment 26

[Intermittent Failures Robot]

10 failures in 4035 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-beta: 1
• try: 1

Platform breakdown:

• windows10-64-shippable: 4
• windows7-32-shippable: 3
• windows10-64-shippable-qr: 2
• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-06-15&endday=2020-06-21&tree=all

Comment 27

[Intermittent Failures Robot]

8 failures in 5252 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 1
• try: 1

Platform breakdown:

• windows7-32-shippable: 2
• windows10-64-shippable-qr: 2
• windows10-64-shippable: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-06-22&endday=2020-06-28&tree=all

Comment 28

[Intermittent Failures Robot]

2 failures in 4516 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• windows10-64-shippable-qr: 1
• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-06-29&endday=2020-07-05&tree=all

Comment 29

[Intermittent Failures Robot]

3 failures in 5265 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2
• autoland: 1

Platform breakdown:

• windows10-64-shippable-qr: 2
• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-07-06&endday=2020-07-12&tree=all

Comment 30

[Intermittent Failures Robot]

5 failures in 4014 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 2

Platform breakdown:

• windows10-64-shippable-qr: 1
• linux1804-64-shippable: 2
• macosx1014-64-shippable: 1
• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-07-13&endday=2020-07-19&tree=all

Comment 31

[Intermittent Failures Robot]

2 failures in 4310 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform breakdown:

• linux1804-64-shippable: 1
• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-07-20&endday=2020-07-26&tree=all

Comment 32

[Intermittent Failures Robot]

6 failures in 4289 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 3
• autoland: 1
• try: 1
• mozilla-central: 1

Platform breakdown:

• windows7-32-shippable: 2
• windows10-64-shippable: 1
• windows10-64-shippable-qr: 1
• macosx1014-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-07-27&endday=2020-08-02&tree=all

Comment 33

[Intermittent Failures Robot]

2 failures in 4618 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-beta: 1

Platform breakdown:

• macosx1014-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-08-03&endday=2020-08-09&tree=all

Comment 34

[Intermittent Failures Robot]

1 failures in 3601 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-08-10&endday=2020-08-16&tree=all

Comment 35

[Intermittent Failures Robot]

2 failures in 4046 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• mozilla-beta: 1

Platform breakdown:

• windows10-64-shippable-qr: 1
• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-08-24&endday=2020-08-30&tree=all

Comment 36

[Intermittent Failures Robot]

1 failures in 2984 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-08-31&endday=2020-09-06&tree=all

Comment 37

[Intermittent Failures Robot]

5 failures in 3410 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 2
• mozilla-beta: 1
• try: 1

Platform breakdown:

• linux1804-64-shippable-qr: 2
• windows10-64-shippable-qr: 2
• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-09-07&endday=2020-09-13&tree=all

Comment 38

[Intermittent Failures Robot]

1 failures in 3760 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-09-14&endday=2020-09-20&tree=all

Comment 39

[Intermittent Failures Robot]

1 failures in 4019 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-09-21&endday=2020-09-27&tree=all

Comment 40

[Intermittent Failures Robot]

2 failures in 4195 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• autoland: 1

Platform breakdown:

• linux1804-64-shippable: 1
• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-09-28&endday=2020-10-04&tree=all

Comment 41

[Intermittent Failures Robot]

7 failures in 4130 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• autoland: 5
• try: 1

Platform breakdown:

• windows10-64-shippable: 1
• macosx1014-64-shippable: 2
• linux1804-64-shippable-qr: 1
• windows7-32-shippable: 1
• windows10-64-shippable-qr: 1
• linux1804-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-10-05&endday=2020-10-11&tree=all

Comment 42

[Intermittent Failures Robot]

1 failures in 3694 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-10-12&endday=2020-10-18&tree=all

Comment 43

[Intermittent Failures Robot]

2 failures in 4230 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• macosx1014-64-shippable: 1
• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-10-19&endday=2020-10-25&tree=all

Comment 44

[Intermittent Failures Robot]

1 failures in 4275 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-10-26&endday=2020-11-01&tree=all

Comment 45

[Intermittent Failures Robot]

2 failures in 4128 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-beta: 1

Platform breakdown:

• windows10-64-shippable-qr: 1
• linux1804-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1613972&startday=2020-11-02&endday=2020-11-08&tree=all

Comment 46

[Intermittent Failures Robot]

1 failures in 4040 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1613972&startday=2020-11-09&endday=2020-11-15&tree=all

Comment 47

[Intermittent Failures Robot]

1 failures in 4810 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1613972&startday=2020-11-16&endday=2020-11-22&tree=all

Comment 48

[Intermittent Failures Robot]

2 failures in 1479 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• try: 1

Platform breakdown:

• linux1804-64-shippable-qr: 1
• linux1804-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1613972&startday=2020-11-23&endday=2020-11-29&tree=all

Comment 49

[Intermittent Failures Robot]

1 failures in 3712 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1613972&startday=2020-11-30&endday=2020-12-06&tree=all

Comment 50

[Intermittent Failures Robot]

3 failures in 3421 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-beta: 1

Platform breakdown:

• macosx1014-64-shippable-qr: 1
• windows10-64-shippable: 1
• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1613972&startday=2020-12-14&endday=2020-12-20&tree=all