1603237 - Intermittent bugs/605138-1.html == bugs/605138-1-ref.html | image comparison, max difference: 11, number of differing pixels: x

Status: RESOLVED INCOMPLETE

(Core :: Layout, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: dvarga [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=280727570&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/JNyTxVl9TbednHZEBKR1eA/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/JNyTxVl9TbednHZEBKR1eA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

Comment 1

[Intermittent Failures Robot]

8 failures in 4867 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2019-12-09&endday=2019-12-15&tree=all

Comment 2

[Intermittent Failures Robot]

6 failures in 4582 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2019-12-16&endday=2019-12-22&tree=all

Comment 3

[Intermittent Failures Robot]

5 failures in 1365 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2019-12-23&endday=2019-12-29&tree=all

Comment 4

[Intermittent Failures Robot]

8 failures in 4472 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-01-06&endday=2020-01-12&tree=all

Comment 5

[Intermittent Failures Robot]

9 failures in 3773 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 2

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 2
• android-hw-p2-8-0-android-aarch64-qr: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-01-13&endday=2020-01-19&tree=all

Comment 6

[Intermittent Failures Robot]

10 failures in 4004 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• autoland: 6

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 9
• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-01-20&endday=2020-01-26&tree=all

Comment 7

[Cristina Coroiu [:ccoroiu]]

Done the retriggers on central:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&searchStr=linux%2C18.04%2Cx64%2Cquantumrender%2Cshippable%2Copt%2Creftests%2Ctest-linux1804-64-shippable-qr%2Fopt-reftest-e10s-8%2Cr%28r8%29&fromchange=3c25ab24bcda1aba845a0266071741a3b17e908d&selectedJob=287024380

Autoland:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=Linux%2C18.04%2Cx64%2CQuantumRender%2CShippable%2Copt%2CReftests%2Ctest-linux1804-64-shippable-qr%2Fopt-reftest-e10s-8%2CR%28R8%29&tochange=1343555236b2ea97b1786c0635973f64c21c3213&fromchange=c06f42caa50864b4388a89673ae0b12c82c3a5ca&selectedJob=287021072

The culprit seems to be bug 1611660
https://hg.mozilla.org/integration/autoland/rev/9dc9deb3ba3bdfb7875b8259308d31ec46f4d6d1

Comment 8

[Cristina Coroiu [:ccoroiu]]

Should be fixed by backout: https://hg.mozilla.org/integration/autoland/rev/3c7cdd9f7b803c14af51d263f6fa62d4623c00a8

Comment 9

[Intermittent Failures Robot]

27 failures in 483 pushes (0.056 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• mozilla-central: 14

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 1
• windows10-64-shippable-qr: 4
• linux1804-64-qr: 5
• linux1804-64-asan-qr: 2
• linux1804-64-shippable-qr: 13
• windows10-64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-01-30&endday=2020-01-30&tree=all

Comment 10

[Andreea Pavel [:apavel]]

I don't think this was fixed by backout, test moved chunks and platforms

https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&selectedJob=287072762&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception%2Cusercancel%2Crunnable&classifiedState=unclassified&tochange=b2b07e0f2dd02f05438dc9dc1e3222896e79683e&fromchange=228931ff1d49b0c474afe1b778218c7cbbb4254e&searchStr=android-hw-p2-8-0-android-aarch64-qr%2Copt%2Creftests%2Ctest-android-hw-p2-8-0-android-aarch64-qr%2Fopt-geckoview-reftest-e10s-3%2Cr%28r3%29

Natalia can you please continue to look into this?

Comment 11

[Natalia Csoregi [:nataliaCs]]

Continued r/b but it looks like the frequency is not that high, on most of the retrigger results it was 2-3 failures over 21 retriggers.
As Andreea said, it moves chunks and platforms which makes it a bit difficult to bisect as it would take a number of ~20 retriggers/job/platform.

Retriggered and backfilled on pushes before https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=9dc9deb3ba3bdfb7875b8259308d31ec46f4d6d1&selectedJob=287022561 - Bug 1611660 .
Last r/b got to https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=android%2C8.0%2Cpixel2%2Cquantumrender%2Copt%2Creftests%2Ctest-android-hw-p2-8-0-arm7-api-16-qr%2Fopt-geckoview-reftest-e10s-3%2Cr%28r3%29&tochange=ed4cadb326afe38a610445b64c0e8aae9a4c78ec&fromchange=a752d438b0176eef5e241cebd4c6f119f5a21b37&selectedJob=287120266

Comment 12

[Cristina Coroiu [:ccoroiu]]

The backout fixed the last 2 days spike, there were more than 30 failures in 24 hours, by comparison to the last 3 months when there were 82 failures.
Retriggeres after the backout was merged: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&searchStr=linux%2C18.04%2Cx64%2Cquantumrender%2Cshippable%2Copt%2Creftests%2Ctest-linux1804-64-shippable-qr%2Fopt-reftest-e10s-8%2Cr%28r8%29&fromchange=3c25ab24bcda1aba845a0266071741a3b17e908d&selectedJob=287065073

Started to frequently fail with this push: https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=9dc9deb3ba3bdfb7875b8259308d31ec46f4d6d1, failed not only on Linux 18.04 x64 QuantumRender Shippable opt but also for Windows 10 x64 QuantumRender Shippable opt and other, multiple reftests tier1 and tier2.

As Natalia mentioned, the failure rate was not that high before, but I've continued r/b up to:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=Android%2C8.0%2CPixel2%2CQuantumRender%2Copt%2CReftests%2Ctest-android-hw-p2-8-0-arm7-api-16-qr%2Fopt-geckoview-reftest-e10s-3%2CR%28R3%29&tochange=bc5880b621d585ca49be49e07ee14dd32153c01b&fromchange=a8df7fffc6251beb500f194f84a8888d6bb12f09&selectedJob=287230066

Comment 13

[Intermittent Failures Robot]

36 failures in 2190 pushes (0.016 failures/push) were associated with this bug in the last 7 days.

This is the #11 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 15
• mozilla-central: 21

Platform breakdown:

• android-em-7-0-x86_64: 1
• android-hw-p2-8-0-android-aarch64-qr: 8
• linux1804-64-qr: 5
• linux1804-64-asan-qr: 2
• windows10-64-shippable-qr: 5
• linux1804-64-shippable-qr: 13
• windows10-64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-01-27&endday=2020-02-02&tree=all

Comment 14

[Intermittent Failures Robot]

4 failures in 3364 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 3

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 3
• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-02-03&endday=2020-02-09&tree=all

Comment 15

[Intermittent Failures Robot]

6 failures in 4690 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• try: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-02-10&endday=2020-02-16&tree=all

Comment 16

[Intermittent Failures Robot]

11 failures in 4045 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• mozilla-central: 2

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-02-17&endday=2020-02-23&tree=all

Comment 17

[Intermittent Failures Robot]

13 failures in 5233 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 13

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-02-24&endday=2020-03-01&tree=all

Comment 18

[Intermittent Failures Robot]

18 failures in 5483 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 12
• mozilla-central: 6

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 18

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-03-02&endday=2020-03-08&tree=all

Comment 19

[Intermittent Failures Robot]

11 failures in 5336 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• autoland: 6
• mozilla-beta: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-03-09&endday=2020-03-15&tree=all

Comment 20

[Intermittent Failures Robot]

17 failures in 4955 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11
• mozilla-central: 3
• mozilla-beta: 2
• try: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-03-16&endday=2020-03-22&tree=all

Comment 21

[Intermittent Failures Robot]

14 failures in 4773 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11
• mozilla-central: 2
• mozilla-beta: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-03-23&endday=2020-03-29&tree=all

Comment 22

[Intermittent Failures Robot]

14 failures in 5015 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11
• mozilla-central: 3

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-03-30&endday=2020-04-05&tree=all

Comment 23

[Intermittent Failures Robot]

2 failures in 4823 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-04-06&endday=2020-04-12&tree=all

Comment 24

[Intermittent Failures Robot]

3 failures in 4528 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-beta: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-04-13&endday=2020-04-19&tree=all

Comment 25

[Intermittent Failures Robot]

7 failures in 5582 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-beta: 1
• try: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-04-20&endday=2020-04-26&tree=all

Comment 26

[Intermittent Failures Robot]

9 failures in 5423 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-04-27&endday=2020-05-03&tree=all

Comment 27

[Bogdan Tara[:bogdan_tara | bogdant]]

In the last 7 days there have been 28 occurrences, all on android-hw-p2-8-0-android-aarch64-qr opt.

Recent failure: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=301554759&repo=autoland&lineNumber=10648

Comment 28

[Dorel Luca [:dluca]]

Retriggers show that this push could be the cause of the recent spike in this intermittent: https://treeherder.mozilla.org/#/jobs?repo=autoland&selectedTaskRun=AQINmkLCSW6HhbDCPaB0hQ-0&searchStr=reftest%2Candroid%2C8.0&revision=2c28e44f5823573216b029351b0ffd7509313c40

Retriggers:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=reftest%2Candroid%2C8.0&tochange=67b2b97539bd1a13a68a84d8aee7b3f613a5985b&fromchange=e88b38c4bd48f06866439254af0bb5f26aef6511&selectedTaskRun=cRyvvE7oRQGriy9juuUgtA-0

Timothy: Could you please take a look at this bug?

Comment 29

[Timothy Nikkel (:tnikkel)]

There aren't any images in that test so I don't think the linked push could cause this.

I notice that in the reftest manifest this test is listed as

fuzzy-if(geckoview&&webrender&&emulator,0-11,0-632)

and the failing tests match all of that except emulator.

Comment 30

[Andreea Pavel [:apavel]]

Continued with retriggers: https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&searchStr=reftest%2Candroid%2C8.0&fromchange=6e2d679c71681402c99bc6263e003d56aed9313c&tochange=bb8563a03d7ec2ef0fe1382d64e3caaaa9632b4b&selectedTaskRun=fdledl31TH2ZhmCQ9UPCDQ-0

Seems like the failure rate increased somewhere between Bug 1625696 and Bug 1634093, based on above.

Comment 31

[Intermittent Failures Robot]

27 failures in 5276 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3
• autoland: 23
• mozilla-beta: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 27

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-05-04&endday=2020-05-10&tree=all

Comment 32

[Intermittent Failures Robot]

9 failures in 5488 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 3
• mozilla-beta: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-05-11&endday=2020-05-17&tree=all

Comment 33

[Intermittent Failures Robot]

4 failures in 4727 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• mozilla-beta: 3

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-05-18&endday=2020-05-24&tree=all

Comment 34

[Intermittent Failures Robot]

2 failures in 5458 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• android-em-7-0-x86_64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-05-25&endday=2020-05-31&tree=all

Comment 35

[Intermittent Failures Robot]

2 failures in 4949 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• windows10-64: 1
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-06-01&endday=2020-06-07&tree=all

Comment 36

[Intermittent Failures Robot]

6 failures in 5211 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 4
• windows10-64-ccov: 1
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-06-08&endday=2020-06-14&tree=all

Comment 37

[Intermittent Failures Robot]

4 failures in 4035 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 2

Platform breakdown:

• windows10-64: 2
• linux1804-64-asan: 1
• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-06-15&endday=2020-06-21&tree=all

Comment 38

[Intermittent Failures Robot]

7 failures in 5252 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• autoland: 5

Platform breakdown:

• linux1804-64-asan: 5
• android-em-7-0-x86_64: 1
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-06-22&endday=2020-06-28&tree=all

Comment 39

[Intermittent Failures Robot]

1 failures in 4516 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-06-29&endday=2020-07-05&tree=all

Comment 40

[Intermittent Failures Robot]

11 failures in 5265 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-beta: 2
• mozilla-central: 2
• try: 1

Platform breakdown:

• linux1804-64-asan: 5
• linux1804-64: 3
• windows10-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-07-06&endday=2020-07-12&tree=all

Comment 41

[Intermittent Failures Robot]

4 failures in 4014 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform breakdown:

• linux1804-64-asan: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-07-13&endday=2020-07-19&tree=all

Comment 42

[Intermittent Failures Robot]

5 failures in 4310 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• mozilla-central: 1
• autoland: 3

Platform breakdown:

• linux1804-64-asan: 4
• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-07-20&endday=2020-07-26&tree=all

Comment 43

[Intermittent Failures Robot]

6 failures in 4289 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-beta: 1

Platform breakdown:

• linux1804-64-asan: 4
• windows10-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-07-27&endday=2020-08-02&tree=all

Comment 44

[Intermittent Failures Robot]

7 failures in 4618 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 5
• windows10-64: 1
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-08-03&endday=2020-08-09&tree=all

Comment 45

[Intermittent Failures Robot]

4 failures in 3601 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-08-10&endday=2020-08-16&tree=all

Comment 46

[Intermittent Failures Robot]

5 failures in 4100 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 1
• try: 2

Platform breakdown:

• linux1804-64: 2
• linux1804-64-asan: 1
• windows10-64: 1
• linux1804-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-08-17&endday=2020-08-23&tree=all

Comment 47

[Intermittent Failures Robot]

4 failures in 4046 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2
• mozilla-central: 1
• autoland: 1

Platform breakdown:

• linux1804-64-asan: 3
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-08-24&endday=2020-08-30&tree=all

Comment 48

[Intermittent Failures Robot]

4 failures in 2984 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform breakdown:

• linux1804-64-asan: 3
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-08-31&endday=2020-09-06&tree=all

Comment 49

[Intermittent Failures Robot]

3 failures in 3410 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-09-07&endday=2020-09-13&tree=all

Comment 50

[Intermittent Failures Robot]

4 failures in 4019 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1
• mozilla-central: 2
• autoland: 1

Platform breakdown:

• linux1804-64: 1
• linux1804-64-asan: 2
• linux1804-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-09-21&endday=2020-09-27&tree=all

Comment 51

[Intermittent Failures Robot]

4 failures in 4195 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 1
• mozilla-beta: 1

Platform breakdown:

• linux1804-64-asan: 2
• linux1804-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-09-28&endday=2020-10-04&tree=all

Comment 52

[Intermittent Failures Robot]

4 failures in 4130 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• try: 2

Platform breakdown:

• linux1804-64-asan: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-10-05&endday=2020-10-11&tree=all

Comment 53

[Intermittent Failures Robot]

1 failures in 3694 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-10-12&endday=2020-10-18&tree=all

Comment 54

[Intermittent Failures Robot]

7 failures in 4230 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3
• autoland: 3
• mozilla-beta: 1

Platform breakdown:

• linux1804-64-asan: 5
• linux1804-64: 1
• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-10-19&endday=2020-10-25&tree=all

Comment 55

[Intermittent Failures Robot]

2 failures in 4275 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• linux1804-64-asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-10-26&endday=2020-11-01&tree=all

Comment 56

[Intermittent Failures Robot]

3 failures in 4128 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-beta: 1
• try: 1

Platform breakdown:

• android-em-7-0-x86_64: 1
• linux1804-64-asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1603237&startday=2020-11-02&endday=2020-11-08&tree=all

Comment 57

[Intermittent Failures Robot]

6 failures in 4040 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• try: 1
• autoland: 2

Platform breakdown:

• linux1804-64-asan: 4
• android-em-7-0-x86_64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1603237&startday=2020-11-09&endday=2020-11-15&tree=all

Comment 58

[Intermittent Failures Robot]

2 failures in 4810 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• mozilla-beta: 1

Platform breakdown:

• linux1804-64-asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1603237&startday=2020-11-16&endday=2020-11-22&tree=all

Comment 59

[Intermittent Failures Robot]

5 failures in 1479 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1
• try: 1

Platform breakdown:

• linux1804-64-asan: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1603237&startday=2020-11-23&endday=2020-11-29&tree=all

Comment 60

[Intermittent Failures Robot]

3 failures in 3712 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 2
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1603237&startday=2020-11-30&endday=2020-12-06&tree=all

Comment 61

[Intermittent Failures Robot]

3 failures in 4060 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• autoland: 2

Platform breakdown:

• linux1804-64-asan: 1
• linux1804-64: 1
• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1603237&startday=2020-12-07&endday=2020-12-13&tree=all

Comment 62

[Intermittent Failures Robot]

7 failures in 3421 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2
• mozilla-central: 3
• autoland: 2

Platform breakdown:

• linux1804-64-asan: 6
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1603237&startday=2020-12-14&endday=2020-12-20&tree=all

Comment 63

[Intermittent Failures Robot]

4 failures in 1450 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• try: 2

Platform breakdown:

• linux1804-64-asan: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1603237&startday=2020-12-21&endday=2020-12-27&tree=all

Comment 64

[Intermittent Failures Robot]

1 failures in 525 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1603237&startday=2020-12-28&endday=2021-01-03&tree=all

Comment 65

[Intermittent Failures Robot]

3 failures in 2956 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• linux1804-64-asan: 2
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1603237&startday=2021-01-04&endday=2021-01-10&tree=all

Comment 66

[Intermittent Failures Robot]

1 failures in 3810 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1603237&startday=2021-01-11&endday=2021-01-17&tree=all

Comment 67

[Intermittent Failures Robot]

5 failures in 3488 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 2

Platform and build breakdown:

• windows7-32: 1
  • debug: 1
• linux1804-64-asan: 3
  • opt: 3
• linux1804-64: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1603237&startday=2021-01-18&endday=2021-01-24&tree=all

Comment 68

[Intermittent Failures Robot]

3 failures in 3891 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform and build breakdown:

• linux1804-64: 1
  • debug: 1
• linux1804-64-asan: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1603237&startday=2021-01-25&endday=2021-01-31&tree=all

Comment 69

[Intermittent Failures Robot]

1 failures in 4322 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform and build breakdown:

• linux1804-64: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1603237&startday=2021-02-08&endday=2021-02-14&tree=all

Comment 70

[Intermittent Failures Robot]

1 failures in 4327 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1603237&startday=2021-02-22&endday=2021-02-28&tree=all

Comment 71

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.