1540635 - Intermittent bugs/1295466-1.xhtml == bugs/1295466-1-ref.xhtml | image comparison, max difference: 14, number of differing pixels: 215

Status: RESOLVED INCOMPLETE

(Core :: Layout, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: shindli [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=237268780&repo=autoland

https://queue.taskcluster.net/v1/task/Auzn6gZLQFuJvqegkrj4xA/runs/0/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/Auzn6gZLQFuJvqegkrj4xA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2019-04-01T08:00:18.103Z] 08:00:18 INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1295466-1.xhtml | 1960 / 2057 (95%)
[task 2019-04-01T08:00:18.152Z] 08:00:18 INFO - ++DOMWINDOW == 145 (0x7f7fc24e6800) [pid = 1282] [serial = 5483] [outer = 0x7f7fc41f8d40]
[task 2019-04-01T08:00:18.438Z] 08:00:18 WARNING - REFTEST WARNING | [CONTENT] MozInvalidateEvent didn't invalidate
[task 2019-04-01T08:00:18.464Z] 08:00:18 INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1295466-1-ref.xhtml | 1960 / 2057 (95%)
[task 2019-04-01T08:00:18.504Z] 08:00:18 INFO - ++DOMWINDOW == 146 (0x7f7fbfd9b000) [pid = 1282] [serial = 5484] [outer = 0x7f7fc41f8d40]
[task 2019-04-01T08:00:18.606Z] 08:00:18 INFO - REFTEST INFO | REFTEST fuzzy test (0, 0) <= (14, 215) <= (15, 50)
[task 2019-04-01T08:00:18.887Z] 08:00:18 INFO - REFTEST TEST-UNEXPECTED-FAIL | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1295466-1.xhtml == file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/bugs/1295466-1-ref.xhtml | image comparison, max difference: 14, number of differing pixels: 215

Comment 1

[Intermittent Failures Robot]

30 failures in 2843 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 11
• try: 5
• mozilla-central: 11
• mozilla-inbound: 3

Platform breakdown:

• linux64: 14
• linux32-shippable: 9
• linux64-shippable: 2
• linux32: 2
• linux64-devedition: 1
• linux64-ccov: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540635&startday=2019-04-01&endday=2019-04-07&tree=all

Comment 2

[Intermittent Failures Robot]

37 failures in 3025 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 9
• try: 5
• mozilla-inbound: 6
• autoland: 17

Platform breakdown:

• linux32: 21
• linux64: 13
• linux32-shippable: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540635&startday=2019-04-08&endday=2019-04-14&tree=all

Comment 3

[Intermittent Failures Robot]

19 failures in 607 pushes (0.031 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 4
• autoland: 11
• mozilla-inbound: 3
• try: 1

Platform breakdown:

• linux64: 11
• linux32: 4
• linux32-shippable: 2
• linux64-shippable: 1
• linux64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540635&startday=2019-04-16&endday=2019-04-16&tree=all

Comment 4

[Intermittent Failures Robot]

57 failures in 2673 pushes (0.021 failures/push) were associated with this bug in the last 7 days.

This is the #37 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 34
• mozilla-central: 9
• mozilla-inbound: 8
• try: 6

Platform breakdown:

• linux32: 13
• linux64: 36
• linux32-shippable: 4
• linux64-shippable: 3
• linux64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540635&startday=2019-04-15&endday=2019-04-21&tree=all

Comment 5

[Intermittent Failures Robot]

62 failures in 3031 pushes (0.02 failures/push) were associated with this bug in the last 7 days.

This is the #34 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-central: 14
• autoland: 29
• try: 9
• mozilla-inbound: 10

Platform breakdown:

• linux64: 31
• linux32: 28
• linux32-shippable: 1
• linux32-devedition: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540635&startday=2019-04-22&endday=2019-04-28&tree=all

Comment 6

[Cosmin Sabou [:CosminS]]

This has failed 161 times in the last 30 days, it's now on disable recommended bugs list. Sean, could you please redirect this to someone to take a look or it will be disabled in 2 days. Thank you.

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=243192178&repo=mozilla-inbound&lineNumber=23375

Comment 7

[Daniel Varga [:dvarga]]

Attachment: Bug 1540635 - Fuzzy-if 1295466-1.xhtml on linux for frequent failures.

Comment 8

[Intermittent Failures Robot]

15 failures in 772 pushes (0.019 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-inbound: 6
• mozilla-central: 3
• autoland: 6

Platform breakdown:

• linux64: 6
• linux32: 7
• linux64-shippable: 1
• linux32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540635&startday=2019-04-30&endday=2019-04-30&tree=all

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/cec83984a5aa
Fuzzy-if 1295466-1.xhtml on linux for frequent failures. r=jmaher

Comment 10

[Pulsebot]

Backout by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/9010230aec8a
Backed out changeset cec83984a5aa for reftest mass failures on layout/reftests/bugs/reftest.list. CLOSED TREE

Comment 11

[Cosmin Sabou [:CosminS]]

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&resultStatus=testfailed%2Cbusted%2Cexception&searchStr=reftest&tochange=9010230aec8a82e3444fa368484b1cb20b76e968&fromchange=cec83984a5aa181d23d1dbdaeb6bf3e5a49403b9&selectedJob=243944300

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=243944300&repo=autoland&lineNumber=1470

[task 2019-05-01T16:00:07.672Z] 16:00:07 ERROR - REFTEST ERROR | EXCEPTION: ReferenceError: gtkwidget is not defined
[task 2019-05-01T16:00:09.020Z] 16:00:09 INFO - --DOCSHELL 0xdd695000 == 12 [pid = 986] [id = {7317bf51-d6f0-4354-9d46-6ca9662eb043}] [url = about:blank]
[task 2019-05-01T16:00:10.289Z] 16:00:10 INFO - --DOCSHELL 0xddd45400 == 11 [pid = 986] [id = {f66a95d3-bd1b-427f-a352-8949b1731825}] [url = chrome://browser/content/browser.xul]
[task 2019-05-01T16:00:10.292Z] 16:00:10 INFO - --DOCSHELL 0xdb921400 == 10 [pid = 986] [id = {c46b0450-2c3c-49e1-9f97-9ae63937449f}] [url = about:blank]
[task 2019-05-01T16:00:10.410Z] 16:00:10 INFO - --DOMWINDOW == 34 (0xdbfc2230) [pid = 986] [serial = 17] [outer = (nil)] [url = about:blank]
[task 2019-05-01T16:00:10.413Z] 16:00:10 INFO - --DOMWINDOW == 33 (0xddad3570) [pid = 986] [serial = 3] [outer = (nil)] [url = about:blank]
[task 2019-05-01T16:00:11.833Z] 16:00:11 INFO - --DOMWINDOW == 32 (0xda0e8c00) [pid = 986] [serial = 26] [outer = (nil)] [url = about:blank]
[task 2019-05-01T16:00:11.834Z] 16:00:11 INFO - --DOMWINDOW == 31 (0xdb92a000) [pid = 986] [serial = 23] [outer = (nil)] [url = about:blank]
[task 2019-05-01T16:00:11.834Z] 16:00:11 INFO - --DOMWINDOW == 30 (0xdcba3800) [pid = 986] [serial = 5] [outer = (nil)] [url = about:blank]
[task 2019-05-01T16:00:11.835Z] 16:00:11 INFO - --DOMWINDOW == 29 (0xdca74400) [pid = 986] [serial = 12] [outer = (nil)] [url = about:blank]
[task 2019-05-01T16:00:11.836Z] 16:00:11 INFO - --DOMWINDOW == 28 (0xdca79800) [pid = 986] [serial = 13] [outer = (nil)] [url = about:blank]
[task 2019-05-01T16:00:11.836Z] 16:00:11 INFO - --DOMWINDOW == 27 (0xdca7a400) [pid = 986] [serial = 14] [outer = (nil)] [url = about:blank]
[task 2019-05-01T16:00:11.836Z] 16:00:11 INFO - --DOMWINDOW == 26 (0xdca7b400) [pid = 986] [serial = 15] [outer = (nil)] [url = about:blank]
[task 2019-05-01T16:00:11.836Z] 16:00:11 INFO - --DOMWINDOW == 25 (0xdca7c400) [pid = 986] [serial = 16] [outer = (nil)] [url = about:blank]
[task 2019-05-01T16:00:11.837Z] 16:00:11 INFO - --DOMWINDOW == 24 (0xdb48a400) [pid = 986] [serial = 27] [outer = (nil)] [url = about:blank]
[task 2019-05-01T16:00:11.837Z] 16:00:11 INFO - --DOMWINDOW == 23 (0xdb5ae800) [pid = 986] [serial = 24] [outer = (nil)] [url = about:blank]
[task 2019-05-01T16:00:11.838Z] 16:00:11 INFO - --DOMWINDOW == 22 (0xd471c800) [pid = 986] [serial = 34] [outer = (nil)] [url = about:blank]
[task 2019-05-01T16:00:16.093Z] 16:00:16 INFO - [986, StreamTrans #4] WARNING: 'NS_FAILED(rv)', file /builds/worker/workspace/build/src/modules/libjar/nsJARChannel.cpp, line 371
[task 2019-05-01T16:00:16.094Z] 16:00:16 INFO - [986, Main Thread] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x80520012: file /builds/worker/workspace/build/src/modules/libjar/nsJARChannel.cpp, line 994
[task 2019-05-01T16:02:56.289Z] 16:02:56 INFO - [986, Main Thread] WARNING: Suboptimal indexes for the SQL statement 0xd611d580 (http://mzl.la/1FuID0j).: file /builds/worker/workspace/build/src/storage/mozStoragePrivateHelpers.cpp, line 108
[task 2019-05-01T16:19:36.302Z] 16:19:36 INFO - Automation Error: mozprocess timed out after 1000 seconds running ['/builds/worker/workspace/build/venv/bin/python', '-u', '/builds/worker/workspace/build/tests/reftest/runreftest.py', '--disable-e10s', '--total-chunks', '8', '--this-chunk', '6', '--appname=/builds/worker/workspace/build/application/firefox/firefox', '--utility-path=tests/bin', '--extra-profile-file=tests/bin/plugins', '--symbols-path=/builds/worker/workspace/build/symbols', '--log-raw=/builds/worker/workspace/build/blobber_upload_dir/reftest_raw.log', '--log-errorsummary=/builds/worker/workspace/build/blobber_upload_dir/reftest_errorsummary.log', '--cleanup-crashes', '--marionette-startup-timeout=180', '--sandbox-read-whitelist=/builds/worker/workspace/build', '--log-raw=-', '--suite=reftest', '--setpref=layers.acceleration.force-enabled=true', '--', 'tests/reftest/tests/layout/reftests/reftest.list']
[task 2019-05-01T16:19:36.306Z] 16:19:36 ERROR - timed out after 1000 seconds of no output
[task 2019-05-01T16:19:36.306Z] 16:19:36 ERROR - Return code: -15
[task 2019-05-01T16:19:36.316Z] 16:19:36 ERROR - No checks run.
[task 2019-05-01T16:19:36.316Z] 16:19:36 ERROR - No suite end message was emitted by this harness.

The problem here was that gtkWidget was written with small cap w as in fuzzy-if(gtkwidget ... searchfox shows that doesn't exist in the code https://searchfox.org/mozilla-central/search?q=gtkwidget&case=true&regexp=false&path=.list

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e2cca2f460bc
Fuzzy-if 1295466-1.xhtml on linux for frequent failures. r=jmaher

Comment 13

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/e2cca2f460bc

Comment 14

[Intermittent Failures Robot]

31 failures in 4131 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 20
• mozilla-inbound: 7
• mozilla-central: 3
• try: 1

Platform breakdown:

• linux32: 15
• linux64-shippable: 3
• linux64: 11
• linux32-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540635&startday=2019-04-29&endday=2019-05-05&tree=all

Comment 15

[Intermittent Failures Robot]

1 failures in 4705 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1

Platform breakdown:

• linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540635&startday=2019-05-06&endday=2019-05-12&tree=all

Comment 16

[Intermittent Failures Robot]

17 failures in 4730 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 17

Platform breakdown:

• linux64: 7
• android-em-4-3-armv7-api16: 3
• linux64-qr: 1
• windows10-64: 4
• linux64-shippable-qr: 1
• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540635&startday=2019-05-20&endday=2019-05-26&tree=all

Comment 17

[BugBot [:suhaib / :marco/ :calixte]]

There's a r+ patch which didn't land and no activity in this bug for 2 weeks.
:dvarga, could you have a look please?
For more information, please visit auto_nag documentation.

Comment 18

[Andreea Pavel [:apavel]]

Calixte, can you take a look at the above comment? the patch seems to have landed in comment12.

Is it because the author in the push is not Dani but Cosmin?

Comment 19

[Andreea Pavel [:apavel]]

Filed bug 1558168 for the above.

Comment 20

[Intermittent Failures Robot]

1 failures in 4753 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540635&startday=2019-06-10&endday=2019-06-16&tree=all

Comment 21

[Intermittent Failures Robot]

1 failures in 5336 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540635&startday=2020-03-09&endday=2020-03-15&tree=all

Comment 22

[Intermittent Failures Robot]

1 failures in 5015 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540635&startday=2020-03-30&endday=2020-04-05&tree=all

Comment 23

[Intermittent Failures Robot]

1 failures in 4618 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540635&startday=2020-08-03&endday=2020-08-09&tree=all

Comment 24

[Intermittent Failures Robot]

15 failures in 3810 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 12
• mozilla-central: 3

Platform breakdown:

• windows7-32: 14
• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-01-11&endday=2021-01-17&tree=all

Comment 25

[Intermittent Failures Robot]

38 failures in 3488 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #32 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 33
• try: 2
• mozilla-release: 1
• mozilla-central: 2

Platform and build breakdown:

• windows7-32: 35
  • debug: 28
  • opt: 7
• windows7-32-shippable: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-01-18&endday=2021-01-24&tree=all

Comment 26

[Andreea Pavel [:apavel]]

There are 38 total failures in the last 7 days on windows7-32 debug and windows7-32-shippable opt.

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=327641731&repo=autoland&lineNumber=15148

[task 2021-01-24T20:49:15.392Z] 20:49:15 INFO - REFTEST TEST-START | layout/reftests/bugs/1295466-1.xhtml == layout/reftests/bugs/1295466-1-ref.xhtml
[task 2021-01-24T20:49:15.392Z] 20:49:15 INFO - REFTEST TEST-LOAD | file:///Z:/task_1611519737/build/tests/reftest/tests/layout/reftests/bugs/1295466-1.xhtml | 1917 / 2058 (93%)
[task 2021-01-24T20:49:15.557Z] 20:49:15 WARNING - REFTEST WARNING | [CONTENT] MozInvalidateEvent didn't invalidate
[task 2021-01-24T20:49:15.567Z] 20:49:15 INFO - REFTEST TEST-LOAD | file:///Z:/task_1611519737/build/tests/reftest/tests/layout/reftests/bugs/1295466-1-ref.xhtml | 1917 / 2058 (93%)
[task 2021-01-24T20:49:15.649Z] 20:49:15 INFO - REFTEST INFO | REFTEST fuzzy test (0, 0) <= (14, 129) <= (15, 50)
[task 2021-01-24T20:49:15.810Z] 20:49:15 INFO - REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/bugs/1295466-1.xhtml == layout/reftests/bugs/1295466-1-ref.xhtml | image comparison, max difference: 14, number of differing pixels: 129

Daniel can you assign someone to take a look?

Comment 27

[Daniel Holbert [:dholbert]]

The test-failure looks unremarkable; the fuzzy annotation just needs to be extended to have a slightly-more-permissive case for windows 7, or something like that.

I'll do that in the next day or so.

(Comment 22 and comment 23 show that we also had some occasional linux failures over the past year, but unfortunately the logs for those failures seem to be gone, so I don't know how many pixels were mismatching there.)

Comment 28

[Daniel Holbert [:dholbert]]

The Win7 failures seem to all have max-difference 14, and num-differing-pixels either at 129 like this log...
https://treeherder.mozilla.org/logviewer?job_id=327280642&repo=autoland&lineNumber=37099
...or at 172 like this log:
https://treeherder.mozilla.org/logviewer?job_id=327247700&repo=autoland&lineNumber=14192

I'll land a patch to allow 172 pixels to differ (by up to 14 in a color channel) to allow for both categories of failure.

Comment 29

[Daniel Holbert [:dholbert]]

Attachment: Bug 1540635: Adjust a fuzzy annotation for reftest 1295466-1.xhtml to be specific to Windows 7, rather than to the "!nativeThemePref" configuration. r?emilio

Comment 30

[Daniel Holbert [:dholbert]]

Looks like bug 1687868 added a different annotation to this test, but I think that was a mistake, so I'm just adjusting that annotation (instead of adding an entirely new one); see bug 1687868 comment 17.

Comment 31

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/481aaa6fdb19
Adjust a fuzzy annotation for reftest 1295466-1.xhtml to be specific to Windows 7, rather than to the "!nativeThemePref" configuration. r=emilio

Comment 32

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/481aaa6fdb19

Comment 33

[Intermittent Failures Robot]

13 failures in 3891 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 13

Platform and build breakdown:

• windows7-32: 13
  • debug: 9
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-01-25&endday=2021-01-31&tree=all

Comment 34

[Intermittent Failures Robot]

2 failures in 3966 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform and build breakdown:

• windows7-32: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-02-01&endday=2021-02-07&tree=all

Comment 35

[Intermittent Failures Robot]

1 failures in 4322 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform and build breakdown:

• windows7-32-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-02-08&endday=2021-02-14&tree=all

Comment 36

[Intermittent Failures Robot]

4 failures in 3737 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform and build breakdown:

• windows7-32: 4
  • opt: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-02-15&endday=2021-02-21&tree=all

Comment 37

[Daniel Holbert [:dholbert]]

Attachment: Bug 1540635: Increase win7 fuzzy-pixel threshold for reftest 1295466-1.xhtml, to match the mismatch-count observed for intermittent fuzzy failures. (no review, just adjusting a test annotation)

Comment 38

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/3f4ebce50df2
Increase win7 fuzzy-pixel threshold for reftest 1295466-1.xhtml, to match the mismatch-count observed for intermittent fuzzy failures. (no review, just adjusting a test annotation) DONTBUILD

Comment 39

[Bogdan Tara[:bogdan_tara | bogdant]]

https://hg.mozilla.org/mozilla-central/rev/3f4ebce50df2

Comment 40

[Intermittent Failures Robot]

1 failures in 4327 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows7-32: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-02-22&endday=2021-02-28&tree=all

Comment 41

[Daniel Holbert [:dholbert]]

Note: the failure in comment 40 was from autoland on 2/22 at 17:00, ~2 hours before this landed. So, it's no cause for concern.

Comment 42

[Intermittent Failures Robot]

1 failures in 4622 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-03-08&endday=2021-03-14&tree=all

Comment 43

[Intermittent Failures Robot]

1 failures in 4255 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• windows10-aarch64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-04-12&endday=2021-04-18&tree=all

Comment 44

[Intermittent Failures Robot]

1 failures in 3706 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• windows10-aarch64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-04-26&endday=2021-05-02&tree=all

Comment 45

[Intermittent Failures Robot]

1 failures in 3061 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows10-32: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-05-17&endday=2021-05-23&tree=all

Comment 46

[Daniel Holbert [:dholbert]]

comment 45 is max difference: 14, number of differing pixels: 129, on platform/configuration "windows10-32 debug reftest-no-accel-e10s-4"

This is the same as the most-common failure that we were seeing on Windows 7, per comment 28. (And the failure is unremarkable/unconcerning, per comment 27).

The fuzzy annotation currently has a win7-specific version check at the end (added in comment 31); we should probably just adjust that Windows version-check to just be a winWidget check.

Comment 47

[Intermittent Failures Robot]

5 failures in 2908 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 1

Platform and build breakdown:

• windows10-32: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-05-24&endday=2021-05-30&tree=all

Comment 48

[Intermittent Failures Robot]

8 failures in 3065 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 1

Platform and build breakdown:

• windows10-32: 8
  • debug: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-05-31&endday=2021-06-06&tree=all

Comment 49

[Intermittent Failures Robot]

2 failures in 3502 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• windows10-32: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-06-07&endday=2021-06-13&tree=all

Comment 50

[Daniel Holbert [:dholbert]]

Attachment: Bug 1540635: Generalize fuzzy annotation for reftest 1295466-1.xhtml to remove Windows version check. (no review, just tweaking test fuzziness metadata)

This test formerly had a win7-specific fuzzy annotation. I'm generalizing that
annotation to include all Windows versions, since Windows 10 has had similar
fuzzy failures; and I'm also merging with the adjacent "gtkWidget" fuzzy
annotation, since it's got exactly the same fuzzy thresholds.

Comment 51

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/fc1f9feba1e0
Generalize fuzzy annotation for reftest 1295466-1.xhtml to remove Windows version check. (no review, just tweaking test fuzziness metadata)

Comment 52

[Marian-Vasile Laza]

https://hg.mozilla.org/mozilla-central/rev/fc1f9feba1e0

Comment 53

[Intermittent Failures Robot]

1 failures in 2888 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows10-32: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1540635&startday=2021-06-14&endday=2021-06-20&tree=all

Comment 54

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.