1599346 - Intermittent bugs/315920-9.html == bugs/315920-9-ref.html | image comparison, max difference: X, number of differing pixels: Y

Status: RESOLVED FIXED

(Core :: Layout, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ccoroiu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=278155037&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Mz_Hz30lT2qUrbEMXTjscA/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Mz_Hz30lT2qUrbEMXTjscA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

Comment 1

[Daniel Holbert [:dholbert]]

The reftest screenshot shows that the outline of an un-ticked <input type="radio"> element rendered a bit differently between testcase & reference case. (It might be just shifted slightly, by a sub-pixel amount?)

Comment 2

[Intermittent Failures Robot]

1 failures in 4331 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1599346&startday=2019-11-25&endday=2019-12-01&tree=all

Comment 3

[Intermittent Failures Robot]

2 failures in 4867 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• android-em-7-0-x86_64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1599346&startday=2019-12-09&endday=2019-12-15&tree=all

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 5

[Razvan Maries]

New occurrence: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=285674404&repo=autoland&lineNumber=24638

Comment 6

[Intermittent Failures Robot]

1 failures in 4004 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1599346&startday=2020-01-20&endday=2020-01-26&tree=all

Comment 7

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 8

[Intermittent Failures Robot]

1 failures in 4823 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1599346&startday=2020-04-06&endday=2020-04-12&tree=all

Comment 9

[Razvan Maries]

New occurrence: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=305064022&repo=autoland&lineNumber=14979

Comment 10

[Intermittent Failures Robot]

1 failures in 4949 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1599346&startday=2020-06-01&endday=2020-06-07&tree=all

Comment 11

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 12

[Sandor Molnar[:smolnar]]

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=329310553&repo=mozilla-central&lineNumber=3891

Comment 13

[Daniel Holbert [:dholbert]]

The failure in comment 0 had max difference: 37, number of differing pixels: 65 (and looked like maybe the radio button was being rendered at a slightly different subpixel position, though not in a clearly broken way aside from the nondeterminism)

The failure in comments 5 and 9 can't be viewed anymore, unfortunately (the parsed log has expired and we don't have the raw log link here).

The failure in comment 12 has max difference: 1, number of differing pixels: 5 which is much more clearly un-interesting -- just some as-subtle-as-possible antialiasing differences around a few pixels at the edge of the radio buttons' rings here.
(raw log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/d4dP-imeSFqmKoGELMtB7g/runs/0/artifacts/public/logs/live_backing.log )

Anyway: if this happens again, we should probably just add a fuzzy annotation that covers the recent observed fuzzy-mismatch levels. At this point, none of the failures here seem particularly alarming or merit spending too much time investigating.

Comment 14

[Intermittent Failures Robot]

2 failures in 4322 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform and build breakdown:

• linux1804-64-asan: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1599346&startday=2021-02-08&endday=2021-02-14&tree=all

Comment 15

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 16

[Intermittent Failures Robot]

1 failures in 3061 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1599346&startday=2021-05-17&endday=2021-05-23&tree=all

Comment 17

[Daniel Holbert [:dholbert]]

For the record: the comment 16 failure is max difference: 1, number of differing pixels: 41 (with the differing pixels being antialiased fringe at the curved edge of the radio-button's circle).

Comment 18

[Atila Butkovits]

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=344903303&repo=autoland&lineNumber=4002

Comment 19

[Intermittent Failures Robot]

1 failures in 2387 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1599346&startday=2021-07-05&endday=2021-07-11&tree=all

Comment 20

[Daniel Holbert [:dholbert]]

comment 18 is the same sort of failure as comment 16 (with max difference: 1, number of differing pixels: 41, on linux1804-64-asan opt).

Comment 21

[Daniel Holbert [:dholbert]]

Attachment: Bug 1599346: Annotate recent observed fuzziness in reftest 315920-9.html. r=#intermittent-reviewers

This is to allow "max difference: 1, number of differing pixels: 41". The
differing pixels are all antialiased fringe along the curved edges of the
test's radio-buttons.

Comment 22

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/be5486992cee
Annotate recent observed fuzziness in reftest 315920-9.html. r=intermittent-reviewers,ahal

Comment 23

[Dorel Luca [:dluca]]

https://hg.mozilla.org/mozilla-central/rev/be5486992cee

Comment 24

[Intermittent Failures Robot]

1 failures in 2819 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1599346&startday=2021-11-22&endday=2021-11-28&tree=all