1633732 - Intermittent first-letter/23605-5.html == first-letter/23605-5-ref.html | image comparison, max difference: 63, number of differing pixels: 1

Status: RESOLVED FIXED

(Core :: Layout: Block and Inline, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nerli [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=299760458&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/JMYSu1CCSbu6KoLCFET7hw/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/JMYSu1CCSbu6KoLCFET7hw/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2020-04-28T11:29:38.555Z] 11:29:38 INFO - REFTEST TEST-START | layout/reftests/first-letter/23605-5.html == layout/reftests/first-letter/23605-5-ref.html
[task 2020-04-28T11:29:38.555Z] 11:29:38 INFO - REFTEST TEST-LOAD | file:///Z:/task_1588069372/build/tests/reftest/tests/layout/reftests/first-letter/23605-5.html | 29 / 76 (38%)
[task 2020-04-28T11:29:38.624Z] 11:29:38 INFO - REFTEST TEST-LOAD | file:///Z:/task_1588069372/build/tests/reftest/tests/layout/reftests/first-letter/23605-5-ref.html | 29 / 76 (38%)
[task 2020-04-28T11:29:38.802Z] 11:29:38 INFO - REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/first-letter/23605-5.html == layout/reftests/first-letter/23605-5-ref.html | image comparison, max difference: 63, number of differing pixels: 1

Comment 1

[Intermittent Failures Robot]

30 failures in 1108 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 21
• mozilla-central: 9

Platform breakdown:

• windows7-32: 14
• windows10-64: 3
• windows7-32-shippable: 6
• windows10-64-qr: 4
• windows10-64-shippable-qr: 1
• windows10-64-shippable: 1
• windows7-32-mingwclang: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1633732&startday=2020-04-28&endday=2020-04-28&tree=all

Comment 2

[Dorel Luca [:dluca]]

Emilio: Could this be a regression of Bug 1632765 when it landed here: https://hg.mozilla.org/integration/autoland/rev/8d7864d6d8da96f869a62ca2e3caaf8cbc5164fa

Retriggers link:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=windows%2C7%2Cdebug%2Creftests%2Ctest-windows7-32%2Fdebug-reftest-e10s-2%2Cr%28r2%29&tochange=6d0a8bc98708a9bf142a7933e2e9aa73e55d92a0&fromchange=33d5b34d917932d4955d98105ae357677dac238a&selectedTaskRun=HBNc4JllQ4SpNVTJ0fN4Tw-0

Comment 3

[Emilio Cobos Álvarez (:emilio)]

Yes, though it's one pixel off so it can probably be fuzzed away. Dorel, do you know in which platforms does this happen? Only win7?

Thank you.

Comment 4

[Intermittent Failures Robot]

33 failures in 1129 pushes (0.029 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 20
• mozilla-central: 12
• try: 1

Platform breakdown:

• windows7-32: 11
• windows10-64-qr: 6
• windows10-64: 6
• windows10-64-ccov: 2
• windows7-32-devedition: 1
• windows7-32-shippable: 3
• windows10-64-shippable-qr: 2
• windows7-32-mingwclang: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1633732&startday=2020-04-29&endday=2020-04-29&tree=all

Comment 5

[Atila Butkovits]

This is happening on Win 7 and Win 10, including webrender: https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2020-04-23&endday=2020-04-30&tree=trunk&bug=1633732

Comment 6

[Emilio Cobos Álvarez (:emilio)]

Ok, will annotate that, thanks!

Comment 7

[Emilio Cobos Álvarez (:emilio)]

Attachment: Bug 1633732 - Fuzz one pixel on first-letter/23605-5.html on Windows.

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/712455de746c
Fuzz one pixel on first-letter/23605-5.html on Windows.

Comment 9

[Intermittent Failures Robot]

58 failures in 1127 pushes (0.051 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 43
• mozilla-central: 6
• try: 9

Platform breakdown:

• windows10-64-qr: 33
• windows7-32: 9
• windows7-32-mingwclang: 2
• windows7-32-shippable: 1
• windows10-64-shippable: 2
• windows10-64: 7
• windows10-64-shippable-qr: 2
• windows10-aarch64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1633732&startday=2020-04-30&endday=2020-04-30&tree=all

Comment 10

[Cristian Brindusan [:cbrindusan]]

https://hg.mozilla.org/mozilla-central/rev/712455de746c

Comment 11

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1632765

Comment 13

[Dorel Luca [:dluca]]

This is still happening, should we reopen this? Or use bug 1634666?

Update: Retriggers show that this wasn't fixed:
https://treeherder.mozilla.org/#/jobs?repo=autoland&selectedTaskRun=a_GkWqlVRIev4fqZ3LXu4g-0&revision=712455de746cadfb201813cdbe688a95c0291cc6&group_state=expanded

Comment 14

[Emilio Cobos Álvarez (:emilio)]

Attachment: Bug 1633732 - Increase the fuzz range a bit more.

Comment 15

[Emilio Cobos Álvarez (:emilio)]

That's a different failure from comment 0 in webrender builds, but just needs a minor annotation tweak.

Comment 16

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/06e8cdbc10cb
Increase the fuzz range a bit more.

Comment 17

[Daniel Varga [:dvarga]]

https://hg.mozilla.org/mozilla-central/rev/06e8cdbc10cb

Comment 18

[Noemi Erli[:noemi_erli]]

This is still happening but on tier2 now: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=300550966&repo=mozilla-central&lineNumber=2650

Emilio, could you please take a look at this?

Comment 19

[Narcis Beleuzu [:NarcisB]]

:emilio , turned into a tier1 failure: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=300565729&repo=autoland&lineNumber=19539

Comment 20

[Emilio Cobos Álvarez (:emilio)]

Attachment: Bug 1633732 - Increase the fuzz range even more to account for some other win builds.

Comment 21

[Emilio Cobos Álvarez (:emilio)]

It's just a difference in the fuzz value. Can be safely increased.

Comment 22

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/8ae2530503a6
Increase the fuzz range even more to account for some other win builds.

Comment 23

[Intermittent Failures Robot]

139 failures in 5423 pushes (0.026 failures/push) were associated with this bug in the last 7 days.

This is the #6 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 95
• mozilla-central: 33
• try: 11

Platform breakdown:

• windows7-32: 35
• windows10-64: 21
• windows7-32-shippable: 10
• windows10-64-qr: 46
• windows10-64-shippable-qr: 6
• windows10-64-shippable: 5
• windows7-32-mingwclang: 5
• windows10-64-ccov: 7
• windows7-32-devedition: 1
• windows10-aarch64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1633732&startday=2020-04-27&endday=2020-05-03&tree=all

Comment 24

[Alexandru Michis [:malexandru]]

https://hg.mozilla.org/mozilla-central/rev/8ae2530503a6