1716135 - Permafailing reftest layout/reftests/bugs/513153-2b.html == layout/reftests/bugs/513153-2-ref.html | image comparison, max difference: X, number of differing pixels: Y when Gecko 91 merges to Beta on 2021-07-12

Status: RESOLVED FIXED

(Core :: Layout, defect)

Description

[Natalia Csoregi [:nataliaCs]]

• Central as beta simulation
• How to run these simulations
• Failure log

[task 2021-06-12T12:33:13.892Z] 12:33:13 INFO - REFTEST TEST-START | layout/reftests/bugs/513153-2b.html == layout/reftests/bugs/513153-2-ref.html
[task 2021-06-12T12:33:13.893Z] 12:33:13 INFO - REFTEST TEST-LOAD | file:///opt/worker/tasks/task_162350059645975/build/tests/reftest/tests/layout/reftests/bugs/513153-2b.html | 1358 / 2051 (66%)
[task 2021-06-12T12:33:14.116Z] 12:33:14 INFO - JavaScript error: resource://gre/modules/XULStore.jsm, line 66: Error: Can't find profile directory.
[task 2021-06-12T12:33:14.158Z] 12:33:14 INFO - REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/bugs/513153-2b.html == layout/reftests/bugs/513153-2-ref.html | image comparison, max difference: 112, number of differing pixels: 108

Comment 1

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Regression from disabling the non-native theme in beta and release on macOS in bug 1715452?

Comment 2

[Emilio Cobos Álvarez (:emilio)]

Attachment: Bug 1716135 - Annotate some fuzz for macOS+webrender+widget.non-native-theme.webrender=false.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/0185c2891e1c
Annotate some fuzz for macOS+webrender+widget.non-native-theme.webrender=false.

Comment 5

[Andreea Pavel [:apavel]]

Fyi, this also fails on mozilla-release: https://treeherder.mozilla.org/logviewer?job_id=342718355&repo=mozilla-release&lineNumber=8073

Comment 6

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/0185c2891e1c

Comment 7

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

One failure is still observed: https://treeherder.mozilla.org/logviewer?job_id=342842170&repo=try

DevEdition (other macOS builds are busted today): REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/bugs/513153-2b.html == layout/reftests/bugs/513153-2-ref.html | image comparison, max difference: 112, number of differing pixels: 108

Comment 8

[Emilio Cobos Álvarez (:emilio)]

Attachment: Bug 1716135 - Move a fuzzy annotation to the right place.

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/b09f48b20f16
Move a fuzzy annotation to the right place.

Comment 10

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/b09f48b20f16

Comment 11

[Andreea Pavel [:apavel]]

Verified fixed in latest beta sim: https://treeherder.mozilla.org/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel&revision=bfccd676723283ace1baf8ce1603c278d8bd9202

Comment 12

[Intermittent Failures Robot]

16 failures in 240 pushes (0.067 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-beta: 16

Platform and build breakdown:

• macosx1015-64-shippable-qr: 16
  • opt: 16

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1716135&startday=2021-06-18&endday=2021-06-18&tree=all

Comment 13

[Intermittent Failures Robot]

33 failures in 2888 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #46 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-release: 7
• mozilla-beta: 26

Platform and build breakdown:

• macosx1015-64-shippable-qr: 33
  • opt: 33

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1716135&startday=2021-06-14&endday=2021-06-20&tree=all

Comment 14

[Andreea Pavel [:apavel]]

Still occurs on beta, should this be uplifted?
https://treeherder.mozilla.org/logviewer?job_id=343387712&repo=mozilla-beta&lineNumber=8065

Comment 15

[Emilio Cobos Álvarez (:emilio)]

Comment on attachment 9227343 [details]
Bug 1716135 - Move a fuzzy annotation to the right place.

Beta/Release Uplift Approval Request

• User impact if declined: none
• Is this code covered by automated tests?: Yes
• Has the fix been verified in Nightly?: Yes
• Needs manual test from QE?: No
• If yes, steps to reproduce:
• List of other uplifts needed: none
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky): Test-only change (the patch that caused this was uplifted to beta)
• String changes made/needed: none

Comment 16

[Julien Cristau [:jcristau]]

Comment on attachment 9227343 [details]
Bug 1716135 - Move a fuzzy annotation to the right place.

I'll land this a=test-only

Comment 17

[Julien Cristau [:jcristau]]

https://hg.mozilla.org/releases/mozilla-beta/rev/673a9805a286
https://hg.mozilla.org/releases/mozilla-beta/rev/ad69d4176c83

Comment 18

[Intermittent Failures Robot]

10 failures in 3115 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 3
• mozilla-beta: 7

Platform and build breakdown:

• macosx1015-64-shippable-qr: 10
  • opt: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1716135&startday=2021-06-21&endday=2021-06-27&tree=all