1620522 - Perma [tier2] image/test/reftest/bmp/bmpsuite/q/rgb24prof.bmp == image/test/reftest/bmp/bmpsuite/q/rgb24.png | image comparison, max difference: 1, number of differing pixels: 73

Status: RESOLVED FIXED

(Core :: Graphics: ImageLib, defect, P3)

Description

[Treeherder Bug Filer]

Filed by: rmaries [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=291917890&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Fu2sfEeSRzGfhJHRzIlffg/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Fu2sfEeSRzGfhJHRzIlffg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

Comment 1

[Andrew Osmond [:aosmond] (he/him)]

I see, it is possible the AArch / NEON implementation of premultiply and color management may have some slight rounding differences compared to x86 / SSE / AVX.

Comment 2

[Intermittent Failures Robot]

14 failures in 5483 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 11
• try: 3

Platform breakdown:

• windows10-aarch64: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1620522&startday=2020-03-02&endday=2020-03-08&tree=all

Comment 3

[Oana Pop-Rus]

There are 24 total failures in the last 7 days on windows10-aarch64, opt build type.

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=293167714&repo=mozilla-central&lineNumber=18489

Andrew,
this failure start to be perma-tier2 on central, 6 days ago.

Comment 4

[Cristina Coroiu [:ccoroiu]]

Started to fail with this merge: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&revision=c991b81a783355827d979bfd7e221fb3c6940662&searchStr=Windows%2C10%2CAArch64%2Copt%2CReftests%2Ctest-windows10-aarch64%2Fopt-reftest-e10s-1%2CR%28R1%29

Done some backfills up to:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=Windows%2C10%2CAArch64%2Copt%2CReftests%2Ctest-windows10-aarch64%2Fopt-reftest-e10s-1%2CR%28R1%29&tochange=d6f1cc3bcb5124b27aa9ee4f937cace0c005aee8&fromchange=7e16fe72804aa5547aad18b62332a0881fcd0bca&selectedJob=293279168

Comment 5

[Intermittent Failures Robot]

46 failures in 5336 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

This is the #34 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 22
• mozilla-beta: 11
• try: 13

Platform breakdown:

• windows10-aarch64: 46

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1620522&startday=2020-03-09&endday=2020-03-15&tree=all

Comment 6

[Intermittent Failures Robot]

47 failures in 4955 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

This is the #28 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 21
• try: 14
• mozilla-beta: 12

Platform breakdown:

• windows10-aarch64: 47

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1620522&startday=2020-03-16&endday=2020-03-22&tree=all

Comment 7

[Alexandru Michis [:malexandru]]

Andrew,
Should we disable this test till a solution is found?

Comment 8

[Intermittent Failures Robot]

33 failures in 4773 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

This is the #43 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• try: 12
• mozilla-beta: 14
• mozilla-central: 7

Platform breakdown:

• windows10-aarch64: 33

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1620522&startday=2020-03-23&endday=2020-03-29&tree=all

Comment 9

[Intermittent Failures Robot]

29 failures in 5015 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 12
• mozilla-central: 6
• try: 9
• mozilla-beta: 2

Platform breakdown:

• windows10-aarch64: 29

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1620522&startday=2020-03-30&endday=2020-04-05&tree=all

Comment 10

[Intermittent Failures Robot]

22 failures in 4823 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 7
• mozilla-release: 2
• mozilla-central: 7
• try: 6

Platform breakdown:

• windows10-aarch64: 22

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1620522&startday=2020-04-06&endday=2020-04-12&tree=all

Comment 11

[Andrew Osmond [:aosmond] (he/him)]

Attachment: Bug 1620522 - Increase fuzz on BMP color managed reftest.

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/5b42abec66cf
Increase fuzz on BMP color managed reftest.

Comment 13

[Oana Pop-Rus]

https://hg.mozilla.org/mozilla-central/rev/5b42abec66cf

Comment 14

[Andreea Pavel [:apavel]]

This is still occurring on beta, should the fix be uplifted?

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=298342452&repo=mozilla-beta&lineNumber=4688

Comment 15

[Intermittent Failures Robot]

15 failures in 4528 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3
• mozilla-beta: 11
• mozilla-release: 1

Platform breakdown:

• windows10-aarch64: 15

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1620522&startday=2020-04-13&endday=2020-04-19&tree=all

Comment 16

[Andrew Osmond [:aosmond] (he/him)]

Comment on attachment 9140113 [details]
Bug 1620522 - Increase fuzz on BMP color managed reftest.

Beta/Release Uplift Approval Request

• User impact if declined: None
• Is this code covered by automated tests?: Yes
• Has the fix been verified in Nightly?: Yes
• Needs manual test from QE?: No
• If yes, steps to reproduce:
• List of other uplifts needed: None
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky): Just increases the fuzz for a test that already has some.
• String changes made/needed:

Comment 17

[Ryan VanderMeulen [:RyanVM]]

Comment on attachment 9140113 [details]
Bug 1620522 - Increase fuzz on BMP color managed reftest.

This can be uplifted a=test-only.

Comment 18

[Alexandru Michis [:malexandru]]

https://hg.mozilla.org/releases/mozilla-beta/rev/b8d1d1fda8c0

Comment 19

[Intermittent Failures Robot]

3 failures in 5582 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• mozilla-release: 2

Platform breakdown:

• windows10-aarch64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1620522&startday=2020-04-20&endday=2020-04-26&tree=all