1619847 - Perma [tier2] TEST-UNEXPECTED-PASS | image/test/reftest/bmp/bmpsuite/g/pal8v4.bmp == image/test/reftest/bmp/bmpsuite/g/pal8.png | image comparison, max difference: 1, number of differing pixels: 899

Status: RESOLVED FIXED

(Core :: Graphics: ImageLib, defect, P3)

Description

[Treeherder Bug Filer]

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=291533395&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/D-aE31o3TB6aVtO-6Q3YMQ/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/D-aE31o3TB6aVtO-6Q3YMQ/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2020-03-04T02:37:58.525Z] 02:37:58 INFO - REFTEST TEST-START | image/test/reftest/bmp/bmpsuite/g/pal8v4.bmp == image/test/reftest/bmp/bmpsuite/g/pal8.png
[task 2020-03-04T02:37:58.525Z] 02:37:58 INFO - REFTEST TEST-LOAD | file:///C:/tasks/task_1583283551/build/tests/reftest/tests/image/test/reftest/bmp/bmpsuite/g/pal8v4.bmp | 16 / 27 (59%)
[task 2020-03-04T02:37:58.569Z] 02:37:58 INFO - REFTEST INFO | REFTEST fuzzy test (3, 6376) <= (1, 899) <= (3, 6376)
[task 2020-03-04T02:37:59.742Z] 02:37:59 INFO - REFTEST TEST-UNEXPECTED-PASS | image/test/reftest/bmp/bmpsuite/g/pal8v4.bmp == image/test/reftest/bmp/bmpsuite/g/pal8.png | image comparison, max difference: 1, number of differing pixels: 899

Comment 1

[Intermittent Failures Robot]

23 failures in 5483 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 20
• try: 3

Platform breakdown:

• windows10-aarch64: 23

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1619847&startday=2020-03-02&endday=2020-03-08&tree=all

Comment 2

[Andreea Pavel [:apavel]]

Andrew can you take a look?

Comment 3

[Intermittent Failures Robot]

47 failures in 5336 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

This is the #31 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 23
• mozilla-beta: 11
• try: 13

Platform breakdown:

• windows10-aarch64: 46
• windows10-64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1619847&startday=2020-03-09&endday=2020-03-15&tree=all

Comment 4

[Andreea Pavel [:apavel]]

There are 21 failures in the last 7 days on windows10-aarch64 opt

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=293779683&repo=mozilla-central&lineNumber=14903

Comment 5

[Intermittent Failures Robot]

48 failures in 4955 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #27 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 22
• try: 14
• mozilla-beta: 12

Platform breakdown:

• windows10-aarch64: 48

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1619847&startday=2020-03-16&endday=2020-03-22&tree=all

Comment 6

[Intermittent Failures Robot]

31 failures in 4773 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

This is the #48 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 9
• try: 9
• mozilla-beta: 13

Platform breakdown:

• windows10-aarch64: 31

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1619847&startday=2020-03-23&endday=2020-03-29&tree=all

Comment 7

[Andrew Osmond [:aosmond] (he/him)]

I'll fix the reftest annotations for this.

Comment 8

[Intermittent Failures Robot]

33 failures in 5015 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

This is the #41 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-release: 12
• try: 11
• mozilla-central: 7
• mozilla-beta: 3

Platform breakdown:

• windows10-aarch64: 33

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1619847&startday=2020-03-30&endday=2020-04-05&tree=all

Comment 9

[Andreea Pavel [:apavel]]

Andrew are there updates here?

Comment 10

[Intermittent Failures Robot]

19 failures in 4823 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 7
• mozilla-central: 6
• mozilla-release: 2
• mozilla-beta: 4

Platform breakdown:

• windows10-aarch64: 19

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1619847&startday=2020-04-06&endday=2020-04-12&tree=all

Comment 11

[Intermittent Failures Robot]

34 failures in 4528 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #47 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• try: 15
• mozilla-central: 8
• mozilla-beta: 10
• mozilla-release: 1

Platform breakdown:

• windows10-aarch64: 34

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1619847&startday=2020-04-13&endday=2020-04-19&tree=all

Comment 12

[Andreea Pavel [:apavel]]

Attachment: Bug 1619847 - update reftest annotation for pal8v4.bmp r?#intermittent-reviewers

Comment 13

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/f01214a10677
update reftest annotation for pal8v4.bmp r=jmaher

Comment 14

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/f01214a10677

Comment 15

[Narcis Beleuzu [:NarcisB]]

After f01214a10677 landed this fails as an UNEXPECTED-FAIL
Log link: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=298571479&repo=mozilla-central&lineNumber=21712

Comment 16

[Narcis Beleuzu [:NarcisB]]

Attachment: Bug 1619847 - update reftest annotation for pal8v4.bmp for 899 pixel difference. r=jmaher

Comment 17

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a05dcc67be0f
update reftest annotation for pal8v4.bmp for 899 pixel difference. r=jmaher

Comment 18

[Arthur Iakab [arthur_iakab]]

https://hg.mozilla.org/mozilla-central/rev/a05dcc67be0f

Comment 19

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-beta/rev/15bb5903baf3

Comment 20

[Intermittent Failures Robot]

14 failures in 5582 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 5
• try: 4
• mozilla-release: 2
• mozilla-beta: 3

Platform breakdown:

• windows10-aarch64: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1619847&startday=2020-04-20&endday=2020-04-26&tree=all