1646619 - Perma [Tier 2] TEST-UNEXPECTED-PASS | bugs/759036-2.html == bugs/759036-2-ref.html | image comparison, max difference: 3, number of differing pixels: 5852

Status: RESOLVED FIXED

(Core :: Layout, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: malexandru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=306724331&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SVnMiBsxQu2MffQ_Z1I7gQ/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SVnMiBsxQu2MffQ_Z1I7gQ/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2020-06-18T04:35:55.171Z] 04:35:55     INFO -  REFTEST TEST-START | layout/reftests/bugs/759036-2.html == layout/reftests/bugs/759036-2-ref.html
[task 2020-06-18T04:35:55.171Z] 04:35:55     INFO -  REFTEST TEST-LOAD | http://10.7.205.240:8854/tests/layout/reftests/bugs/759036-2.html | 1837 / 2155 (85%)
[task 2020-06-18T04:35:55.171Z] 04:35:55     INFO -  REFTEST TEST-LOAD | http://10.7.205.240:8854/tests/layout/reftests/bugs/759036-2-ref.html | 1837 / 2155 (85%)
[task 2020-06-18T04:35:55.171Z] 04:35:55     INFO -  REFTEST INFO | REFTEST fuzzy test (3, 5897) <= (3, 5852) <= (3, 5897)
[task 2020-06-18T04:35:55.171Z] 04:35:55  WARNING -  REFTEST TEST-UNEXPECTED-PASS | layout/reftests/bugs/759036-2.html == layout/reftests/bugs/759036-2-ref.html | image comparison, max difference: 3, number of differing pixels: 5852
[task 2020-06-18T04:35:55.172Z] 04:35:55     INFO -  REFTEST   IMAGE 1 (TEST):
[task 2020-06-18T04:35:55.172Z] 04:35:55     INFO -  REFTEST   IMAGE 2 (REFERENCE):
[task 2020-06-18T04:35:55.172Z] 04:35:55     INFO -  REFTEST TEST-END | layout/reftests/bugs/759036-2.html == layout/reftests/bugs/759036-2-ref.html
[task 2020-06-18T04:35:55.172Z] 04:35:55     INFO -  REFTEST TEST-START | layout/reftests/bugs/776265-1a.html == layout/reftests/bugs/776265-1-ref.html

Comment 1

[Alexandru Michis [:malexandru]]

Glenn, this looks to have appeared when your changes in Bug 1646279 landed:
https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&resultStatus=pending%2Crunning%2Csuccess%2Ctestfailed%2Cbusted%2Cexception%2Crunnable&fromchange=cc9bea1151d389e78bd61afeb53bf929e5e235c4&searchStr=android%2C8.0%2Cpixel2%2Caarch64%2Cwebrender%2Cdebug%2Creftests%2Ctest-android-hw-p2-8-0-android-aarch64-qr%2Fdebug-geckoview-reftest-qr-e10s-1%2Cr%28r1%29&tochange=7f0b0cbecd946aee526a869853a46a14ee44b1f9&selectedTaskRun=eGgnqzZ4SZ6z94C46S_ksQ.0

I think it's a short expectation update, could you please take a look?

Comment 2

[Glenn Watson [:gw]]

Attachment: Bug 1646619 - Update reftest annotations for android device.

Comment 3

[Glenn Watson [:gw]]

Attached a patch that updates the expectations, thanks!

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/eee3381d8d37
Update reftest annotations for android device. r=hiro

Comment 5

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/eee3381d8d37

Comment 6

[Intermittent Failures Robot]

6 failures in 4035 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 2

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 3
• android-hw-p2-8-0-android-aarch64-shippable-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1646619&startday=2020-06-15&endday=2020-06-21&tree=all