1608376 - Intermittent TEST-UNEXPECTED-PASS | w3c-css/received/float-rgt-orthog-htb-in-vlr-003.xht == w3c-css/received/float-rgt-orthog-htb-in-vlr-003-ref.xht | image comparison, max difference: 0, number of differing pixels: 0

Status: RESOLVED FIXED

(Core :: Layout, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=284351299&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/QtapmrqZSK-V3I5avxlVEQ/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/QtapmrqZSK-V3I5avxlVEQ/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

Comment 1

[Intermittent Failures Robot]

4 failures in 4472 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform breakdown:

• macosx1014-64-shippable: 3
• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608376&startday=2020-01-06&endday=2020-01-12&tree=all

Comment 2

[Intermittent Failures Robot]

16 failures in 3773 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• try: 4
• mozilla-esr68: 1
• mozilla-central: 2

Platform breakdown:

• macosx1014-64: 4
• macosx1014-64-shippable-qr: 3
• macosx1014-64-qr: 3
• macosx1014-64-devedition: 1
• macosx1014-64-shippable: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608376&startday=2020-01-13&endday=2020-01-19&tree=all

Comment 3

[Intermittent Failures Robot]

6 failures in 4004 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6

Platform breakdown:

• macosx1014-64-shippable-qr: 5
• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608376&startday=2020-01-20&endday=2020-01-26&tree=all

Comment 4

[Intermittent Failures Robot]

3 failures in 2190 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1
• try: 1

Platform breakdown:

• macosx1014-64-shippable: 1
• macosx1014-64-qr: 1
• macosx1014-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608376&startday=2020-01-27&endday=2020-02-02&tree=all

Comment 5

[Intermittent Failures Robot]

12 failures in 3364 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11
• try: 1

Platform breakdown:

• macosx1014-64-shippable-qr: 7
• macosx1014-64-shippable: 3
• macosx1014-64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608376&startday=2020-02-03&endday=2020-02-09&tree=all

Comment 6

[Intermittent Failures Robot]

11 failures in 4690 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• mozilla-beta: 1

Platform breakdown:

• macosx1014-64: 5
• macosx1014-64-shippable: 4
• macosx1014-64-shippable-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608376&startday=2020-02-10&endday=2020-02-16&tree=all

Comment 7

[Andreea Pavel [:apavel]]

Emilio do you have any suggestion on what to do here?

Comment 8

[Emilio Cobos Álvarez [:emilio]]

At least the first one looks like the screenshot is taken at a size smaller than the viewport. The vertical element takes the whole viewport, but in the UNEXPECTED-PASS case the viewport is smaller and it truncates the element that is at the bottom.

This seems to only happen on mac, so not sure what's going on... David, do you know who is responsible for the reftest harness?

Comment 9

[David Baron :dbaron: (⌚️UTC-5, no longer working on Mozilla)]

To some degree, me, although in this case it seems like something that's going wrong with drawWindow or similar. It's also interesting that whatever is going on is happening on two tests in succession. Could it have something to do with the window being positioned offscreen? It seems like something is wrong with the entire run of reftests -- all four failures seem likely to be from the same cause, since all 4 seem to be the result of not comparing the bottom bit of the viewport.

I'd also note that TYLin will likely remove the test in the title of this bug in bug 1598754, but that the latter two failures in this test run seem likely to continue happening if the problem remains.

It might be interesting to look for a regression range.

Comment 10

[David Baron :dbaron: (⌚️UTC-5, no longer working on Mozilla)]

The intermittent bugs on the other tests are much older.

Comment 11

[Andreea Pavel [:apavel]]

David I started retriggers from this bug and this is how it looks: https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&searchStr=macosx1014-64%2Creftest&tochange=1895e349822271c7d08aa8538b2e95e430796ac6&fromchange=f81ec1f37a25b7a476091af3a8e75ddb51003f1d&selectedJob=290004252

Should we try to narrow down for the other two bugs as well?

Comment 12

[David Baron :dbaron: (⌚️UTC-5, no longer working on Mozilla)]

I don't see anything especially interesting there -- but it's the oldest one that would be most interesting.

Comment 13

[Intermittent Failures Robot]

18 failures in 4045 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• autoland: 14
• mozilla-beta: 1
• mozilla-central: 1

Platform breakdown:

• macosx1014-64-qr: 3
• macosx1014-64: 4
• macosx1014-64-shippable-qr: 10
• macosx1014-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608376&startday=2020-02-17&endday=2020-02-23&tree=all

Comment 14

[Intermittent Failures Robot]

9 failures in 5233 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• try: 2
• mozilla-central: 1

Platform breakdown:

• macosx1014-64-shippable: 2
• macosx1014-64: 1
• macosx1014-64-shippable-qr: 3
• macosx1014-64-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608376&startday=2020-02-24&endday=2020-03-01&tree=all

Comment 15

[Ting-Yu Lin [:TYLin] (PST, UTC-8)]

As note by David in comment 9, this reftest has been removed in bug 1598754. Let's close this bug and track the intermittent in the other two bugs listed in comment 10.

Comment 16

[Intermittent Failures Robot]

1 failures in 5483 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform breakdown:

• macosx1014-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608376&startday=2020-03-02&endday=2020-03-08&tree=all

Comment 17

[Intermittent Failures Robot]

1 failures in 4949 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr68: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608376&startday=2020-06-01&endday=2020-06-07&tree=all