1723727 - Intermittent Android TEST-UNEXPECTED-PASS | /css/css-shapes/shape-outside/values/shape-outside-ellipse-005.html | test unit: vh - ellipse(50vh 100vh) - computed - expected FAIL

Status: RESOLVED FIXED

(Core :: Layout: Floats, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=347239538&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OaXGP6o0T8GlOihZO0cRvg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-08-03T10:25:29.343Z] 10:25:29     INFO - TEST-PASS | /css/css-shapes/shape-outside/values/shape-outside-ellipse-005.html | test unit: vw - ellipse(25vw farthest-side) - computed 
[task 2021-08-03T10:25:29.343Z] 10:25:29     INFO - TEST-PASS | /css/css-shapes/shape-outside/values/shape-outside-ellipse-005.html | test unit: vw - ellipse(farthest-side 75vw) - computed 
[task 2021-08-03T10:25:29.343Z] 10:25:29     INFO - TEST-UNEXPECTED-PASS | /css/css-shapes/shape-outside/values/shape-outside-ellipse-005.html | test unit: vh - ellipse(50vh 100vh) - computed - expected FAIL
[task 2021-08-03T10:25:29.343Z] 10:25:29     INFO - TEST-INFO | expected FAIL
[task 2021-08-03T10:25:29.344Z] 10:25:29     INFO - 
[task 2021-08-03T10:25:29.344Z] 10:25:29     INFO - TEST-UNEXPECTED-PASS | /css/css-shapes/shape-outside/values/shape-outside-ellipse-005.html | test unit: vh - ellipse(100vh 100px) - computed - expected FAIL
[task 2021-08-03T10:25:29.344Z] 10:25:29     INFO - TEST-INFO | expected FAIL
[task 2021-08-03T10:25:29.345Z] 10:25:29     INFO - 
[task 2021-08-03T10:25:29.345Z] 10:25:29     INFO - TEST-UNEXPECTED-PASS | /css/css-shapes/shape-outside/values/shape-outside-ellipse-005.html | test unit: vh - ellipse(50vh 25%) - computed - expected FAIL
[task 2021-08-03T10:25:29.345Z] 10:25:29     INFO - TEST-INFO | expected FAIL
[task 2021-08-03T10:25:29.346Z] 10:25:29     INFO - 
[task 2021-08-03T10:25:29.346Z] 10:25:29     INFO - TEST-UNEXPECTED-PASS | /css/css-shapes/shape-outside/values/shape-outside-ellipse-005.html | test unit: vh - ellipse(25% 50vh) - computed - expected FAIL
[task 2021-08-03T10:25:29.346Z] 10:25:29     INFO - TEST-INFO | expected FAIL
[task 2021-08-03T10:25:29.347Z] 10:25:29     INFO - 
[task 2021-08-03T10:25:29.347Z] 10:25:29     INFO - TEST-UNEXPECTED-PASS | /css/css-shapes/shape-outside/values/shape-outside-ellipse-005.html | test unit: vh - ellipse(25vh closest-side) - computed - expected FAIL
[task 2021-08-03T10:25:29.347Z] 10:25:29     INFO - TEST-INFO | expected FAIL
[task 2021-08-03T10:25:29.347Z] 10:25:29     INFO - 
[task 2021-08-03T10:25:29.347Z] 10:25:29     INFO - TEST-UNEXPECTED-PASS | /css/css-shapes/shape-outside/values/shape-outside-ellipse-005.html | test unit: vh - ellipse(closest-side 75vh) - computed - expected FAIL
[task 2021-08-03T10:25:29.347Z] 10:25:29     INFO - TEST-INFO | expected FAIL
[task 2021-08-03T10:25:29.348Z] 10:25:29     INFO - 
[task 2021-08-03T10:25:29.348Z] 10:25:29     INFO - TEST-UNEXPECTED-PASS | /css/css-shapes/shape-outside/values/shape-outside-ellipse-005.html | test unit: vh - ellipse(25vh farthest-side) - computed - expected FAIL
[task 2021-08-03T10:25:29.348Z] 10:25:29     INFO - TEST-INFO | expected FAIL
[task 2021-08-03T10:25:29.349Z] 10:25:29     INFO - 
[task 2021-08-03T10:25:29.349Z] 10:25:29     INFO - TEST-UNEXPECTED-PASS | /css/css-shapes/shape-outside/values/shape-outside-ellipse-005.html | test unit: vh - ellipse(farthest-side 75vh) - computed - expected FAIL
[task 2021-08-03T10:25:29.349Z] 10:25:29     INFO - TEST-INFO | expected FAIL

Comment 1

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Intermittent unexpected passes. This could just be annotated but do we know what caused this change to intermittent test results?

Comment 2

[Intermittent Failures Robot]

9 failures in 2829 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 1
  • debug: 1
• android-em-7-0-x86_64-lite-qr: 8
  • opt: 2
  • debug: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723727&startday=2021-08-02&endday=2021-08-08&tree=all

Comment 3

[Ting-Yu Lin [:TYLin] (PST, UTC-7)]

Sorry for the late reply. There's no recent change related to shapes or floats that I know of. Given the intermittent all happens on Android and the tests have viewport units like vh and vm, I guess it is related to Android viewport handling.

(cc Hiro)

Comment 4

[Intermittent Failures Robot]

1 failures in 3025 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723727&startday=2021-08-09&endday=2021-08-15&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 2899 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723727&startday=2021-08-16&endday=2021-08-22&tree=all

Comment 6

[Hiroyuki Ikezoe (:hiro)]

I seems to have missed the CC in comment 3. I know the change makes this test pass occasionally, it's bug 1718012. With bug 1718012, auto-scaling on mobile happens earlier than before, which makes the test more stable.

That said, that's not a proper solution on these kind of failure. We should just specify a meta viewport tag to avoid auto-scaling. If there's no meta viewport tag, the document will be laid out on 980px width canvas, it is going to be scaled to fit the device screen width, it happens during reflows, thus in the middle of the reflows the viewport units are not stable.

Comment 7

[Hiroyuki Ikezoe (:hiro)]

Attachment: Bug 1723727 - Specify a meta viewport tag to each files in /css/css-shapes/shape-outside/values/ to avoid auto-scaling on mobile. r?TYLin

Comment 8

[Ting-Yu Lin [:TYLin] (PST, UTC-7)]

Hiro, thanks for looking into this!

I was wondering whether bug 1723671, bug 1723726, bug 1723736, bug 1723739, and bug 1723740 are the same issue. Maybe we can add the viewport tag to every tests under /css/css-shapes/shape-outside/values/ to fix them all.

Comment 9

[Hiroyuki Ikezoe (:hiro)]

Yeah looks like all the bugs are same. I will add them in this bug. Thanks for noticing!

Comment 10

[Hiroyuki Ikezoe (:hiro)]

Looks like I've already included some of them. :)

Comment 11

[Hiroyuki Ikezoe (:hiro)]

A try run FWIW, waiting for Windows results; https://treeherder.mozilla.org/jobs?repo=try&revision=002b68de541229af48261b46a2336f50d9a9fd0c

Comment 12

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/30163 for changes under testing/web-platform/tests

Comment 13

[Iulian Moraru]

https://hg.mozilla.org/mozilla-central/rev/3e81e2a21310

Comment 14

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Upstream PR merged by moz-wptsync-bot

Comment 20

[Intermittent Failures Robot]

2 failures in 2580 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723727&startday=2021-08-23&endday=2021-08-29&tree=all

Comment 21

[Intermittent Failures Robot]

1 failures in 3375 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1723727&startday=2021-09-13&endday=2021-09-19&tree=all