1733521 - Intermittent /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 0 updates animation correctly [element_auto_auto] - assert_approx_equals: expected 100 +/- 5 but got 106

Status: RESOLVED FIXED

(Testing :: web-platform-tests, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ctuns [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=353313197&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/aqEo0QTiSf2lLUCzOp5Big/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-10-01T05:15:54.711Z] 05:15:54     INFO - TEST-START | /scroll-animations/css/at-scroll-timeline-start-end.html
[task 2021-10-01T05:15:54.733Z] 05:15:54     INFO - Closing window 6953000f-9a98-4168-b087-082f8a43e345
[task 2021-10-01T05:15:57.831Z] 05:15:57     INFO - 
[task 2021-10-01T05:15:57.832Z] 05:15:57     INFO - TEST-KNOWN-INTERMITTENT-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 0 updates animation correctly [element_0px_100px] - assert_equals: expected "100px" but got "100.067px"
[task 2021-10-01T05:15:57.834Z] 05:15:57     INFO - test_width_at_scroll_top/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:106:20
[task 2021-10-01T05:15:57.835Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.836Z] 05:15:57     INFO - 
[task 2021-10-01T05:15:57.838Z] 05:15:57     INFO - TEST-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 1 updates animation correctly [element_0px_100px] - assert_equals: expected "101px" but got "102.067px"
[task 2021-10-01T05:15:57.839Z] 05:15:57     INFO - test_width_at_scroll_top/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:106:20
[task 2021-10-01T05:15:57.841Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.842Z] 05:15:57     INFO - TEST-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 50 updates animation correctly [element_0px_100px] - assert_equals: expected "150px" but got "102.733px"
[task 2021-10-01T05:15:57.843Z] 05:15:57     INFO - test_width_at_scroll_top/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:106:20
[task 2021-10-01T05:15:57.844Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.846Z] 05:15:57     INFO - TEST-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 99 updates animation correctly [element_0px_100px] - assert_equals: expected "199px" but got "102.917px"
[task 2021-10-01T05:15:57.848Z] 05:15:57     INFO - test_width_at_scroll_top/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:106:20
[task 2021-10-01T05:15:57.849Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.851Z] 05:15:57     INFO - TEST-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 100 updates animation correctly [element_0px_100px] - assert_equals: expected "0px" but got "103.25px"
[task 2021-10-01T05:15:57.852Z] 05:15:57     INFO - test_width_at_scroll_top/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:106:20
[task 2021-10-01T05:15:57.854Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.855Z] 05:15:57     INFO - TEST-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 101 updates animation correctly [element_0px_100px] - assert_equals: expected "0px" but got "103.75px"
[task 2021-10-01T05:15:57.856Z] 05:15:57     INFO - test_width_at_scroll_top/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:106:20
[task 2021-10-01T05:15:57.859Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.860Z] 05:15:57     INFO - TEST-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 0 updates animation correctly [element_50px_100px] - assert_equals: expected "0px" but got "103.9px"
[task 2021-10-01T05:15:57.862Z] 05:15:57     INFO - test_width_at_scroll_top/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:106:20
[task 2021-10-01T05:15:57.864Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.865Z] 05:15:57     INFO - TEST-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 1 updates animation correctly [element_50px_100px] - assert_equals: expected "0px" but got "104.233px"
[task 2021-10-01T05:15:57.866Z] 05:15:57     INFO - test_width_at_scroll_top/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:106:20
[task 2021-10-01T05:15:57.868Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.871Z] 05:15:57     INFO - TEST-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 49 updates animation correctly [element_50px_100px] - assert_equals: expected "0px" but got "104.417px"
[task 2021-10-01T05:15:57.873Z] 05:15:57     INFO - test_width_at_scroll_top/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:106:20
[task 2021-10-01T05:15:57.874Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.876Z] 05:15:57     INFO - TEST-KNOWN-INTERMITTENT-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 50 updates animation correctly [element_50px_100px] - assert_equals: expected "100px" but got "104.75px"
[task 2021-10-01T05:15:57.877Z] 05:15:57     INFO - test_width_at_scroll_top/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:106:20
[task 2021-10-01T05:15:57.878Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.880Z] 05:15:57     INFO - 
[task 2021-10-01T05:15:57.881Z] 05:15:57     INFO - TEST-KNOWN-INTERMITTENT-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 51 updates animation correctly [element_50px_100px] - assert_equals: expected "102px" but got "104.9px"
[task 2021-10-01T05:15:57.883Z] 05:15:57     INFO - test_width_at_scroll_top/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:106:20
[task 2021-10-01T05:15:57.884Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.886Z] 05:15:57     INFO - 
[task 2021-10-01T05:15:57.887Z] 05:15:57     INFO - TEST-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 99 updates animation correctly [element_50px_100px] - assert_equals: expected "198px" but got "105.4px"
[task 2021-10-01T05:15:57.889Z] 05:15:57     INFO - test_width_at_scroll_top/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:106:20
[task 2021-10-01T05:15:57.890Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.891Z] 05:15:57     INFO - TEST-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 100 updates animation correctly [element_50px_100px] - assert_equals: expected "0px" but got "105.733px"
[task 2021-10-01T05:15:57.891Z] 05:15:57     INFO - test_width_at_scroll_top/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:106:20
[task 2021-10-01T05:15:57.891Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.892Z] 05:15:57     INFO - TEST-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 101 updates animation correctly [element_50px_100px] - assert_equals: expected "0px" but got "106.083px"
[task 2021-10-01T05:15:57.892Z] 05:15:57     INFO - test_width_at_scroll_top/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:106:20
[task 2021-10-01T05:15:57.892Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.892Z] 05:15:57     INFO - TEST-UNEXPECTED-FAIL | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 0 updates animation correctly [element_auto_auto] - assert_approx_equals: expected 100 +/- 5 but got 106
[task 2021-10-01T05:15:57.892Z] 05:15:57     INFO - test_approximate_width_at_fraction/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:120:27
[task 2021-10-01T05:15:57.892Z] 05:15:57     INFO - test_scroll/<@http://web-platform.test:8000/scroll-animations/css/at-scroll-timeline-start-end.html:98:7
[task 2021-10-01T05:15:57.892Z] 05:15:57     INFO - 
[task 2021-10-01T05:15:57.893Z] 05:15:57     INFO - TEST-PASS | /scroll-animations/css/at-scroll-timeline-start-end.html | Scroll at offset 21 updates animation correctly [element_auto_auto] 

Comment 1

[Iulian Moraru]

This started to fail on tier 1: https://treeherder.mozilla.org/logviewer?job_id=353482340&repo=autoland&lineNumber=3165

Comment 2

[Intermittent Failures Robot]

15 failures in 165 pushes (0.091 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 12
• mozilla-central: 3

Platform and build breakdown:

• linux1804-64-tsan-qr: 8
  • opt: 8
• linux1804-64-qr: 1
  • debug: 1
• windows10-64-2004-qr: 6
  • debug: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1733521&startday=2021-10-02&endday=2021-10-02&tree=all

Comment 3

[Cosmin Sabou [:CosminS]]

Boris, could you please have a look over this frequent fail? Retriggers. Thank you.

Comment 4

[Intermittent Failures Robot]

39 failures in 3376 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

This is the #30 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 32
• mozilla-central: 7

Platform and build breakdown:

• linux1804-64-tsan-qr: 28
  • opt: 28
• windows10-64-2004-qr: 8
  • debug: 8
• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1733521&startday=2021-09-27&endday=2021-10-03&tree=all

Comment 5

[Boris Chiou [:boris]]

(In reply to Cosmin Sabou [:CosminS] from comment #3)

Boris, could you please have a look over this frequent fail? Retriggers. Thank you.

Sure, we should mark these as fail (or intermittent) because we don't support this feature right now.

Comment 6

[Boris Chiou [:boris]]

Attachment: Bug 1733521 - Mark intermittent in at-scroll-timeline-start-end.html

"Scroll at offset 0 updates animation correctly [element_auto_auto]" is
intermittent. Just mark it as intermittent because we don't support this
feature now and start and end descriptors will be obsolete sooner.

Comment 7

[Boris Chiou [:boris]]

try of this patch: https://treeherder.mozilla.org/jobs?repo=try&revision=c228bbc60e816923831337ec5d332004cbd5cef6

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/f12a240d70af
Mark intermittent in at-scroll-timeline-start-end.html r=jmaher

Comment 9

[Cristian Tuns]

https://hg.mozilla.org/mozilla-central/rev/f12a240d70af

Comment 10

[Marco Castelluccio [:marco]]

Set release status flags based on info from the regressing bug 1676784

Comment 11

[BugBot [:suhaib / :marco/ :calixte]]

The patch landed in nightly and beta is affected.
:boris, is this bug important enough to require an uplift?
If not please set status_beta to wontfix.

For more information, please visit auto_nag documentation.

Comment 12

[Intermittent Failures Robot]

4 failures in 3626 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• try: 2

Platform and build breakdown:

• linux1804-64-tsan-qr: 3
  • opt: 3
• windows10-64-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1733521&startday=2021-10-04&endday=2021-10-10&tree=all

Comment 13

[Cristian Tuns]

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=354339117&repo=autoland&lineNumber=30787

Comment 14

[Intermittent Failures Robot]

3 failures in 3315 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-beta: 1
• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1733521&startday=2021-10-11&endday=2021-10-17&tree=all

Comment 15

[Intermittent Failures Robot]

4 failures in 3186 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-beta: 2

Platform and build breakdown:

• linux1804-64-qr: 2
  • debug: 2
• linux1804-64-asan-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1733521&startday=2021-10-18&endday=2021-10-24&tree=all

Comment 16

[Boris Chiou [:boris]]

I intend to disable this test in https://phabricator.services.mozilla.com/D126452, but keep this bug open until we update the implementation and tests based on the spec proposal.

Comment 17

[Intermittent Failures Robot]

3 failures in 2845 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1
• mozilla-release: 1

Platform and build breakdown:

• linux1804-64-qr: 2
  • debug: 2
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1733521&startday=2021-10-25&endday=2021-10-31&tree=all

Comment 18

[Boris Chiou [:boris]]

Close this because we push the patch already and this test file will be dropped soon.