1565072 - [test disabled] High frequency Android 7.0 x86-64 opt/debug /css/cssom-view/scroll-behavior-default-css.html | /css/cssom-view/scroll-behavior-element.html | Smooth scrolling of an element...

Status: RESOLVED INCOMPLETE

(Core :: DOM: CSS Object Model, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: csabou [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=255747664&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/LRdLyV3SRBGSUc5Iq35Tbg/runs/0/artifacts/public/logs/live_backing.log

---

This started when Bug 1564846 landed here: https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception&searchStr=android%2Cwpt&tochange=15c5f53a00653d0228a550ef4655bea567992cdc&fromchange=5382e671e265de2eeeb4910eb430b7d09b09afde&selectedJob=255792501

Failure logs: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=255750550&repo=autoland&lineNumber=2623
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=255792502&repo=autoland&lineNumber=2627

Comment 1

[Intermittent Failures Robot]

69 failures in 1024 pushes (0.067 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 68
• mozilla-central: 1

Platform breakdown:

• android-em-7-0-x86_64: 69

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-07-10&endday=2019-07-10&tree=all

Comment 2

[James Willcox (:snorp) ([e-mail]) (he/him)]

Hmm, that's not good. I guess we'll keep an eye on it for a while.

Comment 3

[Intermittent Failures Robot]

109 failures in 893 pushes (0.122 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 84
• mozilla-inbound: 13
• mozilla-central: 11
• try: 1

Platform breakdown:

• android-em-7-0-x86_64: 109

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-07-11&endday=2019-07-11&tree=all

Comment 4

[Dorel Luca [:dluca]]

Attachment: Bug 1565072 - Added WPT expectation for scroll-behavior-default-css.html r=jmaher

Comment 5

[Intermittent Failures Robot]

80 failures in 837 pushes (0.096 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 68
• mozilla-inbound: 7
• mozilla-central: 3
• try: 2

Platform breakdown:

• android-em-7-0-x86_64: 80

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-07-12&endday=2019-07-12&tree=all

Comment 7

[Cosmin Sabou [:CosminS]]

Joel, I would hold off on landing this because they will fail as TEST-UNEXPECTED-PASS, see this try push: https://treeherder.mozilla.org/#/jobs?repo=try&revision=a745c2eaf8b87a76940ec5ad0ed81cecd78887ea&group_state=expanded&selectedJob=256326317
James, Maja any thoughts on how to update this in order to not have them failing, or can we go ahead and disable them?

Comment 8

[Joel Maher ( :jmaher ) (UTC -8)]

with 281 failures in the past week, this sounds like something we shouldn't ignore. I am all for adjusting test expectations, but we also need green tests. We have rules in place that say disable a test if we have 150+ failures in a week, we should stick to them as much as possible.

This started failing July 10th, is there a root cause we can track this down to and backout?

Comment 9

[Cosmin Sabou [:CosminS]]

Joel, I totally agree, cause it's failing a lot on trees. There are three tests constantly failing here: scroll-behavior-default-css.html, scroll-behavior-element.html and scroll-behavior-smooth-positions.html. The root cause it's Bug 1564846 as stated in the first comment and :snorp is aware of the situation. (by the looks of comment 2) Also Bug 1564846 is a blocker for bug 1516298 in which :kats had this to say https://bugzilla.mozilla.org/show_bug.cgi?id=1516298#c37 I'm fine with backing this out.

Comment 10

[Joel Maher ( :jmaher ) (UTC -8)]

I think we should back it out, with multiple test failures and the high frequency and a clear root cause we can back out. This means the tests are useful :) When the tests are useful and we have a clear signal it should be healthy to backout the root cause.

Comment 11

[Cosmin Sabou [:CosminS]]

This should be fixed by this backout: https://hg.mozilla.org/integration/autoland/rev/16da75efcffe8c6cb038fbd4651c30e6dd79e7f5
Let's see if the failure rate improve.

Comment 12

[Kartikaya Gupta (email:[e-mail])]

Many of the scroll behaviour tests are failing or disabled on GV:

https://searchfox.org/mozilla-central/source/testing/web-platform/meta/css/cssom-view/scroll-behavior-main-frame-root.html.ini
https://searchfox.org/mozilla-central/source/testing/web-platform/meta/css/cssom-view/scroll-behavior-smooth.html.ini
https://searchfox.org/mozilla-central/source/testing/web-platform/meta/css/cssom-view/scroll-behavior-subframe-root.html.ini
https://searchfox.org/mozilla-central/source/testing/web-platform/meta/css/cssom-view/scroll-behavior-subframe-window.html.ini
https://searchfox.org/mozilla-central/source/testing/web-platform/meta/css/cssom-view/scrollIntoView-scrollMargin.html.ini
https://searchfox.org/mozilla-central/source/testing/web-platform/meta/css/cssom-view/scrollIntoView-smooth.html.ini

I would prefer to skip this test on GV and reland snorp's fix, and then somebody should look into what's wrong with all these scroll behaviour things.

Comment 13

[Maja Frydrychowicz :impossibus (was :maja_zf) (needinfo me)]

(In reply to Cosmin Sabou [:CosminS] from comment #7)

Joel, I would hold off on landing this because they will fail as TEST-UNEXPECTED-PASS, see this try push: https://treeherder.mozilla.org/#/jobs?repo=try&revision=a745c2eaf8b87a76940ec5ad0ed81cecd78887ea&group_state=expanded&selectedJob=256326317
James, Maja any thoughts on how to update this in order to not have them failing, or can we go ahead and disable them?

As you say, if the pass/fail rates are similar, changing the expectations won't help. The only other options is disabling.

Comment 14

[Maja Frydrychowicz :impossibus (was :maja_zf) (needinfo me)]

(In reply to Kartikaya Gupta (email:[e-mail]) (away 17-Jul-2019 to Feb-2020) from comment #12)

Many of the scroll behaviour tests are failing or disabled on GV:

Although it's true that many scroll tests were disabled on GV for some time, this test was still on because it was stable. The fact that it's suddenly failing is a useful signal. It's clearly different from the other scroll tests.

Comment 15

[Intermittent Failures Robot]

19 failures in 179 pushes (0.106 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• try: 6
• autoland: 5
• mozilla-central: 3
• mozilla-inbound: 5

Platform breakdown:

• android-em-7-0-x86_64: 19

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-07-13&endday=2019-07-13&tree=all

Comment 16

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/b3a80b3b1cfe
Added WPT expectation for scroll-behavior-default-css.html r=jmaher

Comment 17

[Dorel Luca [:dluca]]

https://hg.mozilla.org/mozilla-central/rev/b3a80b3b1cfe

Comment 18

[Intermittent Failures Robot]

287 failures in 4710 pushes (0.061 failures/push) were associated with this bug in the last 7 days.

This is the #2 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 231
• mozilla-central: 20
• mozilla-inbound: 27
• try: 9

Platform breakdown:

• android-em-7-0-x86_64: 287

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-07-08&endday=2019-07-14&tree=all

Comment 19

[Andreea Pavel [:apavel]]

Attachment: Bug 1565072 - disable scroll-behavior-default-css.html on anroid r=jmaher

Comment 20

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/47baf7fd39d7
disable scroll-behavior-default-css.html on anroid r=jmaher

Comment 21

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/47baf7fd39d7

Comment 22

[Intermittent Failures Robot]

38 failures in 792 pushes (0.048 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 20
• mozilla-inbound: 9
• mozilla-central: 4
• try: 5

Platform breakdown:

• android-em-7-0-x86_64: 38

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-07-15&endday=2019-07-15&tree=all

Comment 23

[Intermittent Failures Robot]

40 failures in 4298 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

This is the #42 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 20
• mozilla-inbound: 9
• mozilla-central: 4
• try: 7

Platform breakdown:

• android-em-7-0-x86_64: 40

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-07-15&endday=2019-07-21&tree=all

Comment 24

[Intermittent Failures Robot]

1 failures in 4608 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-07-22&endday=2019-07-28&tree=all

Comment 25

[Intermittent Failures Robot]

2 failures in 4408 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• android-em-7-0-x86_64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-09-02&endday=2019-09-08&tree=all

Comment 26

[Intermittent Failures Robot]

2 failures in 4637 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• android-em-7-0-x86_64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-09-09&endday=2019-09-15&tree=all

Comment 27

[Intermittent Failures Robot]

1 failures in 4350 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-09-16&endday=2019-09-22&tree=all

Comment 28

[Intermittent Failures Robot]

2 failures in 4292 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-inbound: 1

Platform breakdown:

• android-em-7-0-x86_64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-09-30&endday=2019-10-06&tree=all

Comment 29

[Intermittent Failures Robot]

1 failures in 3964 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-10-14&endday=2019-10-20&tree=all

Comment 30

[Intermittent Failures Robot]

2 failures in 4182 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• android-em-7-0-x86_64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-10-21&endday=2019-10-27&tree=all

Comment 31

[Intermittent Failures Robot]

1 failures in 4314 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-10-28&endday=2019-11-03&tree=all

Comment 32

[Intermittent Failures Robot]

1 failures in 5444 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2019-11-18&endday=2019-11-24&tree=all

Comment 33

[Intermittent Failures Robot]

2 failures in 3773 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• android-em-7-0-x86_64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2020-01-13&endday=2020-01-19&tree=all

Comment 34

[Intermittent Failures Robot]

1 failures in 4004 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2020-01-20&endday=2020-01-26&tree=all

Comment 35

[Intermittent Failures Robot]

1 failures in 4045 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2020-02-17&endday=2020-02-23&tree=all

Comment 36

[Intermittent Failures Robot]

1 failures in 5015 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2020-03-30&endday=2020-04-05&tree=all

Comment 37

[Intermittent Failures Robot]

1 failures in 4949 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform breakdown:

• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1565072&startday=2020-06-01&endday=2020-06-07&tree=all

Comment 38

[Intermittent Failures Robot]

1 failures in 3888 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1565072&startday=2022-11-21&endday=2022-11-27&tree=all

Comment 39

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.