1624089 - Intermittent TEST-UNEXPECTED-TIMEOUT | /css/vendor-imports/mozilla/mozilla-central-reftests/masking/mask-image-3h.html | expected PASS

Status: RESOLVED INCOMPLETE

(Core :: CSS Parsing and Computation, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: malexandru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=294166649&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/bcjv1bp9QSW1hfdYYVLdgA/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/bcjv1bp9QSW1hfdYYVLdgA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2020-03-21T04:49:46.859Z] 04:49:46     INFO - TEST-START | /css/vendor-imports/mozilla/mozilla-central-reftests/masking/mask-image-3f.html
[task 2020-03-21T04:50:07.216Z] 04:50:07     INFO - TEST-KNOWN-INTERMITTENT-TIMEOUT | /css/vendor-imports/mozilla/mozilla-central-reftests/masking/mask-image-3f.html | took 20359ms
[task 2020-03-21T04:50:07.217Z] 04:50:07     INFO - TEST-START | /css/vendor-imports/mozilla/mozilla-central-reftests/masking/mask-image-3g.html
[task 2020-03-21T04:50:28.448Z] 04:50:28     INFO - TEST-KNOWN-INTERMITTENT-TIMEOUT | /css/vendor-imports/mozilla/mozilla-central-reftests/masking/mask-image-3g.html | took 21232ms
[task 2020-03-21T04:50:28.450Z] 04:50:28     INFO - TEST-START | /css/vendor-imports/mozilla/mozilla-central-reftests/masking/mask-image-3h.html
[task 2020-03-21T04:50:48.799Z] 04:50:48     INFO - TEST-UNEXPECTED-TIMEOUT | /css/vendor-imports/mozilla/mozilla-central-reftests/masking/mask-image-3h.html | expected PASS
[task 2020-03-21T04:50:48.800Z] 04:50:48     INFO - TEST-INFO took 20350ms
[task 2020-03-21T04:50:50.104Z] 04:50:50     INFO - Closing logging queue
[task 2020-03-21T04:50:50.104Z] 04:50:50     INFO - queue closed
[task 2020-03-21T04:50:50.120Z] 04:50:50     INFO - Setting android reftest preferences
[task 2020-03-21T04:50:50.120Z] 04:50:50     INFO - Setting up ssl
[task 2020-03-21T04:50:50.237Z] 04:50:50     INFO - certutil | 
[task 2020-03-21T04:50:50.312Z] 04:50:50     INFO - certutil | 
[task 2020-03-21T04:50:50.328Z] 04:50:50     INFO - certutil | 
[task 2020-03-21T04:50:50.328Z] 04:50:50     INFO - Certificate Nickname                                         Trust Attributes
[task 2020-03-21T04:50:50.328Z] 04:50:50     INFO -                                                              SSL,S/MIME,JAR/XPI
[task 2020-03-21T04:50:50.328Z] 04:50:50     INFO - 
[task 2020-03-21T04:50:50.328Z] 04:50:50     INFO - web-platform-tests                                           CT,, 
[task 2020-03-21T04:50:50.328Z] 04:50:50     INFO - 
[task 2020-03-21T04:50:53.258Z] 04:50:53     INFO - adb Granting important runtime permissions to org.mozilla.geckoview.test
[task 2020-03-21T04:50:55.009Z] 04:50:55     INFO - adb launch_application: am start -W -n org.mozilla.geckoview.test/org.mozilla.geckoview.test.TestRunnerActivity -a android.intent.action.MAIN --es env9 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env8 R_LOG_DESTINATION=stderr --es args "-no-remote -profile /sdcard/tests/profile --marionette about:blank" --es env3 MOZ_HIDE_RESULTS_TABLE=1 --es env2 R_LOG_VERBOSE=1 --es env1 MOZ_WEBRENDER=0 --es env0 MOZ_CRASHREPORTER=1 --es env7 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env6 MOZ_IN_AUTOMATION=1 --es env5 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --es env4 STYLO_THREADS=1 --ez use_multiprocess True --es env12 R_LOG_LEVEL=6 --es env11 MOZ_PROCESS_LOG=/tmp/tmp5j5eeKpidlog --es env10 MOZ_CRASHREPORTER_NO_REPORT=1
[task 2020-03-21T04:50:56.706Z] 04:50:56     INFO - Starting runner
[task 2020-03-21T04:50:56.833Z] 04:50:56     INFO - TEST-START | /css/vendor-imports/mozilla/mozilla-central-reftests/masking/mask-image-3i.html

Comment 1

[Intermittent Failures Robot]

11 failures in 4955 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 7
• try: 2

Platform breakdown:

• android-em-7-0-x86_64: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1624089&startday=2020-03-16&endday=2020-03-22&tree=all

Comment 2

[Cristina Coroiu [:ccoroiu]]

Started to frequently fail with this push: https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=Android%2C7.0%2Cx86-64%2Copt%2CWeb%2Cplatform%2Ctests%2Ctest-android-em-7.0-x86_64%2Fopt-geckoview-web-platform-tests-reftests-e10s-2%2CW%28Wr2%29&tochange=bbb78f71a5de9849f6697da61a062f59ec960f97&fromchange=98683930e86de8c65dc7a09b17018edecdc7db9d&selectedJob=294746737

James, can you please take a look? Can we update the expectations?

Comment 3

[Intermittent Failures Robot]

16 failures in 884 pushes (0.018 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• try: 2

Platform breakdown:

• android-em-7-0-x86_64: 16

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1624089&startday=2020-03-27&endday=2020-03-27&tree=all

Comment 4

[Intermittent Failures Robot]

49 failures in 4773 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #17 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 36
• try: 6
• mozilla-central: 7

Platform breakdown:

• android-em-7-0-x86_64: 48
• android-hw-p2-8-0-android-aarch64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1624089&startday=2020-03-23&endday=2020-03-29&tree=all

Comment 5

[Andrei Ciure[:aciure]]

There are 31 failures associated to this bug in the last 7 days. These are occurring on android-em-7-0-x86_64 opt builds.

recent log: https://treeherder.mozilla.org/logviewer.html#?job_id=294861021&repo=autoland

Sean, can you take a look at this?

Comment 6

[Intermittent Failures Robot]

8 failures in 5015 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• autoland: 5
• mozilla-central: 1

Platform breakdown:

• android-em-7-0-x86_64: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1624089&startday=2020-03-30&endday=2020-04-05&tree=all

Comment 7

[James Graham [:jgraham]]

I'm confused by this. There's no reftest-wait in these files so if they're timing out it either means something's broken in the harness, or we're not finishing the load+paint within the timeout. I think it makes sense for someone in layout to look at the tests and figure out what's actually going on.

Comment 8

[Cosmin Sabou [:CosminS]]

Emilio, any chance you can tackle what James said in comment 7? There's also https://bugzilla.mozilla.org/show_bug.cgi?id=1626430#c1 for a bit of context about what's going on.

Comment 9

[Emilio Cobos Álvarez (:emilio)]

mask-image-3f.html and mask-image-3g.html are using local masks, so there's nothing that we need to wait for.

The only thing that comes to mind other than a harness bug would be a bug where we incorrectly don't unblock the load event when the mask loads... But that's somewhat unlikely, that should be much much more frequent.

Comment 10

[Cosmin Sabou [:CosminS]]

It started with Bug 1616095 and as one test was updated for timeouts the next one in line started doing the same, and so on. This is what I observed across all the filed reftests/masking* bugs hence https://phabricator.services.mozilla.com/D69693.

Comment 11

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

Attachment: a `git log --name-only` of changes that seem relevant here

Comment 12

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

So there's been a lot of churn in this directory recently. The vast majority of it seems to be updates to the expectations of mask-image-1d.html. (There, the change in bug 1553584 seems like it might be the origin of the problem?)

For everything other than that test, the timeouts seem Android-opt only. For that one test they appear to be more general.

Comment 13

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

I think understanding the relationship to the changes in https://hg.mozilla.org/mozilla-central/rev/c271ae1b60b9 would likely be a good place to start.

Comment 14

[James Graham [:jgraham]]

I actually reenabled these recently; the issue seems to be fixed.

Comment 15

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.