Closed Bug 1383229 Opened 5 years ago Closed 3 years ago

Intermittent /css/CSS2/selectors/universal-selector-005.xht | Testing selectors/universal-selector-005.xht == universal-selector-005-ref.xht

Categories

(Core :: CSS Parsing and Computation, defect)

Product:
Core
Component:
CSS Parsing and Computation
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

()

Status:
RESOLVED FIXED
Milestone:
mozilla69
Tracking Flags:
Tracking Status
firefox-esr60 --- unaffected
firefox67 --- unaffected
firefox68 --- unaffected
firefox69 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: ccoroiu)

References

(Regression)

Details

(Keywords: intermittent-failure, regression, Whiteboard: [stockwell disabled])

Attachments

(3 files, 1 obsolete file)

Bug 1383229 - disabled universal-selector-005.xht on Win and Linux for frequent failures
47 bytes, text/x-phabricator-request
Details | Review
Bug 1383229 - delete universal-selector-005.xht expectancy r=jmaher
47 bytes, text/x-phabricator-request
Details | Review
Bug 1383229 - disabled universal-selector-005.xht on android r=jmaher
47 bytes, text/x-phabricator-request
Details | Review
Summary: Intermittent /css/CSS2/selectors/universal-selector-005.xht | Testing http://web-platform.test:8000/css/CSS2/selectors/universal-selector-005.xht == http://web-platform.test:8000/css/CSS2/selectors/universal-selector-005-ref.xht → Intermittent /css/CSS2/selectors/universal-selector-005.xht | Testing selectors/universal-selector-005.xht == http://web-platform.test:8000/css/CSS2/selectors/universal-selector-005-ref.xht
Whiteboard: [stockwell unknown]
Summary: Intermittent /css/CSS2/selectors/universal-selector-005.xht | Testing selectors/universal-selector-005.xht == http://web-platform.test:8000/css/CSS2/selectors/universal-selector-005-ref.xht → Intermittent /css/CSS2/selectors/universal-selector-005.xht | Testing selectors/universal-selector-005.xht == universal-selector-005-ref.xht
Component: web-platform-tests → CSS Parsing and Computation
Product: Testing → Core
Version: Version 3 → Trunk
There have been 32 occurrences in the last 7 days.
No. of failures per platform and build type:

- 29 failures - linux64 / asan & debug (mostly) and also 4 failures on opt & pgo
- 3 failures - linux32 / debug

Recent relevant log file:
https://treeherder.mozilla.org/logviewer.html#?job_id=190870198&repo=mozilla-inbound&lineNumber=11269

Reftest analyzer:
https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/IpGJvxVESNSic4ngMzk9Mg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1&only_show_unexpected=1
Flags: needinfo?(mreavy)
Whiteboard: [stockwell unknown] → [stockwell needswork]
Hi Sean, Can you ask someone to look into why this increased in frequency?  Thanks.
Flags: needinfo?(mreavy) → needinfo?(svoisen)

In the last 7 days, there have been 35 failures.

Most of the failures are on linux32, linux64 and windows7-32 platforms.
Affected build types: asan, debug, opt and pgo.

An example of a recent log file:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=231601651&repo=autoland&lineNumber=18017

:svoisen As you are the triage owner of this component, could you please take a look at this?
Thank you!

Whiteboard: [stockwell unknown] → [stockwell needswork]

Backed out for parsing error on universal-selector-005.xht.ini

backout: https://hg.mozilla.org/integration/autoland/rev/b3d74a35dd1bb1efd21cf9319184c2f234a1f0c5

push: https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=51a836e169e9ae755e541815bf95138f67362d08&group_state=expanded

failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=232746905&repo=autoland&lineNumber=1014

[task 2019-03-08T20:28:39.906Z] 20:28:39 INFO - mozversion platform_version: 67.0a1
[task 2019-03-08T20:28:50.724Z] 20:28:50 INFO - Closing logging queue
[task 2019-03-08T20:28:50.727Z] 20:28:50 INFO - queue closed
[task 2019-03-08T20:28:50.727Z] 20:28:50 CRITICAL - Test harness output was not a valid structured log message:
[task 2019-03-08T20:28:50.727Z] 20:28:50 CRITICAL - Traceback (most recent call last):
[task 2019-03-08T20:28:50.728Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/runtests.py", line 16, in <module>
[task 2019-03-08T20:28:50.728Z] 20:28:50 CRITICAL - rv = wptrunner.main()
[task 2019-03-08T20:28:50.729Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/wptrunner.py", line 355, in main
[task 2019-03-08T20:28:50.731Z] 20:28:50 CRITICAL - return start(**kwargs)
[task 2019-03-08T20:28:50.731Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/wptrunner.py", line 342, in start
[task 2019-03-08T20:28:50.731Z] 20:28:50 CRITICAL - return not run_tests(**kwargs)
[task 2019-03-08T20:28:50.732Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/wptrunner.py", line 153, in run_tests
[task 2019-03-08T20:28:50.732Z] 20:28:50 CRITICAL - **kwargs)
[task 2019-03-08T20:28:50.732Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/wptrunner.py", line 77, in get_loader
[task 2019-03-08T20:28:50.732Z] 20:28:50 CRITICAL - skip_timeout=kwargs["skip_timeout"])
[task 2019-03-08T20:28:50.732Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/testloader.py", line 456, in init
[task 2019-03-08T20:28:50.732Z] 20:28:50 CRITICAL - self._load_tests()
[task 2019-03-08T20:28:50.732Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/testloader.py", line 519, in _load_tests
[task 2019-03-08T20:28:50.733Z] 20:28:50 CRITICAL - for test_path, test_type, test in self.iter_tests():
[task 2019-03-08T20:28:50.733Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/testloader.py", line 510, in iter_tests
[task 2019-03-08T20:28:50.733Z] 20:28:50 CRITICAL - inherit_metadata, test_metadata = self.load_metadata(manifest_file, metadata_path, test_path)
[task 2019-03-08T20:28:50.733Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/testloader.py", line 490, in load_metadata
[task 2019-03-08T20:28:50.733Z] 20:28:50 CRITICAL - metadata_path, test_path, test_manifest.url_base, self.run_info)
[task 2019-03-08T20:28:50.733Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/manifestexpected.py", line 351, in get_manifest
[task 2019-03-08T20:28:50.734Z] 20:28:50 CRITICAL - url_base=url_base)
[task 2019-03-08T20:28:50.734Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/wptmanifest/backends/static.py", line 220, in compile
[task 2019-03-08T20:28:50.735Z] 20:28:50 CRITICAL - return compile_ast(parse(stream),
[task 2019-03-08T20:28:50.735Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/wptmanifest/parser.py", line 770, in parse
[task 2019-03-08T20:28:50.736Z] 20:28:50 CRITICAL - return p.parse(stream)
[task 2019-03-08T20:28:50.736Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/wptmanifest/parser.py", line 530, in parse
[task 2019-03-08T20:28:50.737Z] 20:28:50 CRITICAL - self.manifest()
[task 2019-03-08T20:28:50.737Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/wptmanifest/parser.py", line 549, in manifest
[task 2019-03-08T20:28:50.738Z] 20:28:50 CRITICAL - self.expect(token_types.eof)
[task 2019-03-08T20:28:50.738Z] 20:28:50 CRITICAL - File "/builds/worker/workspace/build/tests/web-platform/tests/tools/wptrunner/wptrunner/wptmanifest/parser.py", line 539, in expect
[task 2019-03-08T20:28:50.739Z] 20:28:50 CRITICAL - "Token '{}' doesn't equal expected type '{}'".format(self.token[0], type))
[task 2019-03-08T20:28:50.739Z] 20:28:50 CRITICAL - wptrunner.wptmanifest.parser.ParseError: Token 'string' doesn't equal expected type 'eof': /builds/worker/workspace/build/tests/web-platform/meta/css/CSS2/selectors/universal-selector-005.xht.ini line 2
[task 2019-03-08T20:28:51.136Z] 20:28:51 ERROR - Return code: 1
[task 2019-03-08T20:28:51.138Z] 20:28:51 ERROR - No checks run.
[task 2019-03-08T20:28:51.139Z] 20:28:51 ERROR - No suite end message was emitted by this harness.
[task 2019-03-08T20:28:51.139Z] 20:28:51 CRITICAL - # TBPL FAILURE #
[task 2019-03-08T20:28:51.139Z] 20:28:51 WARNING - setting return code to 2

Attachment #9049471 - Attachment is obsolete: true
Pushed by nbeleuzu@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/99b57fdeaf54
disabled universal-selector-005.xht on Win and Linux for frequent failures r=jmaher

https://hg.mozilla.org/mozilla-central/rev/99b57fdeaf54

Status: NEW → RESOLVED
Closed: 3 years ago
status-firefox67: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla67
Status: RESOLVED → REOPENED
status-firefox67: fixed → ---
Resolution: FIXED → ---
Whiteboard: [stockwell disable-recommended] → [stockwell disabled]
Target Milestone: mozilla67 → ---

This bug failed 40 times in the last 7 days. Occurs on android-em-7-0-x86 on opt build types.

Recent log:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=252936636&repo=mozilla-inbound&lineNumber=5934

svoisen: Can you please take a look at this bug?

Regressed by: 1558851
Keywords: regression

Recent failures here are from bug 1558851.

Flags: needinfo?(svoisen)
Keywords: checkin-needed

Pushed by rmaries@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/fae033f2ab2d
delete universal-selector-005.xht expectancy r=jmaher

Keywords: checkin-needed

https://hg.mozilla.org/mozilla-central/rev/fae033f2ab2d

Status: REOPENED → RESOLVED
Closed: 3 years ago → 3 years ago
status-firefox69: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla69
Assignee: nobody → ccoroiu

This is still occuring: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=253777485&repo=autoland&lineNumber=5930

Joel do we disable it? Failure rate seems to have went down.

Flags: needinfo?(jmaher)

failure rates are down, but still trending toward 15-20/week, I agree with disabling on android.

Flags: needinfo?(jmaher)
Keywords: leave-open
Pushed by apavel@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/5261b3fa83f4
disabled universal-selector-005.xht on android r=jmaher
Has Regression Range: --- → yes
You need to log in before you can comment on or make changes to this bug.