1538379 - windows/aarch64 - define outcomes for tests that fail in /signed-exchange/reporting/

Status: NEW

(Testing :: web-platform-tests, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: egao [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=235548644&repo=try

https://queue.taskcluster.net/v1/task/YnFlYaq2TeWuXg7mXY6E1g/runs/0/artifacts/public/logs/live_backing.log

Test: wpt11

Platform: windows10-aarch64

Multiple tests spread across the directory that experience TEST-UNEXPECTED-TIMEOUT.

- sxg-reporting-navigation-mi_error.tentative.html
- sxg-reporting-navigation-parse_error.tentative.html
- sxg-reporting-prefetch-cert_fetch_error-downgraded.tentative.html
- sxg-reporting-prefetch-cert_fetch_error.tentative.html
- sxg-reporting-prefetch-cert_parse_error-downgraded.tentative.html
- sxg-reporting-prefetch-cert_parse_error.tentative.htm
- sxg-reporting-prefetch-cert_verification_error-downgraded.tentative.html
- sxg-reporting-prefetch-cert_verification_error.tentative.html
- sxg-reporting-prefetch-invalid_integrity_header.tentative.html
- sxg-reporting-prefetch-mi_error.tentative.html
- sxg-reporting-prefetch-ok.tentative.html
- sxg-reporting-prefetch-parse_error.tentative.html
- sxg-reporting-prefetch-signature_verification_error-downgraded.tentative.html
- sxg-reporting-prefetch-signature_verification_error.tentative.html

Context (one example):
21:28:36 INFO - PID 10596 | 1553290116919 Marionette INFO Listening on port 2828
21:28:37 INFO - TEST-START | /signed-exchange/reporting/sxg-reporting-prefetch-signature_verification_error.tentative.html
21:28:48 INFO -
21:28:48 INFO - TEST-UNEXPECTED-TIMEOUT | /signed-exchange/reporting/sxg-reporting-prefetch-signature_verification_error.tentative.html | SXG reporting test of sxg.signature_verification_error for prefetch. - Test timed out
21:28:48 INFO - TEST-UNEXPECTED-TIMEOUT | /signed-exchange/reporting/sxg-reporting-prefetch-signature_verification_error.tentative.html | expected OK
21:28:48 INFO - TEST-INFO took 10394ms

Comment 1

[Intermittent Failures Robot]

1 failures in 2561 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• windows10-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1538379&startday=2019-03-18&endday=2019-03-24&tree=all

Comment 2

[Edwin Takahashi (:egao | infrequent contributor)]

Tests had expected outcome adjusted in https://phabricator.services.mozilla.com/D24540#change-DGzE7EnxFclK.

Expected outcome is now PASS -> TIMEOUT. This bug will remain open to document that windows10-aarch64 cannot pass these tests.