1633613 - Intermittent TEST-UNEXPECTED-NOTRUN | /webauthn/getcredential-rk-passing.https.html | undefined allowCredentials - expected FAIL

Status: RESOLVED FIXED

(Core :: DOM: Web Authentication, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: rmaries [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=299684052&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ZIsuleEQRsKwPKGntWsuVQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-04-27T23:37:35.720Z] 23:37:35 INFO - TEST-START | /webstorage/event_local_key.html
[task 2020-04-27T23:37:35.730Z] 23:37:35 INFO - Closing window 35
[task 2020-04-27T23:37:36.064Z] 23:37:36 INFO -
[task 2020-04-27T23:37:36.065Z] 23:37:36 INFO - TEST-TIMEOUT | /webauthn/getcredential-rk-passing.https.html | empty allowCredentials - Test timed out
[task 2020-04-27T23:37:36.065Z] 23:37:36 INFO - TEST-UNEXPECTED-NOTRUN | /webauthn/getcredential-rk-passing.https.html | undefined allowCredentials - expected FAIL
[task 2020-04-27T23:37:36.065Z] 23:37:36 INFO - TEST-INFO | expected FAIL
[task 2020-04-27T23:37:36.065Z] 23:37:36 INFO - TEST-UNEXPECTED-TIMEOUT | /webauthn/getcredential-rk-passing.https.html | expected OK
[task 2020-04-27T23:37:36.065Z] 23:37:36 INFO - TEST-INFO took 60478ms
[task 2020-04-27T23:37:36.096Z] 23:37:36 INFO - PID 3866 | 1588030656075 Marionette INFO Stopped listening on port 56610
[task 2020-04-27T23:37:36.108Z] 23:37:36 INFO - .
[task 2020-04-27T23:37:36.108Z] 23:37:36 INFO - TEST-OK | /webstorage/event_local_key.html | took 387ms

Comment 1

[Narcis Beleuzu [:NarcisB]]

Attachment: Bug 1633613 - Update mac expectancy for getcredential-rk-passing.https.html r?#intermittent-reviewers

Comment 2

[Intermittent Failures Robot]

19 failures in 1108 pushes (0.017 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 16
• mozilla-central: 2
• try: 1

Platform breakdown:

• macosx1014-64-shippable: 18
• macosx1014-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1633613&startday=2020-04-28&endday=2020-04-28&tree=all

Comment 3

[Edwin Takahashi (:egao | infrequent contributor)]

(pasted from phabricator)
I noticed that the bug this is filed against has only been open for a day or so. Is this failing at high enough levels and/or have developer recommendation to silence the failure?

Comment 4

[Andreea Pavel [:apavel]]

(In reply to Edwin Takahashi (:egao) from comment #3)

(pasted from phabricator)
I noticed that the bug this is filed against has only been open for a day or so. Is this failing at high enough levels and/or have developer recommendation to silence the failure?

This has 39 total failures since the 26th and it's a regression from a wpt sync.
To answer your question, by default, we can silence wpt sync regressions.

If the failure is not from a wpt sync, we investigate and ask more questions before updating the expectancy.

Comment 5

[Edwin Takahashi (:egao | infrequent contributor)]

(In reply to Andreea Pavel [:apavel] from comment #4)

(In reply to Edwin Takahashi (:egao) from comment #3)

(pasted from phabricator)
I noticed that the bug this is filed against has only been open for a day or so. Is this failing at high enough levels and/or have developer recommendation to silence the failure?

This has 39 total failures since the 26th and it's a regression from a wpt sync.
To answer your question, by default, we can silence wpt sync regressions.

If the failure is not from a wpt sync, we investigate and ask more questions before updating the expectancy.

Sounds good, thanks for clarifying.

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/3e64edf73d5a
Update mac expectancy for getcredential-rk-passing.https.html r=egao

Comment 7

[Cristian Brindusan [:cbrindusan]]

https://hg.mozilla.org/mozilla-central/rev/3e64edf73d5a

Comment 8

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1632033

Comment 9

[Cosmin Sabou [:CosminS]]

The entire test folder was disabled by https://hg.mozilla.org/integration/autoland/rev/df27a80ecb90 and will be re-enabled with Bug 1587563.

Comment 10

[Intermittent Failures Robot]

48 failures in 5423 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

This is the #36 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 39
• mozilla-central: 6
• try: 3

Platform breakdown:

• macosx1014-64-shippable: 46
• macosx1014-64-devedition: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1633613&startday=2020-04-27&endday=2020-05-03&tree=all

Comment 11

[John Schanck [:jschanck] (out of office Aug 11-18)]

The tests were re-enabled in Bug 1587563 without issue.