Open Bug 1546662 Opened 8 months ago Updated 7 months ago

webauth tests have become unstable

Categories

(Core :: DOM: Web Authentication, defect, P2)

defect

Tracking

()

REOPENED
mozilla68
Tracking Status
firefox68 --- affected

People

(Reporter: jgraham, Assigned: jgraham)

References

Details

After the latest wpt import the following tests keep switching between TIMEOUT/NOTRUN and whatever their real status is (PASS or FAIL). I've already been backed out once for this and I really don't want to be again, so as a short term measure I'm going to disable the follwoing list of tests:

/webauthn/createcredential-badargs-authnrselection.https.html
/webauthn/createcredential-badargs-rp.https.html
/webauthn/createcredential-badargs-user.https.html
/webauthn/createcredential-excludecredentials.https.html
/webauthn/createcredential-extensions.https.html
/webauthn/createcredential-passing.https.html
/webauthn/getcredential-badargs-rpid.https.html
/webauthn/getcredential-badargs-userverification.https.html
/webauthn/getcredential-extensions.https.html
/webauthn/getcredential-passing.https.html
/webauthn/getcredential-timeout.https.html

It may just be that they need a longer timeout. It may be that we need some pref to stop a prompt from interfering with the tests. I hope someone working on webauthn can investigate and reenable these as soon as possible.

Pushed by james@hoppipolla.co.uk:
https://hg.mozilla.org/integration/mozilla-inbound/rev/da523e237c3d
Disable webauthn tests for instability, a=testonly
Status: NEW → RESOLVED
Closed: 8 months ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla68
Status: RESOLVED → REOPENED
Resolution: FIXED → ---

It's unclear why the WPTs became unstable when our internal tests didn't. Nevertheless, can't get to this in 68.

Priority: -- → P2
You need to log in before you can comment on or make changes to this bug.