Closed Bug 1918590 Opened 1 year ago Closed 1 year ago

[wpt-sync] Sync PR 48144 - [WebCryptoAPI] test generateKey > exportKey roundtrip

Categories

(Core :: DOM: Web Crypto, task, P4)

Product:
Core
Component:
DOM: Web Crypto
Type:
task

Tracking

()

Status:
RESOLVED FIXED
Milestone:
132 Branch
Tracking Flags:
Tracking Status
firefox132 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 48144 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/48144
Details from upstream follow.

Filip Skokan <panva.ip@gmail.com> wrote:

[WebCryptoAPI] test generateKey > exportKey roundtrip

A bug in the recent implementation of X25519 has shown that the pattern of generateKey -> exportKey is not tested. This amends the generateKey test cases with an export step to all supported formats for the respective algorithms.

Component: web-platform-tests → DOM: Web Crypto
Product: Testing → Core

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 70 tests and 16 subtests

Status Summary

Firefox

OK : 70
PASS : 3000
FAIL : 100

Chrome

OK : 70
PASS : 2408
FAIL : 692

Safari

OK : 69
PASS : 2744
CRASH: 1
FAIL : 68

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

  • /WebCryptoAPI/generateKey/successes_X25519.https.any.worker.html [wpt.fyi]
    • Success: generateKey({name: X25519}, false, [deriveKey]): FAIL
    • Success: generateKey({name: X25519}, true, [deriveKey]): FAIL
    • Success: generateKey({name: X25519}, false, [deriveBits, deriveKey]): FAIL
    • Success: generateKey({name: X25519}, true, [deriveBits, deriveKey]): FAIL
    • Success: generateKey({name: X25519}, false, [deriveBits]): FAIL
    • Success: generateKey({name: X25519}, true, [deriveBits]): FAIL
    • Success: generateKey({name: X25519}, false, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL
    • Success: generateKey({name: X25519}, true, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL
    • Success: generateKey({name: x25519}, false, [deriveKey]): FAIL
    • Success: generateKey({name: x25519}, true, [deriveKey]): FAIL
    • Success: generateKey({name: x25519}, false, [deriveBits, deriveKey]): FAIL
    • Success: generateKey({name: x25519}, true, [deriveBits, deriveKey]): FAIL
    • Success: generateKey({name: x25519}, false, [deriveBits]): FAIL
    • Success: generateKey({name: x25519}, true, [deriveBits]): FAIL
    • Success: generateKey({name: x25519}, false, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL
    • Success: generateKey({name: x25519}, true, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL
  • /WebCryptoAPI/generateKey/successes_X25519.https.any.html [wpt.fyi]
    • Success: generateKey({name: X25519}, false, [deriveKey]): FAIL
    • Success: generateKey({name: X25519}, true, [deriveKey]): FAIL
    • Success: generateKey({name: X25519}, false, [deriveBits, deriveKey]): FAIL
    • Success: generateKey({name: X25519}, true, [deriveBits, deriveKey]): FAIL
    • Success: generateKey({name: X25519}, false, [deriveBits]): FAIL
    • Success: generateKey({name: X25519}, true, [deriveBits]): FAIL
    • Success: generateKey({name: X25519}, false, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL
    • Success: generateKey({name: X25519}, true, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL
    • Success: generateKey({name: x25519}, false, [deriveKey]): FAIL
    • Success: generateKey({name: x25519}, true, [deriveKey]): FAIL
    • Success: generateKey({name: x25519}, false, [deriveBits, deriveKey]): FAIL
    • Success: generateKey({name: x25519}, true, [deriveBits, deriveKey]): FAIL
    • Success: generateKey({name: x25519}, false, [deriveBits]): FAIL
    • Success: generateKey({name: x25519}, true, [deriveBits]): FAIL
    • Success: generateKey({name: x25519}, false, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL
    • Success: generateKey({name: x25519}, true, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL

New Tests That Don't Pass

  • /WebCryptoAPI/generateKey/successes_Ed448.https.any.html [wpt.fyi]
    • Success: generateKey({name: ED448}, false, [sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ED448}, true, [sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ED448}, false, [verify, sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ED448}, true, [verify, sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ED448}, false, [sign, verify, sign, sign, verify]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ED448}, true, [sign, verify, sign, sign, verify]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ed448}, false, [sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ed448}, true, [sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ed448}, false, [verify, sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ed448}, true, [verify, sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ed448}, false, [sign, verify, sign, sign, verify]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ed448}, true, [sign, verify, sign, sign, verify]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: Ed448}, false, [sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: Ed448}, true, [sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: Ed448}, false, [verify, sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: Ed448}, true, [verify, sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: Ed448}, false, [sign, verify, sign, sign, verify]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: Ed448}, true, [sign, verify, sign, sign, verify]): FAIL (Chrome: FAIL, Safari: FAIL)
  • /WebCryptoAPI/generateKey/successes_Ed448.https.any.worker.html [wpt.fyi]
    • Success: generateKey({name: ED448}, false, [sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ED448}, true, [sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ED448}, false, [verify, sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ED448}, true, [verify, sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ED448}, false, [sign, verify, sign, sign, verify]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ED448}, true, [sign, verify, sign, sign, verify]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ed448}, false, [sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ed448}, true, [sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ed448}, false, [verify, sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ed448}, true, [verify, sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ed448}, false, [sign, verify, sign, sign, verify]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: ed448}, true, [sign, verify, sign, sign, verify]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: Ed448}, false, [sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: Ed448}, true, [sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: Ed448}, false, [verify, sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: Ed448}, true, [verify, sign]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: Ed448}, false, [sign, verify, sign, sign, verify]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: Ed448}, true, [sign, verify, sign, sign, verify]): FAIL (Chrome: FAIL, Safari: FAIL)
  • /WebCryptoAPI/generateKey/successes_X25519.https.any.worker.html [wpt.fyi]
    • Success: generateKey({name: X25519}, false, [deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: X25519}, true, [deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: X25519}, false, [deriveBits, deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: X25519}, true, [deriveBits, deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: X25519}, false, [deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: X25519}, true, [deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: X25519}, false, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: X25519}, true, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, false, [deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, true, [deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, false, [deriveBits, deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, true, [deriveBits, deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, false, [deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, true, [deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, false, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, true, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
  • /WebCryptoAPI/generateKey/successes_X25519.https.any.html [wpt.fyi]
    • Success: generateKey({name: X25519}, false, [deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: X25519}, true, [deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: X25519}, false, [deriveBits, deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: X25519}, true, [deriveBits, deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: X25519}, false, [deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: X25519}, true, [deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: X25519}, false, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: X25519}, true, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, false, [deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, true, [deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, false, [deriveBits, deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, true, [deriveBits, deriveKey]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, false, [deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, true, [deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, false, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
    • Success: generateKey({name: x25519}, true, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: PASS, Safari: PASS)
  • /WebCryptoAPI/generateKey/successes_X448.https.any.html [wpt.fyi]
    • Success: generateKey({name: X448}, false, [deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: X448}, true, [deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: X448}, false, [deriveBits, deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: X448}, true, [deriveBits, deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: X448}, false, [deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: X448}, true, [deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: X448}, false, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: X448}, true, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, false, [deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, true, [deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, false, [deriveBits, deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, true, [deriveBits, deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, false, [deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, true, [deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, false, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, true, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
  • /WebCryptoAPI/generateKey/successes_X448.https.any.worker.html [wpt.fyi]
    • Success: generateKey({name: X448}, false, [deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: X448}, true, [deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: X448}, false, [deriveBits, deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: X448}, true, [deriveBits, deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: X448}, false, [deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: X448}, true, [deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: X448}, false, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: X448}, true, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, false, [deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, true, [deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, false, [deriveBits, deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, true, [deriveBits, deriveKey]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, false, [deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, true, [deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, false, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
    • Success: generateKey({name: x448}, true, [deriveKey, deriveBits, deriveKey, deriveBits, deriveKey, deriveBits]): FAIL (Chrome: FAIL, Safari: FAIL)
Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/a1444ef61005 [wpt PR 48144] - [WebCryptoAPI] test generateKey > exportKey roundtrip, a=testonly https://hg.mozilla.org/integration/autoland/rev/0191a3669d9b [wpt PR 48144] - Update wpt metadata, a=testonly

https://hg.mozilla.org/mozilla-central/rev/a1444ef61005
https://hg.mozilla.org/mozilla-central/rev/0191a3669d9b

Status: NEW → RESOLVED
Closed: 1 year ago
status-firefox132: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 132 Branch
You need to log in before you can comment on or make changes to this bug.