Closed Bug 1881371 Opened 1 year ago Closed 1 year ago

[wpt-sync] Sync PR 44720 - Use the 'verified' field of the test vectors.

Categories

(Core :: DOM: Web Crypto, task, P4)

Product:
Core
Component:
DOM: Web Crypto
Type:
task

Tracking

()

Status:
RESOLVED FIXED
Milestone:
126 Branch
Tracking Flags:
Tracking Status
firefox126 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 44720 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/44720
Details from upstream follow.

Javier Fernández García-Boente <jfernandez@igalia.com> wrote:

Use the 'verified' field of the test vectors.

We had a filed in the test vectors to define the expected result, but we were not using it.

PR 44720 applied with additional changes from upstream: 0926ff577d9bf675024588efb0925b0f478d299d
Component: web-platform-tests → DOM: Web Crypto
Product: Testing → Core
Whiteboard: [wptsync downstream] → [wptsync downstream error]
Whiteboard: [wptsync downstream error] → [wptsync downstream]

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 2 tests and 40 subtests

Status Summary

Firefox

OK : 2
FAIL: 80

Chrome

OK : 2
PASS: 42
FAIL: 38

Safari

OK : 2
PASS: 42
FAIL: 38

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

  • /WebCryptoAPI/sign_verify/eddsa.https.any.html [wpt.fyi]
    • EdDSA Ed25519 verification: FAIL
    • EdDSA Ed25519 verification with altered signature after call: FAIL
    • EdDSA Ed25519 with altered data after call: FAIL
    • EdDSA Ed25519 using privateKey to verify: FAIL
    • EdDSA Ed25519 using publicKey to sign: FAIL
    • EdDSA Ed25519 no verify usage: FAIL
    • EdDSA Ed25519 round trip: FAIL
    • EdDSA Ed25519 signing with wrong algorithm name: FAIL
    • EdDSA Ed25519 verifying with wrong algorithm name: FAIL
    • EdDSA Ed25519 verification failure due to altered signature: FAIL
    • EdDSA Ed25519 verification failure due to shortened signature: FAIL
    • EdDSA Ed25519 verification failure due to altered data: FAIL
    • Sign and verify using generated Ed25519 keys.: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 3: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 4: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 5: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 6: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 7: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 8: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 9: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 10: FAIL
  • /WebCryptoAPI/sign_verify/eddsa.https.any.worker.html [wpt.fyi]
    • EdDSA Ed25519 verification: FAIL
    • EdDSA Ed25519 verification with altered signature after call: FAIL
    • EdDSA Ed25519 with altered data after call: FAIL
    • EdDSA Ed25519 using privateKey to verify: FAIL
    • EdDSA Ed25519 using publicKey to sign: FAIL
    • EdDSA Ed25519 no verify usage: FAIL
    • EdDSA Ed25519 round trip: FAIL
    • EdDSA Ed25519 signing with wrong algorithm name: FAIL
    • EdDSA Ed25519 verifying with wrong algorithm name: FAIL
    • EdDSA Ed25519 verification failure due to altered signature: FAIL
    • EdDSA Ed25519 verification failure due to shortened signature: FAIL
    • EdDSA Ed25519 verification failure due to altered data: FAIL
    • Sign and verify using generated Ed25519 keys.: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 3: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 4: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 5: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 6: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 7: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 8: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 9: FAIL
    • Ed25519 Verification checks with small-order key of order - Test 10: FAIL

New Tests That Don't Pass

  • /WebCryptoAPI/sign_verify/eddsa.https.any.html [wpt.fyi]
    • EdDSA Ed25519 verification: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 verification with altered signature after call: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 with altered data after call: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 using privateKey to verify: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 using publicKey to sign: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 no verify usage: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 round trip: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 signing with wrong algorithm name: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 verifying with wrong algorithm name: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 verification failure due to altered signature: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 verification failure due to shortened signature: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 verification failure due to altered data: FAIL (Chrome: PASS, Safari: PASS)
    • Sign and verify using generated Ed25519 keys.: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed448 verification: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 verification with altered signature after call: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 with altered data after call: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 using privateKey to verify: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 using publicKey to sign: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 no verify usage: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 round trip: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 signing with wrong algorithm name: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 verifying with wrong algorithm name: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 verification failure due to altered signature: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 verification failure due to shortened signature: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 verification failure due to altered data: FAIL (Chrome: FAIL, Safari: FAIL)
    • Sign and verify using generated Ed448 keys.: FAIL (Chrome: FAIL, Safari: FAIL)
    • Ed25519 Verification checks with small-order key of order - Test 0: FAIL (Chrome: FAIL, Safari: FAIL)
    • Ed25519 Verification checks with small-order key of order - Test 1: FAIL (Chrome: FAIL, Safari: FAIL)
    • Ed25519 Verification checks with small-order key of order - Test 2: FAIL (Chrome: FAIL, Safari: FAIL)
    • Ed25519 Verification checks with small-order key of order - Test 3: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 4: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 5: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 6: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 7: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 8: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 9: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 10: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 11: FAIL (Chrome: FAIL, Safari: FAIL)
    • Ed25519 Verification checks with small-order key of order - Test 12: FAIL (Chrome: FAIL, Safari: FAIL)
    • Ed25519 Verification checks with small-order key of order - Test 13: FAIL (Chrome: FAIL, Safari: FAIL)
  • /WebCryptoAPI/sign_verify/eddsa.https.any.worker.html [wpt.fyi]
    • EdDSA Ed25519 verification: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 verification with altered signature after call: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 with altered data after call: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 using privateKey to verify: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 using publicKey to sign: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 no verify usage: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 round trip: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 signing with wrong algorithm name: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 verifying with wrong algorithm name: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 verification failure due to altered signature: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 verification failure due to shortened signature: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed25519 verification failure due to altered data: FAIL (Chrome: PASS, Safari: PASS)
    • Sign and verify using generated Ed25519 keys.: FAIL (Chrome: PASS, Safari: PASS)
    • EdDSA Ed448 verification: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 verification with altered signature after call: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 with altered data after call: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 using privateKey to verify: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 using publicKey to sign: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 no verify usage: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 round trip: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 signing with wrong algorithm name: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 verifying with wrong algorithm name: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 verification failure due to altered signature: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 verification failure due to shortened signature: FAIL (Chrome: FAIL, Safari: FAIL)
    • EdDSA Ed448 verification failure due to altered data: FAIL (Chrome: FAIL, Safari: FAIL)
    • Sign and verify using generated Ed448 keys.: FAIL (Chrome: FAIL, Safari: FAIL)
    • Ed25519 Verification checks with small-order key of order - Test 0: FAIL (Chrome: FAIL, Safari: FAIL)
    • Ed25519 Verification checks with small-order key of order - Test 1: FAIL (Chrome: FAIL, Safari: FAIL)
    • Ed25519 Verification checks with small-order key of order - Test 2: FAIL (Chrome: FAIL, Safari: FAIL)
    • Ed25519 Verification checks with small-order key of order - Test 3: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 4: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 5: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 6: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 7: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 8: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 9: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 10: FAIL (Chrome: PASS, Safari: PASS)
    • Ed25519 Verification checks with small-order key of order - Test 11: FAIL (Chrome: FAIL, Safari: FAIL)
    • Ed25519 Verification checks with small-order key of order - Test 12: FAIL (Chrome: FAIL, Safari: FAIL)
    • Ed25519 Verification checks with small-order key of order - Test 13: FAIL (Chrome: FAIL, Safari: FAIL)
Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/b245bd40e477 [wpt PR 44720] - Use the 'verified' field of the test vectors., a=testonly

https://hg.mozilla.org/mozilla-central/rev/b245bd40e477

Status: NEW → RESOLVED
Closed: 1 year ago
status-firefox126: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 126 Branch
You need to log in before you can comment on or make changes to this bug.