Open Bug 1529019 Opened 6 years ago Updated 1 years ago

[Web Crypto API] Firefox only web platform test failures

Categories

(Core :: DOM: Web Crypto, defect, P3)

Product:
Core
Component:
DOM: Web Crypto
Type:
defect

Tracking

()

People

(Reporter: automatedtester, Unassigned)

References

Details

(Keywords: compat, parity-chrome, parity-safari, Whiteboard: [webcrypto] [webcrypto-wpt])

The following tests fail in Firefox but pass in Chrome and Safari

/WebCryptoAPI/encrypt_decrypt/aes_cbc.https.worker.html [8 subtests]
▶ /WebCryptoAPI/generateKey/successes_AES-CBC.https.any.worker.html [192 subtests]
▶ /WebCryptoAPI/generateKey/successes_HMAC.https.any.worker.html [96 subtests]
▶ /WebCryptoAPI/idlharness.https.any.worker.html [10 subtests]
▶ /WebCryptoAPI/import_export/ec_importKey.https.worker.html [20 subtests]
▶ /WebCryptoAPI/sign_verify/test_ecdsa.https.html [112 subtests]
▶ /WebCryptoAPI/wrapKey_unwrapKey/test_wrapKey_unwrapKey.https.html [81 subtests]

Source: https://jgraham.github.io/wptdash/?bugComponent=core%3A%3Adom%3A+security

Hey JC, can you weigh in on this one? We have similar bugs for CSP, Mixed Content, etc. which we try to look into/fix. Probably we should do the same for those tests?

Flags: needinfo?(jjones)

The vast majority of these are simply parts of Firefox's WebCrypto that were never updated from an early draft implementation to the final Recommendation.

Thanks, I'll mark this properly, but right now Web Crypto work is not planned for the next quarter.

Flags: needinfo?(jjones)
Whiteboard: [webcrypto] [webcrypto-wpt]
Severity: normal → minor
Priority: -- → P3
Component: DOM: Security → DOM: Web Crypto

Looks like there might also be some instability in the tests as they have grown in failures with no changes to that directory in wpt

/WebCryptoAPI/derive_bits_keys/ecdh_bits.https.any.html [1 subtests]
▶ /WebCryptoAPI/derive_bits_keys/ecdh_keys.https.any.html [1 subtests]
▶ /WebCryptoAPI/derive_bits_keys/hkdf.https.any.html?1-1000 [53 subtests]
▶ /WebCryptoAPI/derive_bits_keys/hkdf.https.any.html?1001-2000 [51 subtests]
▶ /WebCryptoAPI/derive_bits_keys/hkdf.https.any.html?2001-3000 [162 subtests]
▶ /WebCryptoAPI/derive_bits_keys/hkdf.https.any.html?3001-last [234 subtests]
▶ /WebCryptoAPI/encrypt_decrypt/aes_cbc.https.worker.html [8 subtests]
▶ /WebCryptoAPI/encrypt_decrypt/aes_gcm.https.worker.html [20 subtests]
▶ /WebCryptoAPI/encrypt_decrypt/test_aes_cbc.https.html [8 subtests]
▶ /WebCryptoAPI/encrypt_decrypt/test_aes_gcm.https.html [20 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-CBC.https.any.html [412 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-CBC.https.any.worker.html [736 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-CTR.https.any.html [412 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-CTR.https.any.worker.html [736 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-GCM.https.any.html [412 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-GCM.https.any.worker.html [736 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-KW.https.any.html [154 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-KW.https.any.worker.html [478 subtests]
▶ /WebCryptoAPI/generateKey/failures_ECDH.https.any.html [94 subtests]
▶ /WebCryptoAPI/generateKey/failures_ECDH.https.any.worker.html [438 subtests]
▶ /WebCryptoAPI/generateKey/failures_ECDSA.https.any.html [76 subtests]
▶ /WebCryptoAPI/generateKey/failures_ECDSA.https.any.worker.html [416 subtests]
▶ /WebCryptoAPI/generateKey/failures_HMAC.https.any.html [128 subtests]
▶ /WebCryptoAPI/generateKey/failures_HMAC.https.any.worker.html [452 subtests]
▶ /WebCryptoAPI/generateKey/failures_RSA-OAEP.https.any.html [172 subtests]
▶ /WebCryptoAPI/generateKey/failures_RSA-OAEP.https.any.worker.html [496 subtests]
▶ /WebCryptoAPI/generateKey/failures_RSA-PSS.https.any.html [68 subtests]
▶ /WebCryptoAPI/generateKey/failures_RSA-PSS.https.any.worker.html [392 subtests]
▶ /WebCryptoAPI/generateKey/failures_RSASSA-PKCS1-v1_5.https.any.html [68 subtests]
▶ /WebCryptoAPI/generateKey/failures_RSASSA-PKCS1-v1_5.https.any.worker.html [392 subtests]
▶ /WebCryptoAPI/generateKey/successes_AES-CBC.https.any.worker.html [192 subtests]
▶ /WebCryptoAPI/generateKey/successes_AES-CTR.https.any.worker.html [192 subtests]
▶ /WebCryptoAPI/generateKey/successes_AES-GCM.https.any.worker.html [192 subtests]
▶ /WebCryptoAPI/generateKey/successes_AES-KW.https.any.worker.html [48 subtests]
▶ /WebCryptoAPI/generateKey/successes_ECDH.https.any.worker.html [48 subtests]
▶ /WebCryptoAPI/generateKey/successes_ECDSA.https.any.worker.html [36 subtests]
▶ /WebCryptoAPI/generateKey/successes_HMAC.https.any.worker.html [96 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?1-10 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?101-110 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?11-20 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?111-120 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?121-130 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?131-140 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?141-150 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?151-last [6 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?21-30 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?31-40 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?41-50 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?51-60 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?61-70 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?71-80 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?81-90 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?91-100 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-PSS.https.any.worker.html?1-10 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-PSS.https.any.worker.html?11-20 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-PSS.https.any.worker.html?21-30 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-PSS.https.any.worker.html?31-last [6 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSASSA-PKCS1-v1_5.https.any.worker.html?1-10 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSASSA-PKCS1-v1_5.https.any.worker.html?11-20 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSASSA-PKCS1-v1_5.https.any.worker.html?21-30 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSASSA-PKCS1-v1_5.https.any.worker.html?31-last [6 subtests]
▶ /WebCryptoAPI/idlharness.https.any.worker.html [10 subtests]
▶ /WebCryptoAPI/import_export/ec_importKey.https.worker.html [20 subtests]
▶ /WebCryptoAPI/import_export/test_ec_importKey.https.html [20 subtests]
▶ /WebCryptoAPI/sign_verify/ecdsa.https.worker.html [112 subtests]
▶ /WebCryptoAPI/sign_verify/test_ecdsa.https.html [112 subtests]
▶ /WebCryptoAPI/wrapKey_unwrapKey/test_wrapKey_unwrapKey.https.html [81 subtests]
▶ /WebCryptoAPI/wrapKey_unwrapKey/wrapKey_unwrapKey.https.worker.html [82 subtests]

These are definitely worth fixing, but the risk here is low - WebCrypto usage is low (partly because of widespread compat issues, of course) but the parts that are really useful tend to work pretty well.

So this just needs to get addressed when we have time to pick WebCrypto back up. In the mean time, I think this is OK to remain stalled.

Type: enhancement → defect
Severity: minor → S4
See Also: → 1383842
See Also: → 1816957
You need to log in before you can comment on or make changes to this bug.