1529019 - [Web Crypto API] Firefox only web platform test failures

Status: NEW

(Core :: DOM: Web Crypto, defect, P3)

Description

[David Burns :automatedtester]

The following tests fail in Firefox but pass in Chrome and Safari

/WebCryptoAPI/encrypt_decrypt/aes_cbc.https.worker.html [8 subtests]
▶ /WebCryptoAPI/generateKey/successes_AES-CBC.https.any.worker.html [192 subtests]
▶ /WebCryptoAPI/generateKey/successes_HMAC.https.any.worker.html [96 subtests]
▶ /WebCryptoAPI/idlharness.https.any.worker.html [10 subtests]
▶ /WebCryptoAPI/import_export/ec_importKey.https.worker.html [20 subtests]
▶ /WebCryptoAPI/sign_verify/test_ecdsa.https.html [112 subtests]
▶ /WebCryptoAPI/wrapKey_unwrapKey/test_wrapKey_unwrapKey.https.html [81 subtests]

Source: https://jgraham.github.io/wptdash/?bugComponent=core%3A%3Adom%3A+security

Comment 1

[Christoph Kerschbaumer [:ckerschb]]

Hey JC, can you weigh in on this one? We have similar bugs for CSP, Mixed Content, etc. which we try to look into/fix. Probably we should do the same for those tests?

Comment 2

[J.C. Jones [:jcj] (he/they)]

The vast majority of these are simply parts of Firefox's WebCrypto that were never updated from an early draft implementation to the final Recommendation.

Thanks, I'll mark this properly, but right now Web Crypto work is not planned for the next quarter.

Comment 3

[David Burns :automatedtester]

Looks like there might also be some instability in the tests as they have grown in failures with no changes to that directory in wpt

/WebCryptoAPI/derive_bits_keys/ecdh_bits.https.any.html [1 subtests]
▶ /WebCryptoAPI/derive_bits_keys/ecdh_keys.https.any.html [1 subtests]
▶ /WebCryptoAPI/derive_bits_keys/hkdf.https.any.html?1-1000 [53 subtests]
▶ /WebCryptoAPI/derive_bits_keys/hkdf.https.any.html?1001-2000 [51 subtests]
▶ /WebCryptoAPI/derive_bits_keys/hkdf.https.any.html?2001-3000 [162 subtests]
▶ /WebCryptoAPI/derive_bits_keys/hkdf.https.any.html?3001-last [234 subtests]
▶ /WebCryptoAPI/encrypt_decrypt/aes_cbc.https.worker.html [8 subtests]
▶ /WebCryptoAPI/encrypt_decrypt/aes_gcm.https.worker.html [20 subtests]
▶ /WebCryptoAPI/encrypt_decrypt/test_aes_cbc.https.html [8 subtests]
▶ /WebCryptoAPI/encrypt_decrypt/test_aes_gcm.https.html [20 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-CBC.https.any.html [412 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-CBC.https.any.worker.html [736 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-CTR.https.any.html [412 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-CTR.https.any.worker.html [736 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-GCM.https.any.html [412 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-GCM.https.any.worker.html [736 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-KW.https.any.html [154 subtests]
▶ /WebCryptoAPI/generateKey/failures_AES-KW.https.any.worker.html [478 subtests]
▶ /WebCryptoAPI/generateKey/failures_ECDH.https.any.html [94 subtests]
▶ /WebCryptoAPI/generateKey/failures_ECDH.https.any.worker.html [438 subtests]
▶ /WebCryptoAPI/generateKey/failures_ECDSA.https.any.html [76 subtests]
▶ /WebCryptoAPI/generateKey/failures_ECDSA.https.any.worker.html [416 subtests]
▶ /WebCryptoAPI/generateKey/failures_HMAC.https.any.html [128 subtests]
▶ /WebCryptoAPI/generateKey/failures_HMAC.https.any.worker.html [452 subtests]
▶ /WebCryptoAPI/generateKey/failures_RSA-OAEP.https.any.html [172 subtests]
▶ /WebCryptoAPI/generateKey/failures_RSA-OAEP.https.any.worker.html [496 subtests]
▶ /WebCryptoAPI/generateKey/failures_RSA-PSS.https.any.html [68 subtests]
▶ /WebCryptoAPI/generateKey/failures_RSA-PSS.https.any.worker.html [392 subtests]
▶ /WebCryptoAPI/generateKey/failures_RSASSA-PKCS1-v1_5.https.any.html [68 subtests]
▶ /WebCryptoAPI/generateKey/failures_RSASSA-PKCS1-v1_5.https.any.worker.html [392 subtests]
▶ /WebCryptoAPI/generateKey/successes_AES-CBC.https.any.worker.html [192 subtests]
▶ /WebCryptoAPI/generateKey/successes_AES-CTR.https.any.worker.html [192 subtests]
▶ /WebCryptoAPI/generateKey/successes_AES-GCM.https.any.worker.html [192 subtests]
▶ /WebCryptoAPI/generateKey/successes_AES-KW.https.any.worker.html [48 subtests]
▶ /WebCryptoAPI/generateKey/successes_ECDH.https.any.worker.html [48 subtests]
▶ /WebCryptoAPI/generateKey/successes_ECDSA.https.any.worker.html [36 subtests]
▶ /WebCryptoAPI/generateKey/successes_HMAC.https.any.worker.html [96 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?1-10 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?101-110 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?11-20 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?111-120 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?121-130 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?131-140 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?141-150 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?151-last [6 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?21-30 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?31-40 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?41-50 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?51-60 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?61-70 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?71-80 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?81-90 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-OAEP.https.any.worker.html?91-100 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-PSS.https.any.worker.html?1-10 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-PSS.https.any.worker.html?11-20 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-PSS.https.any.worker.html?21-30 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSA-PSS.https.any.worker.html?31-last [6 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSASSA-PKCS1-v1_5.https.any.worker.html?1-10 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSASSA-PKCS1-v1_5.https.any.worker.html?11-20 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSASSA-PKCS1-v1_5.https.any.worker.html?21-30 [10 subtests]
▶ /WebCryptoAPI/generateKey/successes_RSASSA-PKCS1-v1_5.https.any.worker.html?31-last [6 subtests]
▶ /WebCryptoAPI/idlharness.https.any.worker.html [10 subtests]
▶ /WebCryptoAPI/import_export/ec_importKey.https.worker.html [20 subtests]
▶ /WebCryptoAPI/import_export/test_ec_importKey.https.html [20 subtests]
▶ /WebCryptoAPI/sign_verify/ecdsa.https.worker.html [112 subtests]
▶ /WebCryptoAPI/sign_verify/test_ecdsa.https.html [112 subtests]
▶ /WebCryptoAPI/wrapKey_unwrapKey/test_wrapKey_unwrapKey.https.html [81 subtests]
▶ /WebCryptoAPI/wrapKey_unwrapKey/wrapKey_unwrapKey.https.worker.html [82 subtests]

Comment 4

[David Burns :automatedtester]

There is some instability in Safari though it doesnt show all these failing tests

https://staging.wpt.fyi/results/WebCryptoAPI?label=master&label=experimental&max-count=10&product=safari&q=seq%28%28status%3APASS%7Cstatus%3AOK%29+%28status%3A%21PASS%26status%3A%21OK%26status%3A%21unknown%29%29+seq%28%28status%3A%21PASS%26status%3A%21OK%26status%3A%21unknown%29+%28status%3APASS%7Cstatus%3AOK%29%29

Comment 5

[J.C. Jones [:jcj] (he/they)]

These are definitely worth fixing, but the risk here is low - WebCrypto usage is low (partly because of widespread compat issues, of course) but the parts that are really useful tend to work pretty well.

So this just needs to get addressed when we have time to pick WebCrypto back up. In the mean time, I think this is OK to remain stalled.

Comment 6

[Manuel]

Ensure that you are using the latest version of Firefox. Outdated versions may have known issues or bugs that have been addressed in newer releases. Go to the Firefox menu https://applianceparthelp.com/most-common-maytag-washer-problems-troubleshooting-101/, click on "Help," and then select "About Firefox" to check for updates.