1530648 - [Feature Policy] Firefox only Web Platform Test failures

Status: NEW

(Core :: DOM: Security, enhancement, P3)

Description

[David Burns :automatedtester]

The following tests are failing in Firefox but passing in Chrome and Safari

/feature-policy/experimental-features/layout-animations-disabled-violation-report-js-tentative.html [1 subtests]
▶ /feature-policy/experimental-features/layout-animations-disabled-violation-report-keyframes-tentative.html [1 subtests]
▶ /feature-policy/payment-allowed-by-feature-policy-attribute-redirect-on-load.https.sub.html [2 subtests]
▶ /feature-policy/payment-allowed-by-feature-policy-attribute.https.sub.html [1 subtests]
▶ /feature-policy/payment-allowed-by-feature-policy.https.sub.html [3 subtests]
▶ /feature-policy/payment-default-feature-policy.https.sub.html [3 subtests]
▶ /feature-policy/reporting/document-write-report-only.html [1 subtests]
▶ /feature-policy/reporting/legacy-image-formats-reporting.html [1 subtests]
▶ /feature-policy/reporting/midi-report-only.html [1 subtests]
▶ /feature-policy/reporting/payment-report-only.https.html [1 subtests]
▶ /feature-policy/reporting/sync-xhr-report-only.html [1 subtests]
▶ /feature-policy/reporting/unoptimized-images-reporting.html [1 subtests]
▶ /feature-policy/reporting/unsized-media-reporting.html [1 subtests]

Source https://jgraham.github.io/wptdash/?bugComponent=core%3A%3Adom&tab=Firefox-only+Failures

Comment 1

[David Burns :automatedtester]

These appear to be very unstable tests with Safari https://wpt.fyi/results/feature-policy?label=master&label=experimental&max-count=10&product=safari&q=seq%28%28status%3APASS%7Cstatus%3AOK%29+%28status%3A%21PASS%26status%3A%21OK%26status%3A%21unknown%29%29+seq%28%28status%3A%21PASS%26status%3A%21OK%26status%3A%21unknown%29+%28status%3APASS%7Cstatus%3AOK%29%29

Comment 2

[Christoph Kerschbaumer [:ckerschb]]

Baku, is this something we should look into?

Comment 3

[Andrea Marchesini [:baku]]

/feature-policy/experimental-features/layout-animations-disabled-violation-report-js-tentative.html [1 subtests]
/feature-policy/experimental-features/layout-animations-disabled-violation-report-keyframes-tentative.html [1 subtests]

We don't have this feature implemented yet. Bug 1530994

/feature-policy/payment-allowed-by-feature-policy-attribute-redirect-on-load.https.sub.html [2 subtests]
/feature-policy/payment-allowed-by-feature-policy-attribute.https.sub.html [1 subtests]
/feature-policy/payment-allowed-by-feature-policy.https.sub.html [3 subtests]
/feature-policy/payment-default-feature-policy.https.sub.html [3 subtests]
/feature-policy/reporting/payment-report-only.https.html [1 subtests]

Marcos, do we care about this? Can yo ucheck why we are failing here?

▶ /feature-policy/reporting/document-write-report-only.html [1 subtests]
▶ /feature-policy/reporting/legacy-image-formats-reporting.html [1 subtests]
▶ /feature-policy/reporting/sync-xhr-report-only.html [1 subtests]
▶ /feature-policy/reporting/unoptimized-images-reporting.html [1 subtests]
▶ /feature-policy/reporting/unsized-media-reporting.html [1 subtests]

This are unsupported features yet. Annevk, you are following the feature-policy spec discussion. How urgent is the implementation of these features? Maybe we should wait until feature-policy is enabled by default before implementing these.

▶ /feature-policy/reporting/midi-report-only.html [1 subtests]

This should work. I'll check why it doesn't.

Comment 4

[Philip Jägenstedt [:foolip]]

https://github.com/web-platform-tests/wpt/pull/15577 will fix some of these, not all though.

Comment 5

[Anne (:annevk)]

See bug 1531012. I'd suggest we hold off for now until we have an agreed upon way forward.

Comment 6

[Marcos Caceres [:marcosc]]

I'll check if what :foolip has sent makes a difference for the payments tests.

If not, happy to dive into those once we have some clarity from bug 1531012.