1632125 - feature-policy/reporting/* tests are almost all expected fail || timeout

Status: RESOLVED FIXED

(Core :: DOM: Security, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

I see that almost all of the tests in feature-policy/reporting are expected fail or timeout:
https://searchfox.org/mozilla-central/source/testing/web-platform/meta/feature-policy/reporting

and the tests:
https://searchfox.org/mozilla-central/source/testing/web-platform/tests/feature-policy/reporting

there are two types of tests:
reporting
report-only

typicaly report-only is timeout and in 8 cases reporting runs successfully (for example in the case of camera)

for the tests that timeout we are getting no value and wasting time waiting for results and cpu/money.

I would like to determine why these are failing and get them passing quickly.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

:hsinyi, I see you as the triage owner, can you help determine if we support what these tests are testing for and if so why they are failing? Maybe you can redirect to the appropriate engineer.

Comment 2

[Hsin-Yi Tsai (she/her) [:hsinyi]]

Hi Christoph, could you please help me to answer Joel's question? Also, I've been thinking about update the in-tree metadata of feature-policy to ensure the related test bugs are filed under DOM: Security. What do you think about this idea? Thank you.

Comment 3

[Christoph Kerschbaumer [:ckerschb]]

(In reply to Hsin-Yi Tsai [:hsinyi] from comment #2)

Hi Christoph, could you please help me to answer Joel's question? Also, I've been thinking about update the in-tree metadata of feature-policy to ensure the related test bugs are filed under DOM: Security. What do you think about this idea? Thank you.

@ Hsin-Yi: I think it makes sense to update the in-tree metadata so that feature-policy bugs are filed in Dom:Security.

@Johann: You have a better overview of feature-policy, can you help advise how to move forward with: feature-policy/reporting tests?

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

when any fixes to the tests or manifests are done, we can update the in-tree component (:hsinyi has the right link in comment 2). I am happy to change manifests around if we find that this isn't supported. Hopefully it is the tests need updating or a pref is needed or something like that.

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

following up here, been 1+ week on needinfo.

Comment 6

[Andrea Marchesini [:baku]]

Feature-Policy-Report-Only header is not supported. We need to disable all these tests. I'll send a patch.

Comment 7

[Andrea Marchesini [:baku]]

Attachment: Bug 1632125 - Disable Feature-Policy-Report-Only header WPTs, r?jgraham

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/dbb3bf1aac95
Disable Feature-Policy-Report-Only header WPTs, r=jgraham

Comment 9

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/dbb3bf1aac95