1600442 - Perma late-beta wpt sandbox-disallow-scripts-via-unsandboxed-popup.tentative.html | Sandboxed => unsandboxed popup - assert_not_equals: got disallowed value "FAIL" - when Gecko 72 merges to Beta on 2019-12-02

Status: VERIFIED FIXED

(Core :: DOM: Core & HTML, defect)

Description

[Cosmin Sabou [:CosminS]]

[Tracking Requested - why for this release]:

Central as beta simulation: https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&resultStatus=testfailed%2Cbusted%2Cexception&revision=132fcdedf54fd14f6892732763ada7aa476307df&searchStr=wpt1&selectedJob=278889305
Failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=278882713&repo=try

[task 2019-11-30T13:16:44.530Z] 13:16:44 INFO - TEST-START | /html/browsers/sandboxing/sandbox-disallow-scripts-via-unsandboxed-popup.tentative.html
[task 2019-11-30T13:16:44.551Z] 13:16:44 INFO - Closing window 29
[task 2019-11-30T13:16:45.013Z] 13:16:45 INFO -
[task 2019-11-30T13:16:45.014Z] 13:16:45 INFO - TEST-UNEXPECTED-FAIL | /html/browsers/sandboxing/sandbox-disallow-scripts-via-unsandboxed-popup.tentative.html | Sandboxed => unsandboxed popup - assert_not_equals: got disallowed value "FAIL"
[task 2019-11-30T13:16:45.014Z] 13:16:45 INFO - @http://web-platform.test:8000/html/browsers/sandboxing/sandbox-disallow-scripts-via-unsandboxed-popup.tentative.html:27:26
[task 2019-11-30T13:16:45.014Z] 13:16:45 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1984:25
[task 2019-11-30T13:16:45.014Z] 13:16:45 INFO - Test.prototype.step_func/<@http://web-platform.test:8000/resources/testharness.js:2009:35
[task 2019-11-30T13:16:45.014Z] 13:16:45 INFO - TEST-INFO | expected TIMEOUT
[task 2019-11-30T13:16:45.014Z] 13:16:45 INFO - TEST-UNEXPECTED-OK | /html/browsers/sandboxing/sandbox-disallow-scripts-via-unsandboxed-popup.tentative.html | expected TIMEOUT
[task 2019-11-30T13:16:45.014Z] 13:16:45 INFO - TEST-INFO expected TIMEOUT | took 481ms
[task 2019-11-30T13:16:45.050Z] 13:16:45 INFO - PID 29289 | 1575119805042 Marionette INFO Stopped listening on port 40242
[task 2019-11-30T13:16:45.732Z] 13:16:45 INFO - Browser exited with return code 0
[task 2019-11-30T13:16:45.732Z] 13:16:45 INFO - PROCESS LEAKS None
[task 2019-11-30T13:16:45.733Z] 13:16:45 INFO - PROCESS LEAKS None
[task 2019-11-30T13:16:45.735Z] 13:16:45 INFO - Closing logging queue
[task 2019-11-30T13:16:45.735Z] 13:16:45 INFO - queue closed
[task 2019-11-30T13:16:45.757Z] 13:16:45 INFO - Setting up ssl
[task 2019-11-30T13:16:45.781Z] 13:16:45 INFO - certutil |
[task 2019-11-30T13:16:45.809Z] 13:16:45 INFO - certutil |
[task 2019-11-30T13:16:45.825Z] 13:16:45 INFO - certutil |
[task 2019-11-30T13:16:45.825Z] 13:16:45 INFO - Certificate Nickname Trust Attributes
[task 2019-11-30T13:16:45.825Z] 13:16:45 INFO - SSL,S/MIME,JAR/XPI
[task 2019-11-30T13:16:45.825Z] 13:16:45 INFO -
[task 2019-11-30T13:16:45.825Z] 13:16:45 INFO - web-platform-tests CT,,
[task 2019-11-30T13:16:45.825Z] 13:16:45 INFO -
[task 2019-11-30T13:16:45.841Z] 13:16:45 INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmp80f1fr.mozrunner
[task 2019-11-30T13:16:45.849Z] 13:16:45 INFO - Starting runner
[task 2019-11-30T13:16:46.198Z] 13:16:46 INFO - PID 29581 | 1575119806189 [e-mail] WARN Loading extension '[e-mail]': Reading manifest: Invalid extension permission: networkStatus
[task 2019-11-30T13:16:46.719Z] 13:16:46 INFO - PID 29581 | 1575119806708 [e-mail] WARN Loading extension '[e-mail]': Reading manifest: Invalid extension permission: mozillaAddons
[task 2019-11-30T13:16:46.719Z] 13:16:46 INFO - PID 29581 | 1575119806708 [e-mail] WARN Loading extension '[e-mail]': Reading manifest: Invalid extension permission: telemetry
[task 2019-11-30T13:16:46.719Z] 13:16:46 INFO - PID 29581 | 1575119806708 [e-mail] WARN Loading extension '[e-mail]': Reading manifest: Invalid extension permission: resource://pdf.js/
[task 2019-11-30T13:16:46.720Z] 13:16:46 INFO - PID 29581 | 1575119806708 [e-mail] WARN Loading extension '[e-mail]': Reading manifest: Invalid extension permission: about:reader*
[task 2019-11-30T13:16:48.668Z] 13:16:48 INFO - PID 29581 | GLib-GIO-Message: Using the 'memory' GSettings backend. Your settings will not be saved or shared with other applications.
[task 2019-11-30T13:16:49.735Z] 13:16:49 INFO - PID 29581 | 1575119809731 Marionette INFO Listening on port 40242
[task 2019-11-30T13:16:49.976Z] 13:16:49 INFO - TEST-START | /html/browsers/sandboxing/sandbox-disallow-scripts.html

Fallout from the latest wpt-sync https://hg.mozilla.org/mozilla-central/rev/60d24475b40f5d82621b1013d63e10f819027804

Comment 1

[Cosmin Sabou [:CosminS]]

Attachment: Bug 1600442 - Add release or beta expectations for sandbox-disallow-scripts-via-unsandboxed-popup.tentative.html. r=jgraham

Comment 2

[Bogdan Tara[:bogdan_tara | bogdant]]

Not sure the patch worked as intended:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=0dc2c098d76302b5af600182c3b72d5c7db5214d&selectedJob=278938136

[task 2019-12-01T12:58:35.502Z] 12:58:35 INFO - TEST-START | /html/browsers/sandboxing/sandbox-disallow-scripts-via-unsandboxed-popup.tentative.html
[task 2019-12-01T12:58:35.510Z] 12:58:35 INFO - Closing window 29
[task 2019-12-01T12:58:36.051Z] 12:58:36 INFO - PID 490 | JavaScript error: http://web-platform.test:8000/html/browsers/sandboxing/resources/post-done-to-opener.html, line 2: TypeError: window.opener is null
[task 2019-12-01T12:58:45.735Z] 12:58:45 INFO -
[task 2019-12-01T12:58:45.735Z] 12:58:45 INFO - TEST-UNEXPECTED-TIMEOUT | /html/browsers/sandboxing/sandbox-disallow-scripts-via-unsandboxed-popup.tentative.html | Sandboxed => unsandboxed popup - Test timed out
[task 2019-12-01T12:58:45.735Z] 12:58:45 INFO - TEST-INFO | expected FAIL
[task 2019-12-01T12:58:45.735Z] 12:58:45 INFO - TEST-UNEXPECTED-TIMEOUT | /html/browsers/sandboxing/sandbox-disallow-scripts-via-unsandboxed-popup.tentative.html | expected OK
[task 2019-12-01T12:58:45.735Z] 12:58:45 INFO - TEST-INFO took 10228ms
[task 2019-12-01T12:58:45.743Z] 12:58:45 INFO - PID 490 | 1575205125740 Marionette INFO Stopped listening on port 59711
[task 2019-12-01T12:58:46.348Z] 12:58:46 INFO - Browser exited with return code 0

Comment 3

[Cosmin Sabou [:CosminS]]

Updated the patch. Thanks.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a96cd74dc942
Add release or beta expectations for sandbox-disallow-scripts-via-unsandboxed-popup.tentative.html. r=jgraham

Comment 5

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/releases/mozilla-beta/rev/a46b16fc6f0d

Comment 6

[Stefan Hindli [:stefan_hindli]]

https://hg.mozilla.org/mozilla-central/rev/a96cd74dc942

Comment 7

[Andreea Pavel [:apavel]]

No longer shows up in beta sims: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=e5ba0286cc5e5b479a831b5e9f04244d3fbd52e9