1605193 - Intermittent TEST-UNEXPECTED-PASS | /html/browsers/sandboxing/sandbox-disallow-scripts-via-unsandboxed-popup.tentative.html | Sandboxed => unsandboxed popup - expected FAIL

Status: RESOLVED FIXED

(Core :: DOM: Core & HTML, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: rmaries [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=281935707&repo=mozilla-beta
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/GcRkne7QQ_qb5I4OoJIJXA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2019-12-19T17:18:34.137Z] 17:18:34 INFO - TEST-START | /html/browsers/sandboxing/sandbox-disallow-scripts-via-unsandboxed-popup.tentative.html
[task 2019-12-19T17:18:34.137Z] 17:18:34 INFO - Closing window 18
[task 2019-12-19T17:18:34.794Z] 17:18:34 INFO -
[task 2019-12-19T17:18:34.794Z] 17:18:34 INFO - TEST-UNEXPECTED-PASS | /html/browsers/sandboxing/sandbox-disallow-scripts-via-unsandboxed-popup.tentative.html | Sandboxed => unsandboxed popup - expected FAIL
[task 2019-12-19T17:18:34.794Z] 17:18:34 INFO - TEST-INFO | expected FAIL
[task 2019-12-19T17:18:35.126Z] 17:18:35 INFO - TEST-OK | /html/browsers/sandboxing/sandbox-disallow-scripts-via-unsandboxed-popup.tentative.html | took 992ms
[task 2019-12-19T17:18:36.331Z] 17:18:36 INFO - Closing logging queue
[task 2019-12-19T17:18:36.331Z] 17:18:36 INFO - queue closed
[task 2019-12-19T17:18:36.348Z] 17:18:36 INFO - Setting up ssl
[task 2019-12-19T17:18:36.469Z] 17:18:36 INFO - certutil |
[task 2019-12-19T17:18:36.545Z] 17:18:36 INFO - certutil |
[task 2019-12-19T17:18:36.565Z] 17:18:36 INFO - certutil |
[task 2019-12-19T17:18:36.565Z] 17:18:36 INFO - Certificate Nickname Trust Attributes
[task 2019-12-19T17:18:36.566Z] 17:18:36 INFO - SSL,S/MIME,JAR/XPI
[task 2019-12-19T17:18:36.566Z] 17:18:36 INFO -
[task 2019-12-19T17:18:36.566Z] 17:18:36 INFO - web-platform-tests CT,,
[task 2019-12-19T17:18:36.566Z] 17:18:36 INFO -
[task 2019-12-19T17:18:39.349Z] 17:18:39 INFO - adb Granting important runtime permissions to org.mozilla.geckoview.test
[task 2019-12-19T17:18:41.126Z] 17:18:41 INFO - adb launch_application: am start -W -n org.mozilla.geckoview.test/org.mozilla.geckoview.test.TestRunnerActivity -a android.intent.action.MAIN --es env9 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env8 R_LOG_DESTINATION=stderr --es args "-no-remote -profile /sdcard/tests/profile --marionette about:blank" --es env3 MOZ_HIDE_RESULTS_TABLE=1 --es env2 R_LOG_VERBOSE=1 --es env1 MOZ_WEBRENDER=0 --es env0 MOZ_CRASHREPORTER=1 --es env7 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env6 MOZ_IN_AUTOMATION=1 --es env5 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --es env4 STYLO_THREADS=4 --ez use_multiprocess True --es env12 R_LOG_LEVEL=6 --es env11 MOZ_PROCESS_LOG=/tmp/tmpGyO1oCpidlog --es env10 MOZ_CRASHREPORTER_NO_REPORT=1
[task 2019-12-19T17:18:43.560Z] 17:18:43 INFO - Starting runner

Comment 1

[Intermittent Failures Robot]

2 failures in 4582 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• try: 1

Platform breakdown:

• android-em-7-0-x86_64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1605193&startday=2019-12-16&endday=2019-12-22&tree=all

Comment 2

[Intermittent Failures Robot]

1 failures in 4472 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1605193&startday=2020-01-06&endday=2020-01-12&tree=all

Comment 3

[Intermittent Failures Robot]

4 failures in 4004 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 4

Platform breakdown:

• android-em-7-0-x86_64: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1605193&startday=2020-01-20&endday=2020-01-26&tree=all

Comment 4

[Intermittent Failures Robot]

2 failures in 2190 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• android-em-7-0-x86_64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1605193&startday=2020-01-27&endday=2020-02-02&tree=all

Comment 5

[Andreea Pavel [:apavel]]

Hsin-Yi does the expectancy here need to be updated or wait until the failure rate is higher?

Comment 6

[Hsin-Yi Tsai (she/her) [:hsinyi]]

(In reply to Andreea Pavel [:apavel] from comment #5)

Hsin-Yi does the expectancy here need to be updated or wait until the failure rate is higher?

Hi Christoph, I wonder if you have thoughts about this. Thanks!

Comment 7

[Andreea Pavel [:apavel]]

Attachment: Bug 1605193 - update expectancy r=ckerschb

Comment 8

[Intermittent Failures Robot]

11 failures in 3364 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 2
• mozilla-release: 1
• try: 1

Platform breakdown:

• android-em-7-0-x86_64: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1605193&startday=2020-02-03&endday=2020-02-09&tree=all

Comment 9

[Christoph Kerschbaumer [:ckerschb]]

(In reply to Hsin-Yi Tsai (OOO till March 2nd) [:hsinyi] from comment #6)

(In reply to Andreea Pavel [:apavel] from comment #5)

Hsin-Yi does the expectancy here need to be updated or wait until the failure rate is higher?

Hi Christoph, I wonder if you have thoughts about this. Thanks!

Can't tell why this would pass on android but no other platforms - I guess it's fine to annotate for now to eliminate the intermittent failure.

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/67f65e950f6c
update expectancy r=ckerschb

Comment 11

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/67f65e950f6c

Comment 12

[Noemi Erli[:noemi_erli]]

This fail appeared on today's beta-sim but only once:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=288721082&repo=try&lineNumber=3898
Push: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=048c63ff0b3cb2c6aa74490654b411862b07e03d&selectedJob=288721082

Comment 13

[Intermittent Failures Robot]

3 failures in 4690 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• mozilla-beta: 2

Platform breakdown:

• android-em-7-0-x86_64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1605193&startday=2020-02-10&endday=2020-02-16&tree=all

Comment 14

[Intermittent Failures Robot]

1 failures in 4045 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1605193&startday=2020-02-17&endday=2020-02-23&tree=all