1312632 - Intermittent test_mixed_script_content_blocking.py TestMixedScriptContentBlocking.test_mixed_content_page | TimeoutException: Timed out after 5.0 seconds with message: Insecure {plugin|script one|stylesheet} has been unblocked

Status: RESOLVED INVALID

(Testing :: Firefox UI Tests, defect)

Description

[Treeherder Bug Filer]

Filed by: philringnalda [at] gmail.com

https://treeherder.mozilla.org/logviewer.html#?job_id=5606672&repo=autoland

https://queue.taskcluster.net/v1/task/GNugqFBARmmZrFwehmyP2A/runs/0/artifacts/public%2Flogs%2Flive_backing.log

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Looks like disabling protection by clicking the button didn't work in this case and protection is still enabled:

[task 2016-10-25T01:40:58.426243Z] 01:40:58     INFO - TEST-UNEXPECTED-ERROR | test_mixed_script_content_blocking.py TestMixedScriptContentBlocking.test_mixed_content_page | TimeoutException: Timed out after 5.0 seconds with message: Insecure script one has been unblocked
[task 2016-10-25T01:40:58.426448Z] 01:40:58     INFO - Traceback (most recent call last):
[task 2016-10-25T01:40:58.426640Z] 01:40:58     INFO -   File "/home/worker/workspace/build/venv/local/lib/python2.7/site-packages/marionette/marionette_test/testcases.py", line 163, in run
[task 2016-10-25T01:40:58.426708Z] 01:40:58     INFO -     testMethod()
[task 2016-10-25T01:40:58.426855Z] 01:40:58     INFO -   File "/home/worker/workspace/build/tests/firefox-ui/tests/functional/security/test_mixed_script_content_blocking.py", line 86, in test_mixed_content_page
[task 2016-10-25T01:40:58.426948Z] 01:40:58     INFO -     self.expect_protection_disabled()
[task 2016-10-25T01:40:58.427164Z] 01:40:58     INFO -   File "/home/worker/workspace/build/tests/firefox-ui/tests/functional/security/test_mixed_script_content_blocking.py", line 70, in expect_protection_disabled
[task 2016-10-25T01:40:58.427293Z] 01:40:58     INFO -     self._expect_protection_status(False)
[task 2016-10-25T01:40:58.427484Z] 01:40:58     INFO -   File "/home/worker/workspace/build/tests/firefox-ui/tests/functional/security/test_mixed_script_content_blocking.py", line 63, in _expect_protection_status
[task 2016-10-25T01:40:58.427564Z] 01:40:58     INFO -     message=("%s has been %s" % (description, state))
[task 2016-10-25T01:40:58.427726Z] 01:40:58     INFO -   File "/home/worker/workspace/build/venv/local/lib/python2.7/site-packages/marionette_driver/wait.py", line 151, in until

Comment 2

[Julien Cristau [:jcristau]]

Mass wontfix for bugs affecting firefox 52.

Comment 3

[Intermittent Failures Robot]

1 failures in 822 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1312632&startday=2017-07-17&endday=2017-07-23&tree=all

Comment 4

[Intermittent Failures Robot]

1 failures in 949 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-beta: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1312632&startday=2017-08-14&endday=2017-08-20&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 908 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-beta: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1312632&startday=2017-08-21&endday=2017-08-27&tree=all

Comment 6

[Firefox Bug Husbandry Bot]

See https://wiki.mozilla.org/Bugmasters/Projects/Bug_Handling/Bug_Husbandry#Intermittent_Test_Failure_Cleanup

Comment 7

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Hit yesterday's central-as-beta simulation: https://treeherder.mozilla.org/logviewer.html#?job_id=177900515&repo=try

Comment 8

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Yesterday the patch for bug 1414776 was still on central, but got backed out later. So we should keep an eye on that failure before trying to land the patch again.

Comment 9

[Intermittent Failures Robot]

1 failures in 660 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 1

Platform breakdown:
* windows10-64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-05-07&endday=2018-05-13&tree=trunk

Comment 10

[Intermittent Failures Robot]

1 failures in 760 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-07-23&endday=2018-07-29&tree=trunk

Comment 11

[Intermittent Failures Robot]

6 failures in 2579 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 1
* mozilla-beta: 1
* try: 1
* mozilla-inbound: 2
* mozilla-central: 1

Platform breakdown:
* windows10-64: 1
* windows7-32-msvc: 1
* linux32: 2
* linux64: 1
* windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-08-06&endday=2018-08-12&tree=all

Comment 12

[Intermittent Failures Robot]

7 failures in 2672 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 1
* mozilla-central: 1
* autoland: 2
* mozilla-inbound: 3

Platform breakdown:
* linux64: 3
* windows10-64-msvc: 1
* linux32: 1
* windows7-32: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-08-13&endday=2018-08-19&tree=all

Comment 13

[Intermittent Failures Robot]

13 failures in 2568 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 3
* mozilla-esr60: 1
* try: 2
* mozilla-inbound: 2
* autoland: 5

Platform breakdown:
* linux64: 4
* windows10-64-msvc: 1
* windows7-32: 2
* windows10-64-ccov: 1
* osx-10-10: 2
* linux32: 2
* windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-08-20&endday=2018-08-26&tree=all

Comment 15

[Intermittent Failures Robot]

5 failures in 2545 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 1
* mozilla-inbound: 2
* autoland: 1
* mozilla-beta: 1

Platform breakdown:
* windows10-64: 1
* linux64: 2
* osx-10-10: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-08-27&endday=2018-09-02&tree=all

Comment 17

[Intermittent Failures Robot]

6 failures in 2667 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 2
* mozilla-inbound: 1
* autoland: 3

Platform breakdown:
* windows7-32: 3
* windows10-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-09-03&endday=2018-09-09&tree=all

Comment 18

[Intermittent Failures Robot]

10 failures in 2684 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 3
* mozilla-inbound: 3
* try: 1
* mozilla-central: 3

Platform breakdown:
* windows7-32-msvc: 1
* windows7-32: 3
* windows10-64: 2
* macosx64-nightly: 1
* linux64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-09-10&endday=2018-09-16&tree=all

Comment 19

[Intermittent Failures Robot]

23 failures in 2902 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 5
* mozilla-inbound: 9
* try: 5
* mozilla-central: 4

Platform breakdown:
* linux64-ccov: 1
* windows10-64: 4
* osx-10-10: 6
* linux64: 5
* windows7-32: 5
* linux32: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-09-17&endday=2018-09-23&tree=all

Comment 20

[Henrik Skupin [:whimboo][⌚️UTC+2]]

The problem in all those cases is that the browser doens't display any content inside the tab. It's just a gray area. See this screenshot for example: https://taskcluster-artifacts.net/TQYjAyqLQEu9_a6dcGHrxQ/0/public/test_info/report.html

So the test is clicking the "Disable protection for now" button (https://searchfox.org/mozilla-central/source/testing/marionette/puppeteer/firefox/firefox_puppeteer/ui/browser/toolbars.py#570), which then triggers a page load. This works fine, and the tab shows the document title, but the page stays empty, see above. At this state we can still access the DOM and retrieve the element under test:

https://treeherder.mozilla.org/logviewer.html#?job_id=200337336&repo=try&lineNumber=7279-7280

But checking for it's color CSS property it always returns `rgb(0, 136, 0)`, which indicates that the content blocking hasn't been disabled.

Maybe this action sometimes ends-up in a weird state? Johann, do you have an idea?

Comment 21

[Intermittent Failures Robot]

15 failures in 2773 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 7
* mozilla-inbound: 6
* try: 1
* mozilla-central: 1

Platform breakdown:
* windows10-64: 7
* windows7-32: 2
* windows10-64-nightly: 1
* osx-10-10: 4
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-09-24&endday=2018-09-30&tree=all

Comment 22

[Johann Hofmann [:johannh]]

I'm not sure if the "gray area" in that screenshot has a lot of significance, I often see that in mochitest screenshots from automation. Is there a way to locally reproduce this?

Comment 23

[Intermittent Failures Robot]

5 failures in 2708 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 2
* mozilla-central: 2
* mozilla-inbound: 1

Platform breakdown:
* windows7-32: 2
* linux64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-10-01&endday=2018-10-07&tree=all

Comment 24

[Intermittent Failures Robot]

7 failures in 2740 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 1
* autoland: 1
* mozilla-central: 2
* mozilla-inbound: 3

Platform breakdown:
* linux32: 2
* osx-10-10: 1
* windows10-64-msvc: 1
* windows10-64: 2
* windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-10-08&endday=2018-10-14&tree=all

Comment 25

[Intermittent Failures Robot]

3 failures in 2759 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 2
* try: 1

Platform breakdown:
* windows10-64: 1
* linux64: 1
* windows10-64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-10-15&endday=2018-10-21&tree=all

Comment 26

[Intermittent Failures Robot]

7 failures in 2584 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 2
* mozilla-inbound: 4
* mozilla-central: 1

Platform breakdown:
* windows10-64: 4
* windows7-32: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-10-22&endday=2018-10-28&tree=all

Comment 27

[Intermittent Failures Robot]

6 failures in 2978 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 2
* mozilla-release: 1
* mozilla-central: 1
* autoland: 2

Platform breakdown:
* windows7-32: 1
* osx-10-10: 2
* linux64: 1
* linux32-nightly: 1
* windows10-64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-10-29&endday=2018-11-04&tree=all

Comment 28

[Intermittent Failures Robot]

4 failures in 3007 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-esr60: 1
* mozilla-inbound: 1
* autoland: 2

Platform breakdown:
* osx-10-10: 1
* windows7-32: 1
* windows10-64-nightly: 1
* windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-11-05&endday=2018-11-11&tree=all

Comment 29

[Intermittent Failures Robot]

2 failures in 2917 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 1
* mozilla-inbound: 1

Platform breakdown:
* windows7-32: 1
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-11-12&endday=2018-11-18&tree=all

Comment 30

[Intermittent Failures Robot]

1 failures in 2387 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 1

Platform breakdown:
* windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-11-19&endday=2018-11-25&tree=all

Comment 31

[Intermittent Failures Robot]

2 failures in 2808 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 1
* autoland: 1

Platform breakdown:
* osx-10-10: 1
* windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-11-26&endday=2018-12-02&tree=all

Comment 32

[Intermittent Failures Robot]

1 failures in 1862 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 1

Platform breakdown:
* windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-12-03&endday=2018-12-09&tree=all

Comment 33

[Intermittent Failures Robot]

1 failures in 2648 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2018-12-17&endday=2018-12-23&tree=all

Comment 34

[Intermittent Failures Robot]

1 failures in 2627 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform breakdown:

• windows10-64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2019-01-07&endday=2019-01-13&tree=all

Comment 35

[Intermittent Failures Robot]

3 failures in 2383 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• mozilla-inbound: 1
• autoland: 1

Platform breakdown:

• linux64-devedition: 1
• linux64: 1
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2019-01-21&endday=2019-01-27&tree=all

Comment 36

[Intermittent Failures Robot]

2 failures in 2628 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-beta: 1

Platform breakdown:

• linux32: 1
• macosx64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2019-01-28&endday=2019-02-03&tree=all

Comment 37

[Intermittent Failures Robot]

1 failures in 2832 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2019-02-11&endday=2019-02-17&tree=all

Comment 38

[Intermittent Failures Robot]

5 failures in 2602 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-beta: 1

Platform breakdown:

• linux64: 3
• windows7-32: 1
• linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2019-02-18&endday=2019-02-24&tree=all

Comment 39

[Intermittent Failures Robot]

2 failures in 3910 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform breakdown:

• linux32: 1
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2019-03-25&endday=2019-03-31&tree=all

Comment 40

[Intermittent Failures Robot]

1 failures in 2843 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• osx-10-10-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2019-04-01&endday=2019-04-07&tree=all

Comment 41

[Intermittent Failures Robot]

1 failures in 4710 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1312632&startday=2019-07-08&endday=2019-07-14&tree=all

Comment 42

[Henrik Skupin [:whimboo][⌚️UTC+2]]

The test will be removed on bug 1573393.