1489771 - Intermittent toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | Expected cookie value - Expected: cookie=monster, Actual:

Reporter

Description

•

6 years ago

treeherder

Filed by: ccoroiu [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=198231887&repo=mozilla-central

https://queue.taskcluster.net/v1/task/IQamtekDQc6tlTbkeqkTfA/runs/0/artifacts/public/logs/live_backing.log

task 2018-09-08T14:09:37.175Z] 14:09:37     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | test result correct 
[task 2018-09-08T14:09:37.176Z] 14:09:37     INFO - AddTask.js | Leaving test test_webext_contentscript_iframe_subframe_privileges
[task 2018-09-08T14:09:37.177Z] 14:09:37     INFO - AddTask.js | Entering test test_webext_background_remote_subframe_privileges
[task 2018-09-08T14:09:37.179Z] 14:09:37     INFO - Extension loaded
[task 2018-09-08T14:09:37.180Z] 14:09:37     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | postmessage origin ok - Expected: http://mochi.test:8888, Actual: http://mochi.test:8888 
[task 2018-09-08T14:09:37.181Z] 14:09:37     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | remote frame cannot access webextension APIs 
[task 2018-09-08T14:09:37.183Z] 14:09:37     INFO - Buffered messages finished
[task 2018-09-08T14:09:37.184Z] 14:09:37     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | Expected cookie value - Expected: cookie=monster, Actual:  
[task 2018-09-08T14:09:37.185Z] 14:09:37     INFO -     @moz-extension://be17e47b-669b-43f0-8276-5acaa4730024/background-subframe.js:5:7
[task 2018-09-08T14:09:37.186Z] 14:09:37     INFO -     EventListener.handleEvent*backgroundSubframeScript@moz-extension://be17e47b-669b-43f0-8276-5acaa4730024/background-subframe.js:2:5
[task 2018-09-08T14:09:37.188Z] 14:09:37     INFO -     @moz-extension://be17e47b-669b-43f0-8276-5acaa4730024/background-subframe.js:1:11
[task 2018-09-08T14:09:37.189Z] 14:09:37     INFO -     
[task 2018-09-08T14:09:37.190Z] 14:09:37     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | webext-background-subframe-privileges 
[task 2018-09-08T14:09:37.192Z] 14:09:37     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | test result correct 
[task 2018-09-08T14:09:37.193Z] 14:09:37     INFO - AddTask.js | Leaving test test_webext_background_remote_subframe_privileges

Comment hidden (Intermittent Failures Robot)

16 failures in 136 pushes (0.118 failures/push) were associated with this bug yesterday.

Repository breakdown:
* autoland: 8
* try: 4
* mozilla-central: 4

Platform breakdown:
* android-em-4-3-armv7-api16: 2
* osx-10-10: 2
* linux64-nightly: 1
* linux64: 10
* linux64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1489771&startday=2018-09-08&endday=2018-09-08&tree=all

Comment hidden (Intermittent Failures Robot)

17 failures in 2667 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 4
* try: 5
* autoland: 8

Platform breakdown:
* osx-10-10: 2
* android-em-4-3-armv7-api16: 3
* linux64-devedition: 1
* linux64: 10
* linux64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1489771&startday=2018-09-03&endday=2018-09-09&tree=all

Andreea Pavel [:apavel]

Assignee

Comment 3

•

6 years ago

This seems to be from here: https://hg.mozilla.org/integration/mozilla-inbound/rev/318b1252e9ba83cf071f2ae1b8729158be346760

Kris, please take a look.

Flags: needinfo?(kmaglione+bmo)

Kris Maglione [:kmag]

Comment 4

•

6 years ago

I just fixed the ridiculous assertion message. The failure isn't new.

Flags: needinfo?(kmaglione+bmo)

Andreea Pavel [:apavel]

Assignee

Comment 6

•

6 years ago

okay, but since you changed https://hg.mozilla.org/integration/mozilla-inbound/rev/318b1252e9ba83cf071f2ae1b8729158be346760#l1.13 and the failure mentions  "Expected cookie value - Expected: cookie=monster" is there a possibility it's from there? did you modify it somewhere else? this is a rather frequent failure.

Flags: needinfo?(kmaglione+bmo)

Kris Maglione [:kmag]

Comment 7

•

6 years ago

This has nothing to do with my change. I made that change because I saw the existing intermittent failure and was annoyed by the absurd assertion message.

Flags: needinfo?(kmaglione+bmo)

Comment hidden (Intermittent Failures Robot)

51 failures in 2684 pushes (0.019 failures/push) were associated with this bug in the last 7 days.

This is the #21 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 27
* mozilla-inbound: 21
* mozilla-central: 3

Platform breakdown:
* android-em-4-3-armv7-api16: 51

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1489771&startday=2018-09-10&endday=2018-09-16&tree=all

Andreea Pavel [:apavel]

Assignee

Comment 9

•

6 years ago

There are 71 total failures in the last 7 days, all on android-em-4-3-armv7-api16

Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=200048817&repo=autoland&lineNumber=1744

[task 2018-09-18T23:11:48.275Z] 23:11:48     INFO -  31 INFO TEST-START | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html
[task 2018-09-18T23:13:02.093Z] 23:13:02     INFO -  Buffered messages logged at 23:11:44
[task 2018-09-18T23:13:02.094Z] 23:13:02     INFO -  32 INFO AddTask.js | Entering test test_webext_tab_subframe_privileges
[task 2018-09-18T23:13:02.095Z] 23:13:02     INFO -  33 INFO Extension loaded
[task 2018-09-18T23:13:02.096Z] 23:13:02     INFO -  Buffered messages logged at 23:12:11
[task 2018-09-18T23:13:02.097Z] 23:13:02     INFO -  34 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | Subframe of a privileged page has access to privileged APIs
[task 2018-09-18T23:13:02.098Z] 23:13:02     INFO -  Buffered messages logged at 23:12:20
[task 2018-09-18T23:13:02.099Z] 23:13:02     INFO -  35 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | webext-tab-subframe-privileges
[task 2018-09-18T23:13:02.099Z] 23:13:02     INFO -  36 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | test result correct
[task 2018-09-18T23:13:02.099Z] 23:13:02     INFO -  Buffered messages logged at 23:12:21
[task 2018-09-18T23:13:02.099Z] 23:13:02     INFO -  37 INFO AddTask.js | Leaving test test_webext_tab_subframe_privileges
[task 2018-09-18T23:13:02.100Z] 23:13:02     INFO -  38 INFO AddTask.js | Entering test test_webext_background_subframe_privileges
[task 2018-09-18T23:13:02.100Z] 23:13:02     INFO -  39 INFO Extension loaded
[task 2018-09-18T23:13:02.100Z] 23:13:02     INFO -  Buffered messages logged at 23:12:27
[task 2018-09-18T23:13:02.100Z] 23:13:02     INFO -  40 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | Subframe of a background page has access to privileged APIs
[task 2018-09-18T23:13:02.100Z] 23:13:02     INFO -  41 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | webext-background-subframe-privileges
[task 2018-09-18T23:13:02.101Z] 23:13:02     INFO -  42 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | test result correct
[task 2018-09-18T23:13:02.102Z] 23:13:02     INFO -  43 INFO AddTask.js | Leaving test test_webext_background_subframe_privileges
[task 2018-09-18T23:13:02.102Z] 23:13:02     INFO -  44 INFO AddTask.js | Entering test test_webext_contentscript_iframe_subframe_privileges
[task 2018-09-18T23:13:02.103Z] 23:13:02     INFO -  Buffered messages logged at 23:12:28
[task 2018-09-18T23:13:02.103Z] 23:13:02     INFO -  45 INFO Extension loaded
[task 2018-09-18T23:13:02.104Z] 23:13:02     INFO -  Buffered messages logged at 23:12:44
[task 2018-09-18T23:13:02.105Z] 23:13:02     INFO -  46 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | Subframe of a content script privileged iframes has no access to privileged APIs
[task 2018-09-18T23:13:02.106Z] 23:13:02     INFO -  47 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | Subframe of a content script privileged iframes has access to content script APIs
[task 2018-09-18T23:13:02.107Z] 23:13:02     INFO -  48 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | webext-contentscript-subframe-privileges
[task 2018-09-18T23:13:02.108Z] 23:13:02     INFO -  49 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | test result correct
[task 2018-09-18T23:13:02.110Z] 23:13:02     INFO -  Buffered messages logged at 23:12:46
[task 2018-09-18T23:13:02.110Z] 23:13:02     INFO -  50 INFO AddTask.js | Leaving test test_webext_contentscript_iframe_subframe_privileges
[task 2018-09-18T23:13:02.111Z] 23:13:02     INFO -  51 INFO AddTask.js | Entering test test_webext_background_remote_subframe_privileges
[task 2018-09-18T23:13:02.111Z] 23:13:02     INFO -  52 INFO Extension loaded
[task 2018-09-18T23:13:02.112Z] 23:13:02     INFO -  Buffered messages logged at 23:12:58
[task 2018-09-18T23:13:02.112Z] 23:13:02     INFO -  53 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | postmessage origin ok - Expected: http://mochi.test:8888, Actual: http://mochi.test:8888
[task 2018-09-18T23:13:02.113Z] 23:13:02     INFO -  54 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | remote frame cannot access webextension APIs
[task 2018-09-18T23:13:02.113Z] 23:13:02     INFO -  Buffered messages finished
[task 2018-09-18T23:13:02.114Z] 23:13:02     INFO -  55 INFO TEST-UNEXPECTED-FAIL | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | Expected cookie value - Expected: cookie=monster, Actual:
[task 2018-09-18T23:13:02.114Z] 23:13:02     INFO -      @moz-extension://b4d7cc91-a88c-4e40-a91b-80eb0fc4ff23/background-subframe.js:5:7
[task 2018-09-18T23:13:02.115Z] 23:13:02     INFO -  56 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | webext-background-subframe-privileges
[task 2018-09-18T23:13:02.116Z] 23:13:02     INFO -  57 INFO TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | test result correct
[task 2018-09-18T23:13:02.116Z] 23:13:02     INFO -  58 INFO AddTask.js | Leaving test test_webext_background_remote_subframe_privileges
[task 2018-09-18T23:13:02.117Z] 23:13:02     INFO -  59 INFO TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_subframes_privileges.html | took 78729ms

Whiteboard: [stockwell needswork:owner]

Comment hidden (Intermittent Failures Robot)

17 failures in 571 pushes (0.03 failures/push) were associated with this bug yesterday.

Repository breakdown:
* autoland: 11
* mozilla-central: 2
* mozilla-inbound: 4

Platform breakdown:
* android-em-4-3-armv7-api16: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1489771&startday=2018-09-18&endday=2018-09-18&tree=all

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Comment 11

•

6 years ago

The only non-Android failures here have been with test-verify which lets the test run very often and is likely pre-existing.

The frequent Android failures start shortly before the renaming of the string, when the test chunks got increased in bug 1489645.

Blocks: 1489645

Flags: needinfo?(gbrown)

Geoff Brown [:gbrown]

Comment 12

•

6 years ago

This test previously ran in android/debug mochitest-48. The only difference I see is that mochitest-48 was running toolkit/components/alerts/test before toolkit/components/extensions/test/mochitest tests; with the new chunks, mochitest-60 runs toolkit/components/extensions/test/mochitest as the first manifest in the task. The TV failures may also indicate that this test relies on state from earlier tests. 

The additional test chunks are needed and we cannot guarantee test order across manifests. Unless someone can investigate further, I suggest disabling this test, at least, skip-if = os == 'android' || verify.

Flags: needinfo?(gbrown)

Comment hidden (Intermittent Failures Robot)

15 failures in 543 pushes (0.028 failures/push) were associated with this bug yesterday.

Repository breakdown:
* autoland: 10
* mozilla-inbound: 2
* try: 1
* mozilla-central: 2

Platform breakdown:
* android-em-4-3-armv7-api16: 15

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1489771&startday=2018-09-19&endday=2018-09-19&tree=all

Andreea Pavel [:apavel]

Assignee

Comment 14

•

6 years ago

Attached patch disabled test on android — Details — Splinter Review

Geoff please take a look and let me know what needs to be changed if any. 
Thank you.

Assignee: nobody → apavel

Attachment #9010826 - Flags: review?(gbrown)

Comment hidden (Intermittent Failures Robot)

23 failures in 540 pushes (0.043 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-central: 2
* autoland: 17
* mozilla-inbound: 4

Platform breakdown:
* android-em-4-3-armv7-api16: 23

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1489771&startday=2018-09-20&endday=2018-09-20&tree=all

Geoff Brown [:gbrown]

Comment 16

•

6 years ago

Comment on attachment 9010826 [details] [diff] [review]
disabled test on android

Review of attachment 9010826 [details] [diff] [review]:
-----------------------------------------------------------------

That looks fine - thanks!

Attachment #9010826 - Flags: review?(gbrown) → review+

Comment hidden (Intermittent Failures Robot)

18 failures in 538 pushes (0.033 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* mozilla-inbound: 7
* autoland: 11

Platform breakdown:
* linux64: 1
* android-em-4-3-armv7-api16: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1489771&startday=2018-09-21&endday=2018-09-21&tree=all

Pulsebot

Comment 18

•

6 years ago

Pushed by rgurzau@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/e7fcb90e8848
disable test_ext_subframes_privileges.html on android r=gbrown

Dorel Luca [:dluca]

Comment 19

•

6 years ago

bugherder

https://hg.mozilla.org/mozilla-central/rev/e7fcb90e8848

Status: NEW → RESOLVED

Closed: 6 years ago

status-firefox64: --- → fixed

Resolution: --- → FIXED

Target Milestone: --- → mozilla64

Comment hidden (Intermittent Failures Robot)

102 failures in 2902 pushes (0.035 failures/push) were associated with this bug in the last 7 days.

This is the #12 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. ** 

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 67
* mozilla-inbound: 25
* try: 3
* mozilla-central: 7

Platform breakdown:
* linux64: 1
* android-em-4-3-armv7-api16: 101

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1489771&startday=2018-09-17&endday=2018-09-23&tree=all

Cristina Coroiu [:ccoroiu]

Comment 21

•

6 years ago

No new failures since 22th of September.

CosminB

Updated

•

6 years ago

Flags: qe-verify-

Luca Greco [:rpl] [:luca] [:lgreco]

Updated

•

5 years ago

Whiteboard: [stockwell disable-recommended] → [stockwell disabled]