Closed Bug 1645565 Opened 4 years ago Closed 3 years ago

Intermittent toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | CS can access page DOM - Expected:

Categories

(WebExtensions :: General, defect, P5)

defect

Tracking

(firefox-esr91 fixed, firefox94 wontfix, firefox95 fixed)

RESOLVED FIXED
95 Branch
Tracking Status
firefox-esr91 --- fixed
firefox94 --- wontfix
firefox95 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: zombie)

References

Details

(Keywords: intermittent-failure, Whiteboard: [addons-jira])

Attachments

(3 files)

Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=306189369&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KxX8Ab6HQciJ5PYxda7S8g/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KxX8Ab6HQciJ5PYxda7S8g/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1


[task 2020-06-13T01:52:48.654Z] 01:52:48 INFO - TEST-START | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html
[task 2020-06-13T01:52:48.741Z] 01:52:48 INFO - GECKO(1240) | Console message: [JavaScript Warning: "The character encoding of a framed document was not declared. The document may appear different if viewed without the document framing it." {file: "http://mochi.test:8888/tests/toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html" line: 0}]
[task 2020-06-13T01:52:48.839Z] 01:52:48 INFO - TEST-INFO | started process screencapture
[task 2020-06-13T01:52:49.002Z] 01:52:49 INFO - TEST-INFO | screencapture: exit 0
[task 2020-06-13T01:52:49.003Z] 01:52:49 INFO - Buffered messages logged at 01:52:48
[task 2020-06-13T01:52:49.003Z] 01:52:49 INFO - add_task | Entering test test_content_script_cross_origin_frame
[task 2020-06-13T01:52:49.003Z] 01:52:49 INFO - Extension loaded
[task 2020-06-13T01:52:49.003Z] 01:52:49 INFO - Buffered messages finished
[task 2020-06-13T01:52:49.006Z] 01:52:49 INFO - TEST-UNEXPECTED-FAIL | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | CS can access page DOM - Expected:
[task 2020-06-13T01:52:49.006Z] 01:52:49 INFO -
[task 2020-06-13T01:52:49.006Z] 01:52:49 INFO - Sample text
[task 2020-06-13T01:52:49.007Z] 01:52:49 INFO -
[task 2020-06-13T01:52:49.007Z] 01:52:49 INFO -
[task 2020-06-13T01:52:49.007Z] 01:52:49 INFO -
[task 2020-06-13T01:52:49.007Z] 01:52:49 INFO - , Actual: Sample text
[task 2020-06-13T01:52:49.007Z] 01:52:49 INFO - SimpleTest.ok@SimpleTest/SimpleTest.js:299:16
[task 2020-06-13T01:52:49.007Z] 01:52:49 INFO - testHandler@SimpleTest/ExtensionTestUtils.js:68:18
[task 2020-06-13T01:52:49.007Z] 01:52:49 INFO - testResult@SimpleTest/ExtensionTestUtils.js:82:18
[task 2020-06-13T01:52:49.007Z] 01:52:49 INFO - AsyncExtensionTestUtils.loadExtension@SimpleTest/ExtensionTestUtils.js:113:33
[task 2020-06-13T01:52:49.008Z] 01:52:49 INFO - test_content_script_cross_origin_frame@toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html:14:40
[task 2020-06-13T01:52:49.008Z] 01:52:49 INFO - nextTick/<@SimpleTest/SimpleTest.js:2084:34
[task 2020-06-13T01:52:49.008Z] 01:52:49 INFO - nextTick@SimpleTest/SimpleTest.js:2109:11
[task 2020-06-13T01:52:49.008Z] 01:52:49 INFO - setTimeout handler
SimpleTest_setTimeoutShim@SimpleTest/SimpleTest.js:788:41
[task 2020-06-13T01:52:49.008Z] 01:52:49 INFO - add_task@SimpleTest/SimpleTest.js:2039:17
[task 2020-06-13T01:52:49.008Z] 01:52:49 INFO - @toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html:12:9

Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → INCOMPLETE

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=316783055&repo=mozilla-beta&lineNumber=10173

[task 2020-09-26T09:03:46.333Z] 09:03:46 INFO - TEST-START | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html
[task 2020-09-26T09:03:46.412Z] 09:03:46 INFO - GECKO(7888) | Console message: [JavaScript Warning: "The character encoding of a framed document was not declared. The document may appear different if viewed without the document framing it." {file: "http://mochi.test:8888/tests/toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html" line: 0}]
[task 2020-09-26T09:03:46.584Z] 09:03:46 INFO - GECKO(7888) | Console message: [JavaScript Warning: "Storage access automatically granted for origin “http://example.org” on “http://mochi.test:8888”."]
[task 2020-09-26T09:03:46.724Z] 09:03:46 INFO - TEST-INFO | started process screenshot
[task 2020-09-26T09:03:47.076Z] 09:03:47 INFO - TEST-INFO | screenshot: exit 0
[task 2020-09-26T09:03:47.077Z] 09:03:47 INFO - Buffered messages logged at 09:03:46
[task 2020-09-26T09:03:47.077Z] 09:03:47 INFO - add_task | Entering test test_content_script_cross_origin_frame
[task 2020-09-26T09:03:47.077Z] 09:03:47 INFO - Extension loaded
[task 2020-09-26T09:03:47.077Z] 09:03:47 INFO - Buffered messages finished
[task 2020-09-26T09:03:47.078Z] 09:03:47 INFO - TEST-UNEXPECTED-FAIL | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | CS can access page DOM - Expected:
[task 2020-09-26T09:03:47.078Z] 09:03:47 INFO -
[task 2020-09-26T09:03:47.078Z] 09:03:47 INFO - Sample text
[task 2020-09-26T09:03:47.079Z] 09:03:47 INFO -
[task 2020-09-26T09:03:47.079Z] 09:03:47 INFO -
[task 2020-09-26T09:03:47.079Z] 09:03:47 INFO -
[task 2020-09-26T09:03:47.079Z] 09:03:47 INFO - , Actual: Sample text
[task 2020-09-26T09:03:47.079Z] 09:03:47 INFO - SimpleTest.ok@SimpleTest/SimpleTest.js:417:16
[task 2020-09-26T09:03:47.079Z] 09:03:47 INFO - testHandler@SimpleTest/ExtensionTestUtils.js:68:18
[task 2020-09-26T09:03:47.079Z] 09:03:47 INFO - testResult@SimpleTest/ExtensionTestUtils.js:82:18
[task 2020-09-26T09:03:47.079Z] 09:03:47 INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | undefined - Expected: 1.0, Actual: 1.0
[task 2020-09-26T09:03:47.080Z] 09:03:47 INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | undefined - Expected: Generated extension, Actual: Generated extension
[task 2020-09-26T09:03:47.080Z] 09:03:47 INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | sender frameId is ok
[task 2020-09-26T09:03:47.080Z] 09:03:47 INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | url is ok
[task 2020-09-26T09:03:47.080Z] 09:03:47 INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | CS runs in a shared Sandbox - Expected: 357, Actual: 357
[task 2020-09-26T09:03:47.081Z] 09:03:47 INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | Promise rejected, expecting rejection to match /does is not defined/, got "does is not defined": Got the expected rejection from tabs.executeScript
[task 2020-09-26T09:03:47.081Z] 09:03:47 INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | Promise rejected, expecting rejection to match /Script .* result is non-structured-clonable data/, got "Script '<anonymous code>' result is non-structured-clonable data": Got the expected rejection from tabs.executeScript
[task 2020-09-26T09:03:47.081Z] 09:03:47 INFO - content script received tabs.sendMessage
[task 2020-09-26T09:03:47.081Z] 09:03:47 INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | Got correct response - Expected: 21, Actual: 21
[task 2020-09-26T09:03:47.081Z] 09:03:47 INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | undefined assertion name
[task 2020-09-26T09:03:47.081Z] 09:03:47 INFO - add_task | Leaving test test_content_script_cross_origin_frame
[task 2020-09-26T09:03:47.081Z] 09:03:47 INFO - GECKO(7888) | MEMORY STAT | vsize 19405895MB | vsizeMaxContiguous 74541690MB | residentFast 595MB
[task 2020-09-26T09:03:47.082Z] 09:03:47 INFO - TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | took 576ms

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 4 years ago4 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 4 years ago3 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 3 years ago3 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

Update:
There have been 38 failures within the last 7 days:
• 3 failures on OS X 10.15 WebRender opt
• 9 failures on OS X 10.15 WebRender Shippable opt
• 16 failures on Windows 10 x64 2004 WebRender opt
• 10 failures on Windows 10 x64 2004 WebRender Shippable opt
Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=347777708&repo=mozilla-central&lineNumber=10165

[task 2021-08-08T11:31:09.100Z] 11:31:09     INFO - TEST-START | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html
[task 2021-08-08T11:31:09.128Z] 11:31:09     INFO - GECKO(6180) | Console message: [JavaScript Warning: "The character encoding of a framed document was not declared. The document may appear different if viewed without the document framing it." {file: "http://mochi.test:8888/tests/toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html" line: 0}]
[task 2021-08-08T11:31:09.214Z] 11:31:09     INFO - TEST-INFO | started process screenshot
[task 2021-08-08T11:31:09.306Z] 11:31:09     INFO - TEST-INFO | screenshot: exit 0
[task 2021-08-08T11:31:09.316Z] 11:31:09     INFO - Buffered messages logged at 11:31:09
[task 2021-08-08T11:31:09.317Z] 11:31:09     INFO - add_task | Entering test test_content_script_cross_origin_frame
[task 2021-08-08T11:31:09.317Z] 11:31:09     INFO - Load first extension
[task 2021-08-08T11:31:09.317Z] 11:31:09     INFO - Extension loaded
[task 2021-08-08T11:31:09.318Z] 11:31:09     INFO - Load a page, test content scripts in new frame with extension loaded
[task 2021-08-08T11:31:09.318Z] 11:31:09     INFO - Buffered messages finished
[task 2021-08-08T11:31:09.319Z] 11:31:09     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | CS can access page DOM - Expected: 
[task 2021-08-08T11:31:09.319Z] 11:31:09     INFO - 
[task 2021-08-08T11:31:09.319Z] 11:31:09     INFO - Sample text
[task 2021-08-08T11:31:09.319Z] 11:31:09     INFO - 
[task 2021-08-08T11:31:09.319Z] 11:31:09     INFO - 
[task 2021-08-08T11:31:09.320Z] 11:31:09     INFO - 
[task 2021-08-08T11:31:09.320Z] 11:31:09     INFO - , Actual: Sample text 
[task 2021-08-08T11:31:09.320Z] 11:31:09     INFO -     SimpleTest.ok@SimpleTest/SimpleTest.js:417:16
[task 2021-08-08T11:31:09.320Z] 11:31:09     INFO -     testHandler@SimpleTest/ExtensionTestUtils.js:68:18
[task 2021-08-08T11:31:09.320Z] 11:31:09     INFO -     testResult@SimpleTest/ExtensionTestUtils.js:82:18
[task 2021-08-08T11:31:09.320Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | undefined - Expected: 1.0, Actual: 1.0 
[task 2021-08-08T11:31:09.321Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | undefined - Expected: Generated extension, Actual: Generated extension 
[task 2021-08-08T11:31:09.322Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | sender frameId is ok 
[task 2021-08-08T11:31:09.323Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | url is ok 
[task 2021-08-08T11:31:09.324Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | CS runs in a shared Sandbox - Expected: 357, Actual: 357 
[task 2021-08-08T11:31:09.324Z] 11:31:09     INFO - GECKO(6180) | Console message: [JavaScript Warning: "Storage access automatically granted for origin http://example.org on http://mochi.test:8888."]
[task 2021-08-08T11:31:09.325Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | Promise rejected, expecting rejection to match /does is not defined/, got "does is not defined": Got the expected rejection from tabs.executeScript 
[task 2021-08-08T11:31:09.326Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | Promise rejected, expecting rejection to match /Script .* result is non-structured-clonable data/, got "Script '<anonymous code>' result is non-structured-clonable data": Got the expected rejection from tabs.executeScript 
[task 2021-08-08T11:31:09.327Z] 11:31:09     INFO - content script received tabs.sendMessage
[task 2021-08-08T11:31:09.327Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | Got correct response - Expected: 21, Actual: 21 
[task 2021-08-08T11:31:09.328Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | undefined assertion name 
[task 2021-08-08T11:31:09.328Z] 11:31:09     INFO - Load second extension, test content scripts in existing frame
[task 2021-08-08T11:31:09.329Z] 11:31:09     INFO - Extension loaded
[task 2021-08-08T11:31:09.329Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | CS can access page DOM - Expected: Sample text, Actual: Sample text 
[task 2021-08-08T11:31:09.330Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | undefined - Expected: 1.0, Actual: 1.0 
[task 2021-08-08T11:31:09.330Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | undefined - Expected: Generated extension, Actual: Generated extension 
[task 2021-08-08T11:31:09.331Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | sender frameId is ok 
[task 2021-08-08T11:31:09.331Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | url is ok 
[task 2021-08-08T11:31:09.332Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | CS runs in a shared Sandbox - Expected: 357, Actual: 357 
[task 2021-08-08T11:31:09.332Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | Promise rejected, expecting rejection to match /does is not defined/, got "does is not defined": Got the expected rejection from tabs.executeScript 
[task 2021-08-08T11:31:09.333Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | Promise rejected, expecting rejection to match /Script .* result is non-structured-clonable data/, got "Script '<anonymous code>' result is non-structured-clonable data": Got the expected rejection from tabs.executeScript 
[task 2021-08-08T11:31:09.333Z] 11:31:09     INFO - content script received tabs.sendMessage
[task 2021-08-08T11:31:09.334Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | Got correct response - Expected: 21, Actual: 21 
[task 2021-08-08T11:31:09.334Z] 11:31:09     INFO - TEST-PASS | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | undefined assertion name 
[task 2021-08-08T11:31:09.335Z] 11:31:09     INFO - add_task | Leaving test test_content_script_cross_origin_frame
[task 2021-08-08T11:31:09.335Z] 11:31:09     INFO - GECKO(6180) | MEMORY STAT | vsize 2103754MB | vsizeMaxContiguous 65479172MB | residentFast 78MB | heapAllocated 13MB
[task 2021-08-08T11:31:09.336Z] 11:31:09     INFO - TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html | took 195ms
[task 2021-08-08T11:31:09.336Z] 11:31:09     INFO - TEST-START | toolkit/components/extensions/test/mochitest/test_ext_contentscript_incognito.html
Whiteboard: [stockwell needswork:owner]

Shane, as the owner of this component, could you help us assign it to someone?
Thank you.

Flags: needinfo?(mixedpuppy)

Update:
There have been 30 failures within the last 7 days:
• 1 failures on OS X 10.15 WebRender opt
• 9 failures on OS X 10.15 WebRender Shippable opt
• 11 failures on Windows 10 x64 2004 WebRender opt
• 9 failures on Windows 10 x64 2004 WebRender Shippable opt
Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=348448600&repo=mozilla-central&lineNumber=8837

Keywords: leave-open
Attachment #9236808 - Attachment description: Bug 1645565 - disable test_ext_contentscript_fission_frame.html on OS_X_10.15_64_qr_opt and windows_10_64_qr_opt for frequent failures. r=#intermittent-reviewers → Bug 1645565 - disable test_ext_contentscript_fission_frame.html on OS_X_10.15_64_opt and windows_10_64_opt for frequent failures. r=#intermittent-reviewers
Whiteboard: [stockwell disable-recommended] → [stockwell disabled]
Pushed by imoraru@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/1ad45ece4e1d
disable test_ext_contentscript_fission_frame.html on OS_X_10.15_64_opt and windows_10_64_opt for frequent failures. r=intermittent-reviewers,jmaher DONTBUILD

This seems weird, it seems document.body.innerText intermittently returns whitespace and newlines:
https://treeherder.mozilla.org/logviewer?job_id=348725722&repo=autoland&lineNumber=8771

and then this assertion fails:
https://searchfox.org/mozilla-central/rev/9dceacf3d7/toolkit/components/extensions/test/mochitest/test_ext_contentscript_fission_frame.html#61-62

Apparently, innerText is supposed to include whitespace in some cases, but it seems non-deterministic without any style changes for the simple page included as an iframe in another simple page:
https://searchfox.org/mozilla-central/rev/d3683dbb25/toolkit/components/extensions/test/mochitest/file_sample.html
https://searchfox.org/mozilla-central/rev/9dceacf3d7/toolkit/components/extensions/test/mochitest/file_with_xorigin_frame.html

I can work around it easily for this test, but ni? for Emilio to check if this is an interesting bug for the DOM team.

Flags: needinfo?(mixedpuppy) → needinfo?(emilio)

Ah, so I bet what's going on, and it is expected to some extent. If you send a message to the cross-origin iframe before it gets displayed once, the iframe still doesn't have frames so we end up in .textContent effectively.

Flags: needinfo?(emilio)
Assignee: nobody → tomica
Pushed by apavel@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/999d04afd2a4
include win10_2004 in disabling condition r=intermittent-reviewers,MasterWayZ,mixedpuppy DONTBUILD

innerText can be flaky for unrelated reasons, and we dont't actually need it
for this test.

Pushed by tjovanovic@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/2a8f322bfb8d
Avoid using innerText in test_ext_contentscript_fission_frame r=willdurand
Whiteboard: [stockwell disabled] → [addons-jira][stockwell disabled]
Whiteboard: [addons-jira][stockwell disabled] → [addons-jira]

The only two remaining failures were from ESR, since we didn't bother with uplifting the test fix.

Closing as fixed.

Status: REOPENED → RESOLVED
Closed: 3 years ago3 years ago
Resolution: --- → FIXED
Target Milestone: --- → 95 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: