1732277 - Intermittent testing/firefox-ui/tests/functional/sessionstore/test_restore_windows_after_restart_and_quit.py TestSessionStoreEnabledNoPrivateWindows.test_with_variety | AssertionError: Items in the first set but not the second:

Status: RESOLVED DUPLICATE of bug 1702841

(Testing :: Firefox UI Tests, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=352497712&repo=mozilla-beta
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/CcfYMZC4SLWYnH7-FQC_3A/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-09-23T10:20:09.812Z] 10:20:09     INFO -    _reasonsToNotScheduleUpdates: Failed to check for Maintenance Service Registry Key: [Exception... "Component returned failure code: 0x80004001 (NS_ERROR_NOT_IMPLEMENTED) [nsIUpdateProcessor.getServiceRegKeyExists]"  nsresult: "0x80004001 (NS_ERROR_NOT_IMPLEMENTED)"  location: "JS frame :: resource://gre/modules/BackgroundUpdate.jsm :: _reasonsToNotScheduleUpdates :: line 243"  data: no]
[task 2021-09-23T10:20:09.815Z] 10:20:09     INFO -  1632392409815	Marionette	TRACE	All scripts recorded.
[task 2021-09-23T10:20:09.816Z] 10:20:09     INFO -  1632392409816	Marionette	INFO	Listening on port 2828
[task 2021-09-23T10:20:09.816Z] 10:20:09     INFO -  1632392409816	Marionette	DEBUG	Marionette is listening
[task 2021-09-23T10:20:09.876Z] 10:20:09     INFO -  1632392409875	Marionette	DEBUG	Accepted connection 0 from 127.0.0.1:49675
[task 2021-09-23T10:20:09.877Z] 10:20:09     INFO -  1632392409877	Marionette	DEBUG	Closed connection 0
[task 2021-09-23T10:20:09.877Z] 10:20:09     INFO -  1632392409877	Marionette	DEBUG	Accepted connection 1 from 127.0.0.1:49676
[task 2021-09-23T10:20:09.880Z] 10:20:09     INFO -  1632392409879	Marionette	DEBUG	1 -> [0,1,"WebDriver:NewSession",{"strictFileInteractability":true}]
[task 2021-09-23T10:20:09.884Z] 10:20:09     INFO -  1632392409883	Marionette	DEBUG	1 <- [1,1,null,{"sessionId":"da110cf1-1a02-274e-a59b-593180a8b035","capabilities":{"browserName":"firefox","browserVersion":"93.0" ... 7.mozrunner","moz:shutdownTimeout":60000,"moz:useNonSpecCompliantPointerOrigin":false,"moz:webdriverClick":true,"proxy":{}}}]
[task 2021-09-23T10:20:09.885Z] 10:20:09     INFO -  1632392409884	Marionette	DEBUG	1 -> [0,2,"Marionette:SetContext",{"value":"chrome"}]
[task 2021-09-23T10:20:09.885Z] 10:20:09     INFO -  1632392409884	Marionette	DEBUG	1 <- [1,2,null,{"value":null}]
[task 2021-09-23T10:20:09.886Z] 10:20:09     INFO -  1632392409885	Marionette	DEBUG	1 -> [0,3,"WebDriver:GetChromeWindowHandles",{}]
[task 2021-09-23T10:20:09.886Z] 10:20:09     INFO -  1632392409886	Marionette	DEBUG	1 <- [1,3,null,["cfcdfc03-1910-8a4f-b792-6f51a557e2c4","ad5b436e-6487-6446-8e73-dd96ef3801fe","a426dfe6-21a5-8747-b3a5-2aaf47ec4d5c"]]
[task 2021-09-23T10:20:09.887Z] 10:20:09     INFO -  1632392409886	Marionette	DEBUG	1 -> [0,4,"WebDriver:GetChromeWindowHandle",{}]
[task 2021-09-23T10:20:09.887Z] 10:20:09     INFO -  1632392409886	Marionette	DEBUG	1 <- [1,4,null,{"value":"a426dfe6-21a5-8747-b3a5-2aaf47ec4d5c"}]
[task 2021-09-23T10:20:09.888Z] 10:20:09     INFO -  1632392409887	Marionette	DEBUG	1 -> [0,5,"Marionette:GetContext",{}]
[task 2021-09-23T10:20:09.888Z] 10:20:09     INFO -  1632392409888	Marionette	DEBUG	1 <- [1,5,null,{"value":"chrome"}]
[task 2021-09-23T10:20:09.889Z] 10:20:09     INFO -  1632392409888	Marionette	DEBUG	1 -> [0,6,"Marionette:SetContext",{"value":"chrome"}]
[task 2021-09-23T10:20:09.889Z] 10:20:09     INFO -  1632392409889	Marionette	DEBUG	1 <- [1,6,null,{"value":null}]
[task 2021-09-23T10:20:09.891Z] 10:20:09     INFO -  1632392409891	Marionette	DEBUG	1 -> [0,7,"WebDriver:SwitchToWindow",{"handle":"cfcdfc03-1910-8a4f-b792-6f51a557e2c4","focus":true}]
[task 2021-09-23T10:20:09.897Z] 10:20:09     INFO -  1632392409897	Marionette	TRACE	Received DOM event activate for [object Window]
[task 2021-09-23T10:20:09.897Z] 10:20:09     INFO -  1632392409897	Marionette	TRACE	Received DOM event focus for [object HTMLDocument]
[task 2021-09-23T10:20:09.908Z] 10:20:09     INFO -  1632392409908	Marionette	DEBUG	1 <- [1,7,null,{"value":null}]
[task 2021-09-23T10:20:09.913Z] 10:20:09     INFO -  1632392409913	Marionette	DEBUG	1 -> [0,8,"WebDriver:ExecuteScript",{"script":"return gBrowser.tabs.map(tab => {\n                    return tab.linkedBrowser.cur ... andbox":"default","line":165,"filename":"tests/testing/firefox-ui/tests/functional/sessionstore/session_store_test_case.py"}]
[task 2021-09-23T10:20:09.914Z] 10:20:09     INFO -  1632392409914	Marionette	TRACE	[15] MarionetteCommands actor created for window id 4
[task 2021-09-23T10:20:09.915Z] 10:20:09     INFO -  1632392409915	Marionette	DEBUG	1 <- [1,8,null,{"value":["about:blank","http://127.0.0.1:49266/layout/mozilla_community.html"]}]
[task 2021-09-23T10:20:09.917Z] 10:20:09     INFO -  1632392409916	Marionette	DEBUG	1 -> [0,9,"Marionette:SetContext",{"value":"chrome"}]
[task 2021-09-23T10:20:09.917Z] 10:20:09     INFO -  1632392409916	Marionette	DEBUG	1 <- [1,9,null,{"value":null}]
[task 2021-09-23T10:20:09.918Z] 10:20:09     INFO -  1632392409917	Marionette	DEBUG	1 -> [0,10,"WebDriver:SwitchToWindow",{"handle":"a426dfe6-21a5-8747-b3a5-2aaf47ec4d5c","focus":true}]
[task 2021-09-23T10:20:09.923Z] 10:20:09     INFO -  1632392409923	Marionette	TRACE	Received DOM event activate for [object Window]
[task 2021-09-23T10:20:09.924Z] 10:20:09     INFO -  1632392409923	Marionette	TRACE	Received DOM event focus for [object HTMLDocument]
[task 2021-09-23T10:20:09.927Z] 10:20:09     INFO -  1632392409926	Marionette	DEBUG	1 <- [1,10,null,{"value":null}]
[task 2021-09-23T10:20:09.939Z] 10:20:09     INFO -  1632392409939	Marionette	DEBUG	1 -> [0,11,"WebDriver:GetChromeWindowHandle",{}]
[task 2021-09-23T10:20:09.940Z] 10:20:09     INFO -  1632392409939	Marionette	DEBUG	1 <- [1,11,null,{"value":"a426dfe6-21a5-8747-b3a5-2aaf47ec4d5c"}]
[task 2021-09-23T10:20:09.942Z] 10:20:09     INFO -  1632392409941	Marionette	DEBUG	1 -> [0,12,"Marionette:GetContext",{}]
[task 2021-09-23T10:20:09.942Z] 10:20:09     INFO -  1632392409942	Marionette	DEBUG	1 <- [1,12,null,{"value":"chrome"}]
[task 2021-09-23T10:20:09.943Z] 10:20:09     INFO -  1632392409942	Marionette	DEBUG	1 -> [0,13,"Marionette:SetContext",{"value":"chrome"}]
[task 2021-09-23T10:20:09.943Z] 10:20:09     INFO -  1632392409943	Marionette	DEBUG	1 <- [1,13,null,{"value":null}]
[task 2021-09-23T10:20:09.944Z] 10:20:09     INFO -  1632392409943	Marionette	DEBUG	1 -> [0,14,"WebDriver:SwitchToWindow",{"handle":"ad5b436e-6487-6446-8e73-dd96ef3801fe","focus":true}]
[task 2021-09-23T10:20:09.947Z] 10:20:09     INFO -  1632392409947	Marionette	TRACE	Received DOM event activate for [object Window]
[task 2021-09-23T10:20:09.947Z] 10:20:09     INFO -  1632392409947	Marionette	TRACE	Received DOM event focus for [object HTMLDocument]
[task 2021-09-23T10:20:09.948Z] 10:20:09     INFO -  1632392409948	Marionette	DEBUG	1 <- [1,14,null,{"value":null}]
[task 2021-09-23T10:20:09.960Z] 10:20:09     INFO -  1632392409960	Marionette	DEBUG	1 -> [0,15,"WebDriver:ExecuteScript",{"script":"return gBrowser.tabs.map(tab => {\n                    return tab.linkedBrowser.cu ... andbox":"default","line":165,"filename":"tests/testing/firefox-ui/tests/functional/sessionstore/session_store_test_case.py"}]
[task 2021-09-23T10:20:09.961Z] 10:20:09     INFO -  1632392409960	Marionette	TRACE	[31] MarionetteCommands actor created for window id 10
[task 2021-09-23T10:20:09.962Z] 10:20:09     INFO -  1632392409961	Marionette	DEBUG	1 <- [1,15,null,{"value":["http://127.0.0.1:49266/layout/mozilla_governance.html","http://127.0.0.1:49266/layout/mozilla_grants.html"]}]
[task 2021-09-23T10:20:09.963Z] 10:20:09     INFO -  1632392409962	Marionette	DEBUG	1 -> [0,16,"Marionette:SetContext",{"value":"chrome"}]
[task 2021-09-23T10:20:09.963Z] 10:20:09     INFO -  1632392409962	Marionette	DEBUG	1 <- [1,16,null,{"value":null}]
[task 2021-09-23T10:20:09.963Z] 10:20:09     INFO -  1632392409963	Marionette	DEBUG	1 -> [0,17,"WebDriver:SwitchToWindow",{"handle":"a426dfe6-21a5-8747-b3a5-2aaf47ec4d5c","focus":true}]
[task 2021-09-23T10:20:09.968Z] 10:20:09     INFO -  1632392409968	Marionette	TRACE	Received DOM event activate for [object Window]
[task 2021-09-23T10:20:09.969Z] 10:20:09     INFO -  1632392409968	Marionette	TRACE	Received DOM event focus for [object HTMLDocument]
[task 2021-09-23T10:20:09.969Z] 10:20:09     INFO -  1632392409969	Marionette	DEBUG	1 <- [1,17,null,{"value":null}]
[task 2021-09-23T10:20:09.980Z] 10:20:09     INFO -  1632392409979	Marionette	DEBUG	1 -> [0,18,"WebDriver:GetChromeWindowHandle",{}]
[task 2021-09-23T10:20:09.980Z] 10:20:09     INFO -  1632392409979	Marionette	DEBUG	1 <- [1,18,null,{"value":"a426dfe6-21a5-8747-b3a5-2aaf47ec4d5c"}]
[task 2021-09-23T10:20:09.980Z] 10:20:09     INFO -  1632392409980	Marionette	DEBUG	1 -> [0,19,"Marionette:GetContext",{}]
[task 2021-09-23T10:20:09.981Z] 10:20:09     INFO -  1632392409980	Marionette	DEBUG	1 <- [1,19,null,{"value":"chrome"}]
[task 2021-09-23T10:20:09.981Z] 10:20:09     INFO -  1632392409981	Marionette	DEBUG	1 -> [0,20,"Marionette:SetContext",{"value":"chrome"}]
[task 2021-09-23T10:20:09.981Z] 10:20:09     INFO -  1632392409981	Marionette	DEBUG	1 <- [1,20,null,{"value":null}]
[task 2021-09-23T10:20:09.981Z] 10:20:09     INFO -  1632392409981	Marionette	DEBUG	1 -> [0,21,"WebDriver:SwitchToWindow",{"handle":"a426dfe6-21a5-8747-b3a5-2aaf47ec4d5c","focus":true}]
[task 2021-09-23T10:20:09.982Z] 10:20:09     INFO -  1632392409981	Marionette	DEBUG	1 <- [1,21,null,{"value":null}]
[task 2021-09-23T10:20:09.983Z] 10:20:09     INFO -  1632392409982	Marionette	DEBUG	1 -> [0,22,"WebDriver:ExecuteScript",{"script":"return gBrowser.tabs.map(tab => {\n                    return tab.linkedBrowser.cu ... andbox":"default","line":165,"filename":"tests/testing/firefox-ui/tests/functional/sessionstore/session_store_test_case.py"}]
[task 2021-09-23T10:20:09.983Z] 10:20:09     INFO -  1632392409983	Marionette	TRACE	[32] MarionetteCommands actor created for window id 12
[task 2021-09-23T10:20:09.984Z] 10:20:09     INFO -  1632392409984	Marionette	DEBUG	1 <- [1,22,null,{"value":["http://127.0.0.1:49266/layout/mozilla.html"]}]
[task 2021-09-23T10:20:09.985Z] 10:20:09     INFO -  1632392409985	Marionette	DEBUG	1 -> [0,23,"Marionette:SetContext",{"value":"chrome"}]
[task 2021-09-23T10:20:09.985Z] 10:20:09     INFO -  1632392409985	Marionette	DEBUG	1 <- [1,23,null,{"value":null}]
[task 2021-09-23T10:20:09.986Z] 10:20:09     INFO -  1632392409985	Marionette	DEBUG	1 -> [0,24,"WebDriver:SwitchToWindow",{"handle":"a426dfe6-21a5-8747-b3a5-2aaf47ec4d5c","focus":true}]
[task 2021-09-23T10:20:09.986Z] 10:20:09     INFO -  1632392409986	Marionette	DEBUG	1 <- [1,24,null,{"value":null}]
[task 2021-09-23T10:20:09.987Z] 10:20:09     INFO -  1632392409987	Marionette	DEBUG	1 -> [0,25,"Marionette:GetContext",{}]
[task 2021-09-23T10:20:09.987Z] 10:20:09     INFO -  1632392409987	Marionette	DEBUG	1 <- [1,25,null,{"value":"chrome"}]
[task 2021-09-23T10:20:09.988Z] 10:20:09     INFO -  1632392409987	Marionette	DEBUG	1 -> [0,26,"Marionette:SetContext",{"value":"chrome"}]
[task 2021-09-23T10:20:09.988Z] 10:20:09     INFO -  1632392409987	Marionette	DEBUG	1 <- [1,26,null,{"value":null}]
[task 2021-09-23T10:20:09.988Z] 10:20:09     INFO -  1632392409988	Marionette	DEBUG	1 -> [0,27,"WebDriver:TakeScreenshot",{"id":null,"full":true,"hash":false,"scroll":true}]
[task 2021-09-23T10:20:10.051Z] 10:20:10     INFO -  1632392410050	Marionette	DEBUG	1 <- [1,27,null,{"value":"iVBORw0KGgoAAAANSUhEUgAABQAAAAPNCAYAAADWQsenAAAgAElEQVR4nOydd1hTZ+P+6fdn37et1lZF67YVW1Fba0utHW9F1LfD0Vpb ... AAAABjAhAAAAAAxgQgAAAAAIwJQAAAAAAYE4AAAAAAMCYAAQAAAGBMAAIAAADAmAAEAAAAgDEBCAAAAABjAhAAAAAAxgI0U8VQDUaa/wAAAABJRU5ErkJggg=="}]
[task 2021-09-23T10:20:10.057Z] 10:20:10     INFO -  1632392410057	Marionette	DEBUG	1 -> [0,28,"Marionette:SetContext",{"value":"chrome"}]
[task 2021-09-23T10:20:10.058Z] 10:20:10     INFO -  1632392410057	Marionette	DEBUG	1 <- [1,28,null,{"value":null}]
[task 2021-09-23T10:20:10.058Z] 10:20:10     INFO -  1632392410058	Marionette	DEBUG	1 -> [0,29,"Marionette:GetContext",{}]
[task 2021-09-23T10:20:10.059Z] 10:20:10     INFO -  1632392410058	Marionette	DEBUG	1 <- [1,29,null,{"value":"chrome"}]
[task 2021-09-23T10:20:10.059Z] 10:20:10     INFO -  1632392410059	Marionette	DEBUG	1 -> [0,30,"Marionette:SetContext",{"value":"content"}]
[task 2021-09-23T10:20:10.060Z] 10:20:10     INFO -  1632392410059	Marionette	DEBUG	1 <- [1,30,null,{"value":null}]
[task 2021-09-23T10:20:10.060Z] 10:20:10     INFO -  1632392410060	Marionette	DEBUG	1 -> [0,31,"WebDriver:GetPageSource",{}]
[task 2021-09-23T10:20:10.062Z] 10:20:10     INFO -  1632392410062	Marionette	TRACE	[37] MarionetteCommands actor created for window id 6442450945
[task 2021-09-23T10:20:10.063Z] 10:20:10     INFO -  1632392410063	Marionette	DEBUG	1 <- [1,31,null,{"value":"<html dir=\"ltr\" lang=\"en\"><head>\n    <title>Mozilla</title>\n    <link rel=\"shortcut icon\" type=\ ...  better for everyone.\n            <a href=\"mozilla_mission.html\">More</a>\n        </p>\n    </div>\n\n\n</body></html>"}]
[task 2021-09-23T10:20:10.064Z] 10:20:10     INFO -  1632392410064	Marionette	DEBUG	1 -> [0,32,"Marionette:SetContext",{"value":"chrome"}]
[task 2021-09-23T10:20:10.064Z] 10:20:10     INFO -  1632392410064	Marionette	DEBUG	1 <- [1,32,null,{"value":null}]
[task 2021-09-23T10:20:10.220Z] 10:20:10     INFO - TEST-UNEXPECTED-FAIL | testing/firefox-ui/tests/functional/sessionstore/test_restore_windows_after_restart_and_quit.py TestSessionStoreEnabledNoPrivateWindows.test_with_variety | AssertionError: Items in the first set but not the second:
[task 2021-09-23T10:20:10.220Z] 10:20:10     INFO - ('about:blank', 'http://127.0.0.1:49266/layout/mozilla_community.html')
[task 2021-09-23T10:20:10.220Z] 10:20:10     INFO - Items in the second set but not the first:
[task 2021-09-23T10:20:10.220Z] 10:20:10     INFO - ('http://127.0.0.1:49266/layout/mozilla_organizations.html', 'http://127.0.0.1:49266/layout/mozilla_community.html') : Non private browsing windows should have
[task 2021-09-23T10:20:10.221Z] 10:20:10     INFO -                          been restored. Expected {('http://127.0.0.1:49266/layout/mozilla_organizations.html', 'http://127.0.0.1:49266/layout/mozilla_community.html'), ('http://127.0.0.1:49266/layout/mozilla_governance.html', 'http://127.0.0.1:49266/layout/mozilla_grants.html'), ('http://127.0.0.1:49266/layout/mozilla.html',)}, got {('http://127.0.0.1:49266/layout/mozilla_governance.html', 'http://127.0.0.1:49266/layout/mozilla_grants.html'), ('about:blank', 'http://127.0.0.1:49266/layout/mozilla_community.html'), ('http://127.0.0.1:49266/layout/mozilla.html',)}.
[task 2021-09-23T10:20:10.221Z] 10:20:10     INFO - Traceback (most recent call last):
[task 2021-09-23T10:20:10.221Z] 10:20:10     INFO -   File "/opt/worker/tasks/task_163239229505369/build/venv/lib/python3.7/site-packages/marionette_harness/marionette_test/testcases.py", line 202, in run
[task 2021-09-23T10:20:10.221Z] 10:20:10     INFO -     testMethod()
[task 2021-09-23T10:20:10.221Z] 10:20:10     INFO -   File "/opt/worker/tasks/task_163239229505369/build/tests/firefox-ui/tests/testing/firefox-ui/tests/functional/sessionstore/test_restore_windows_after_restart_and_quit.py", line 53, in test_with_variety
[task 2021-09-23T10:20:10.221Z] 10:20:10     INFO -     self.test_windows, current_windows_set
[task 2021-09-23T10:20:10.221Z] 10:20:10     INFO - TEST-INFO took 6603ms

Comment 1

[Intermittent Failures Robot]

2 failures in 2873 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• autoland: 1

Platform and build breakdown:

• macosx1015-64-devedition-qr: 1
  • opt: 1
• macosx1015-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1732277&startday=2021-09-20&endday=2021-09-26&tree=all

Comment 2

[Intermittent Failures Robot]

3 failures in 3376 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• mozilla-central: 2

Platform and build breakdown:

• macosx1015-64-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1732277&startday=2021-09-27&endday=2021-10-03&tree=all

Comment 3

[Intermittent Failures Robot]

6 failures in 3626 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• try: 3
• mozilla-beta: 1

Platform and build breakdown:

• macosx1015-64-qr: 2
  • opt: 2
• macosx1015-64-shippable-qr: 3
  • opt: 3
• macosx1015-64-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1732277&startday=2021-10-04&endday=2021-10-10&tree=all