Closed Bug 1702841 Opened 3 years ago Closed 2 years ago

Intermittent esr91 testing/firefox-ui/tests/functional/sessionstore/<random> | AssertionError: Items in the first set but not the second

Categories

(Firefox :: Session Restore, defect, P5)

Firefox 91
defect

Tracking

()

RESOLVED WONTFIX
Tracking Status
firefox-esr91 --- affected
firefox98 --- unaffected
firefox99 --- unaffected
firefox100 --- unaffected

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: assertion, intermittent-failure)

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=335319714&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Jbxqw6HGQM6oyKazXFjugg/runs/0/artifacts/public/logs/live_backing.log


[task 2021-04-02T22:49:52.944Z] 22:49:52     INFO -  [CodeCoverage] Setting handlers for process 4390.
[task 2021-04-02T22:49:52.950Z] 22:49:52     INFO -  1617403792947	Marionette	DEBUG	1 <- [1,22,null,{"value":["http://127.0.0.1:44306/layout/mozilla.html"]}]
[task 2021-04-02T22:49:52.952Z] 22:49:52     INFO -  1617403792951	Marionette	DEBUG	1 -> [0,23,"Marionette:SetContext",{"value":"chrome"}]
[task 2021-04-02T22:49:52.953Z] 22:49:52     INFO -  1617403792951	Marionette	DEBUG	1 <- [1,23,null,{"value":null}]
[task 2021-04-02T22:49:52.954Z] 22:49:52     INFO -  1617403792953	Marionette	TRACE	[39] MarionetteEvents actor created for window id 22
[task 2021-04-02T22:49:52.957Z] 22:49:52     INFO -  1617403792956	Marionette	DEBUG	1 -> [0,24,"WebDriver:SwitchToWindow",{"handle":"32","focus":true}]
[task 2021-04-02T22:49:52.958Z] 22:49:52     INFO -  1617403792958	Marionette	DEBUG	1 <- [1,24,null,{"value":null}]
[task 2021-04-02T22:49:52.965Z] 22:49:52     INFO -  1617403792965	Marionette	DEBUG	1 -> [0,25,"Marionette:GetContext",{}]
[task 2021-04-02T22:49:52.966Z] 22:49:52     INFO -  1617403792965	Marionette	DEBUG	1 <- [1,25,null,{"value":"chrome"}]
[task 2021-04-02T22:49:52.970Z] 22:49:52     INFO -  1617403792970	Marionette	DEBUG	1 -> [0,26,"Marionette:SetContext",{"value":"chrome"}]
[task 2021-04-02T22:49:52.971Z] 22:49:52     INFO -  1617403792970	Marionette	DEBUG	1 <- [1,26,null,{"value":null}]
[task 2021-04-02T22:49:52.973Z] 22:49:52     INFO -  1617403792972	Marionette	DEBUG	1 -> [0,27,"WebDriver:TakeScreenshot",{"id":null,"full":true,"hash":false,"scroll":true}]
[task 2021-04-02T22:49:53.046Z] 22:49:53     INFO -  1617403793046	Marionette	DEBUG	1 <- [1,27,null,{"value":"iVBORw0KGgoAAAANSUhEUgAABQAAAAQQCAYAAAC9RfbYAAAgAElEQVR4nOydeXRU5eH+RwsKJCwBWQJhEZeitWrFpa3tsedr66/ab7Vq ... IQAAAAAMYEIAAAAACMCUAAAAAAGBOAAAAAADAmAAEAAABgTAACAAAAwJgABAAAAIAxAQgAAAAAYwIQAAAAAMYEIAAAAACMBeP4zYKxwQy/AAAAAElFTkSuQmCC"}]
[task 2021-04-02T22:49:53.062Z] 22:49:53     INFO -  1617403793061	Marionette	TRACE	[44] MarionetteEvents actor created for window id 29
[task 2021-04-02T22:49:53.076Z] 22:49:53     INFO -  1617403793075	Marionette	TRACE	[45] MarionetteEvents actor created for window id 31
[task 2021-04-02T22:49:53.087Z] 22:49:53     INFO -  1617403793086	Marionette	TRACE	[46] MarionetteEvents actor created for window id 33
[task 2021-04-02T22:49:53.091Z] 22:49:53     INFO -  1617403793091	Marionette	TRACE	[47] MarionetteEvents actor created for window id 35
[task 2021-04-02T22:49:53.095Z] 22:49:53     INFO -  1617403793095	Marionette	DEBUG	1 -> [0,28,"Marionette:SetContext",{"value":"chrome"}]
[task 2021-04-02T22:49:53.096Z] 22:49:53     INFO -  1617403793095	Marionette	DEBUG	1 <- [1,28,null,{"value":null}]
[task 2021-04-02T22:49:53.097Z] 22:49:53     INFO -  1617403793097	Marionette	DEBUG	1 -> [0,29,"Marionette:GetContext",{}]
[task 2021-04-02T22:49:53.098Z] 22:49:53     INFO -  1617403793097	Marionette	DEBUG	1 <- [1,29,null,{"value":"chrome"}]
[task 2021-04-02T22:49:53.098Z] 22:49:53     INFO -  1617403793098	Marionette	TRACE	[48] MarionetteEvents actor created for window id 37
[task 2021-04-02T22:49:53.099Z] 22:49:53     INFO -  1617403793098	Marionette	DEBUG	1 -> [0,30,"Marionette:SetContext",{"value":"content"}]
[task 2021-04-02T22:49:53.099Z] 22:49:53     INFO -  1617403793099	Marionette	DEBUG	1 <- [1,30,null,{"value":null}]
[task 2021-04-02T22:49:53.100Z] 22:49:53     INFO -  1617403793100	Marionette	DEBUG	1 -> [0,31,"WebDriver:GetPageSource",{}]
[task 2021-04-02T22:49:53.106Z] 22:49:53     INFO -  1617403793105	Marionette	TRACE	[37] MarionetteCommands actor created for window id 6442450945
[task 2021-04-02T22:49:53.107Z] 22:49:53     INFO -  1617403793107	Marionette	DEBUG	1 <- [1,31,null,{"value":"<html dir=\"ltr\" lang=\"en\"><head>\n    <title>Mozilla</title>\n    <link rel=\"shortcut icon\" type=\ ...  better for everyone.\n            <a href=\"mozilla_mission.html\">More</a>\n        </p>\n    </div>\n\n\n</body></html>"}]
[task 2021-04-02T22:49:53.108Z] 22:49:53     INFO -  1617403793108	Marionette	DEBUG	1 -> [0,32,"Marionette:SetContext",{"value":"chrome"}]
[task 2021-04-02T22:49:53.109Z] 22:49:53     INFO -  1617403793108	Marionette	DEBUG	1 <- [1,32,null,{"value":null}]
[task 2021-04-02T22:49:53.178Z] 22:49:53     INFO - TEST-UNEXPECTED-FAIL | testing/firefox-ui/tests/functional/sessionstore/test_restore_windows_after_restart_and_quit.py TestSessionStoreEnabledNoPrivateWindows.test_with_variety | AssertionError: Items in the first set but not the second```
Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Summary: Intermittent testing/firefox-ui/tests/functional/sessionstore/test_restore_windows_after_restart_and_quit.py TestSessionStoreEnabledNoPrivateWindows.test_with_variety | AssertionError: Items in the first set but not the second: → Intermittent testing/firefox-ui/tests/functional/sessionstore/test_restore_windows_after_restart_and_quit.py <random> | AssertionError: Items in the first set but not the second:
Status: REOPENED → RESOLVED
Closed: 3 years ago3 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Summary: Intermittent testing/firefox-ui/tests/functional/sessionstore/test_restore_windows_after_restart_and_quit.py <random> | AssertionError: Items in the first set but not the second: → Intermittent testing/firefox-ui/tests/functional/sessionstore/<random> | AssertionError: Items in the first set but not the second

With the work on bug 1726465 these failures might get fixed.

Depends on: 1726465

The changes on bug 1759574 should actually have helped here. Lets see if these failures continue to happen or finally have stopped.

Component: Firefox UI Tests → Session Restore
Depends on: 1759574
Product: Testing → Firefox
QA Contact: hskupin
Summary: Intermittent testing/firefox-ui/tests/functional/sessionstore/<random> | AssertionError: Items in the first set but not the second → Intermittent browser/component/sessionstore/test/marionette/<random> | AssertionError: Items in the first set but not the second

Actually there haven't been intermittent failures on mozilla-central for quite some time. All recent ones have only been seen on esr91. AS such I think it makes sense to cover esr91 only here, and revert the summary because on this branch the tests are still running as part of the Firefox UI tests.

Status: REOPENED → NEW
Summary: Intermittent browser/component/sessionstore/test/marionette/<random> | AssertionError: Items in the first set but not the second → Intermittent esr91 testing/firefox-ui/tests/functional/sessionstore/<random> | AssertionError: Items in the first set but not the second
Version: unspecified → Firefox 91

This is a esr91 only failure and as such will never get the changes from bug 1726465.

No longer depends on: 1726465
Status: NEW → RESOLVED
Closed: 3 years ago2 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

The esr91 branch is no longer supported. Closing the bug.

Status: REOPENED → RESOLVED
Closed: 2 years ago2 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.