Closed Bug 1829464 Opened 1 year ago Closed 1 year ago

Intermittent telemetry/marionette/tests/client/test_main_tab_scalars.py TestMainTabScalars.test_main_tab_scalars | AssertionError: 2 != 3

Categories

(Toolkit :: Telemetry, defect, P5)

Product:
Toolkit
Component:
Telemetry
Type:
defect

Tracking

()

Status:
RESOLVED FIXED
Milestone:
114 Branch
Tracking Flags:
Tracking Status
firefox-esr102 --- unaffected
firefox112 --- unaffected
firefox113 --- unaffected
firefox114 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: barret)

References

(Regression)

Details

(Keywords: assertion, intermittent-failure, regression, Whiteboard: [retriggered])

Attachments

(1 file)

Bug 1829464 - Fix intermittent in test_main_tab_scalars.py r?chutten
48 bytes, text/x-phabricator-request
Details | Review

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=413376846&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/aD7-JWe7T-Kodh4onoaclA/runs/0/artifacts/public/logs/live_backing.log

[task 2023-04-22T06:21:07.438Z] 06:21:07     INFO -  [Parent 1903, Main Thread] WARNING: '!sTextInputHandlingWidget', file /builds/worker/checkouts/gecko/dom/events/IMEStateManager.cpp:1015
[task 2023-04-22T06:21:07.445Z] 06:21:07     INFO -  1682144467444	Marionette	DEBUG	1 <- [1,1,null,{"sessionId":"21c217a3-fa16-443f-b586-1683814f988a","capabilities":{"browserName":"firefox","browserVersion":"114.0a1","platformName":"linux","acceptInsecureCerts":false,"pageLoadStrategy":"normal","setWindowRect":true,"timeouts":{"implicit":0,"pageLoad":300000,"script":30000},"strictFileInteractability":true,"unhandledPromptBehavior":"dismiss and notify","moz:accessibilityChecks":false,"moz:buildID":"20230422060244","moz:headless":false,"moz:platformVersion":"4.4.0-1014-aws","moz:processID":1903,"moz:profile":"/builds/worker/workspace/build/tmp7pebqrf5.mozrunner","moz:shutdownTimeout":60000,"moz:useNonSpecCompliantPointerOrigin":false,"moz:webdriverClick":true,"moz:windowless":false,"proxy":{}}}]
[task 2023-04-22T06:21:07.451Z] 06:21:07     INFO -  1682144467450	Marionette	DEBUG	1 -> [0,2,"Marionette:SetContext",{"value":"content"}]
[task 2023-04-22T06:21:07.452Z] 06:21:07     INFO -  1682144467452	Marionette	DEBUG	1 <- [1,2,null,{"value":null}]
[task 2023-04-22T06:21:07.458Z] 06:21:07     INFO -  1682144467458	Marionette	DEBUG	1 -> [0,3,"Marionette:GetContext",{}]
[task 2023-04-22T06:21:07.459Z] 06:21:07     INFO -  1682144467459	Marionette	DEBUG	1 <- [1,3,null,{"value":"content"}]
[task 2023-04-22T06:21:07.463Z] 06:21:07     INFO -  1682144467462	Marionette	DEBUG	1 -> [0,4,"Marionette:SetContext",{"value":"chrome"}]
[task 2023-04-22T06:21:07.464Z] 06:21:07     INFO -  1682144467463	Marionette	DEBUG	1 <- [1,4,null,{"value":null}]
[task 2023-04-22T06:21:07.467Z] 06:21:07     INFO -  [WARN  glean_core::upload] Attempted to enqueue a duplicate ping 58bd8724-de28-4c91-8368-ebda24810132 at /submit/firefox-desktop/baseline/1/58bd8724-de28-4c91-8368-ebda24810132.
[task 2023-04-22T06:21:07.471Z] 06:21:07     INFO -  1682144467471	Marionette	DEBUG	1 -> [0,5,"WebDriver:ExecuteScript",{"script":"const { ClientID } = ChromeUtils.import(\n                  \"resource://gre/modules/ClientID.jsm\"\n                );\n                return ClientID.getCachedClientID();","args":[],"newSandbox":true,"sandbox":"default","line":212,"filename":"venv/lib/python3.7/site-packages/telemetry_harness/testcase.py"}]
[task 2023-04-22T06:21:07.479Z] 06:21:07     INFO -  1682144467479	RemoteAgent	TRACE	WebDriverProcessData actor created for PID 1903
[task 2023-04-22T06:21:07.481Z] 06:21:07     INFO -  1682144467481	Marionette	TRACE	[1] MarionetteCommands actor created for window id 2
[task 2023-04-22T06:21:07.489Z] 06:21:07     INFO -  1682144467488	Marionette	DEBUG	1 <- [1,5,null,{"value":"3fe7e992-0f74-40fe-b7a1-a1c2d922891a"}]
[task 2023-04-22T06:21:07.492Z] 06:21:07     INFO -  1682144467492	Marionette	DEBUG	1 -> [0,6,"Marionette:SetContext",{"value":"content"}]
[task 2023-04-22T06:21:07.493Z] 06:21:07     INFO -  1682144467493	Marionette	DEBUG	1 <- [1,6,null,{"value":null}]
[task 2023-04-22T06:21:07.498Z] 06:21:07     INFO -  1682144467498	Marionette	DEBUG	1 -> [0,7,"Marionette:GetContext",{}]
[task 2023-04-22T06:21:07.499Z] 06:21:07     INFO -  1682144467499	Marionette	DEBUG	1 <- [1,7,null,{"value":"content"}]
[task 2023-04-22T06:21:07.502Z] 06:21:07     INFO -  1682144467502	Marionette	DEBUG	1 -> [0,8,"Marionette:SetContext",{"value":"chrome"}]
[task 2023-04-22T06:21:07.503Z] 06:21:07     INFO -  1682144467502	Marionette	DEBUG	1 <- [1,8,null,{"value":null}]
[task 2023-04-22T06:21:07.505Z] 06:21:07     INFO -  1682144467505	Marionette	DEBUG	1 -> [0,9,"WebDriver:TakeScreenshot",{"id":null,"full":true,"hash":false,"scroll":true}]
[task 2023-04-22T06:21:07.521Z] 06:21:07     INFO -  [GFX3-]: Creating null Skia image from null SourceSurface
[task 2023-04-22T06:21:07.524Z] 06:21:07     INFO -  [GFX3-]: Creating null Skia image from null SourceSurface
[task 2023-04-22T06:21:07.554Z] 06:21:07     INFO -  1682144467553	Marionette	DEBUG	1 <- [1,9,null,{"value":"iVBORw0KGgoAAAANSUhEUgAABQAAAAQQCAYAAAC9RfbYAAAgAElEQVR4XuzdCbwtV10n+nXukJvk3iRMGSDxYQBBQMC2BRF9n6eNgNo2KCjaiCggoPChG1Qc+iOC4 ... AAAECBAgQIECAAAECBAgQIECAwMACCoADL67QCBAgQIAAAQIECBAgQIAAAQIECCgA2gMECBAgQIAAAQIECBAgQIAAAQIEBhb4P1JIiOmCIKaAAAAAAElFTkSuQmCC"}]
[task 2023-04-22T06:21:07.603Z] 06:21:07     INFO -  1682144467603	Marionette	DEBUG	1 -> [0,10,"Marionette:SetContext",{"value":"content"}]
[task 2023-04-22T06:21:07.605Z] 06:21:07     INFO -  1682144467604	Marionette	DEBUG	1 <- [1,10,null,{"value":null}]
[task 2023-04-22T06:21:07.607Z] 06:21:07     INFO -  1682144467607	Marionette	DEBUG	1 -> [0,11,"Marionette:GetContext",{}]
[task 2023-04-22T06:21:07.608Z] 06:21:07     INFO -  1682144467608	Marionette	DEBUG	1 <- [1,11,null,{"value":"content"}]
[task 2023-04-22T06:21:07.610Z] 06:21:07     INFO -  1682144467609	Marionette	DEBUG	1 -> [0,12,"Marionette:SetContext",{"value":"content"}]
[task 2023-04-22T06:21:07.611Z] 06:21:07     INFO -  1682144467610	Marionette	DEBUG	1 <- [1,12,null,{"value":null}]
[task 2023-04-22T06:21:07.612Z] 06:21:07     INFO -  1682144467612	Marionette	DEBUG	1 -> [0,13,"WebDriver:GetPageSource",{}]
[task 2023-04-22T06:21:07.614Z] 06:21:07     INFO -  1682144467614	Marionette	TRACE	[6] MarionetteCommands actor created for window id 13
[task 2023-04-22T06:21:07.616Z] 06:21:07     INFO -  1682144467615	Marionette	DEBUG	1 <- [1,13,null,{"value":"<html xmlns=\"http://www.w3.org/1999/xhtml\" dir=\"ltr\" lang=\"en-US\"><head>\n  <meta charset=\"utf-8\">\n  <meta name=\"color-scheme\" ... <a href=\"about:webrtc\">about:webrtc</a></li><li><a href=\"about:welcome\">about:welcome</a></li></ul>\n  </div>\n\n\n</body></html>"}]
[task 2023-04-22T06:21:07.676Z] 06:21:07     INFO - TEST-UNEXPECTED-FAIL | telemetry/marionette/tests/client/test_main_tab_scalars.py TestMainTabScalars.test_main_tab_scalars | AssertionError: 2 != 3
[task 2023-04-22T06:21:07.676Z] 06:21:07     INFO - Traceback (most recent call last):
[task 2023-04-22T06:21:07.676Z] 06:21:07     INFO -   File "/builds/worker/workspace/build/venv/lib/python3.7/site-packages/marionette_harness/marionette_test/testcases.py", line 198, in run
[task 2023-04-22T06:21:07.676Z] 06:21:07     INFO -     testMethod()
[task 2023-04-22T06:21:07.676Z] 06:21:07     INFO -   File "/builds/worker/workspace/build/tests/telemetry/marionette/tests/client/test_main_tab_scalars.py", line 37, in test_main_tab_scalars
[task 2023-04-22T06:21:07.676Z] 06:21:07     INFO -     self.assertEqual(scalars["browser.engagement.max_concurrent_tab_count"], 3)
[task 2023-04-22T06:21:07.676Z] 06:21:07     INFO - TEST-INFO took 21984ms

Retriggers and backfill range reveals that the first occurrence of this fail happened here
Barret, could this be related to the changes in Bug 1810739?
Thanks

Flags: needinfo?(brennie)
Whiteboard: [retriggered]
Assignee: nobody → brennie
Status: NEW → ASSIGNED
Flags: needinfo?(brennie)
Pushed by brennie@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/0b8c708afdfb
Fix intermittent in test_main_tab_scalars.py r=chutten

https://hg.mozilla.org/mozilla-central/rev/0b8c708afdfb

Status: ASSIGNED → RESOLVED
Closed: 1 year ago
status-firefox114: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 114 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: