Closed Bug 1629602 Opened 1 year ago Closed 1 year ago

Include reason for failure when describing features

Categories

(Core :: Graphics, enhancement)

Product:
Core
Component:
Graphics
Type:
enhancement

Tracking

()

Status:
RESOLVED FIXED
Milestone:
mozilla77
Tracking Flags:
Tracking Status
firefox77 --- fixed

People

(Reporter: jrmuizel, Assigned: jrmuizel, NeedInfo)

Details

Attachments

(1 file)

Bug 1629602 - Include reason for failure when describing features.
47 bytes, text/x-phabricator-request
Details | Review
No description provided.

This should give us more information in telemetry.

Assignee: nobody → jmuizelaar
Status: NEW → ASSIGNED
Pushed by jmuizelaar@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/502e83464c91
Include reason for failure when describing features. r=aosmond
Pushed by jmuizelaar@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/34c45b73c707
Include reason for failure when describing features. r=aosmond
Pushed by jmuizelaar@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/575503d55ccd
Include reason for failure when describing features. r=aosmond

Backed out changeset 575503d55ccd (bug 1629602) for gfx/tests/marionette/test_pref_rollout_workaround.py failures

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=windows%2C10%2Cx64%2Cdebug%2Ctest-windows10-64%2Fdebug-marionette-gpu-e10s%2C%28mng%29&fromchange=da9005a3fda006a710231c83fd2bd4174a7b80f2&tochange=b85fc2ae7ec3ab6a82a14f966233c1d2fb17534e&selectedJob=297562031

Backout link: https://hg.mozilla.org/integration/autoland/rev/b85fc2ae7ec3ab6a82a14f966233c1d2fb17534e

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=297562031&repo=autoland&lineNumber=1188

...
[task 2020-04-14T16:50:16.038Z] 16:50:16     INFO -  DEBUG: Adding blocker ScriptPreloader: Saving bytecode cache for phase xpcom-will-shutdown
[task 2020-04-14T16:50:16.038Z] 16:50:16     INFO -  1586883016034	Marionette	DEBUG	3 -> [0,5,"Marionette:GetContext",{}]
[task 2020-04-14T16:50:16.038Z] 16:50:16     INFO -  1586883016036	Marionette	DEBUG	3 <- [1,5,null,{"value":"chrome"}]
[task 2020-04-14T16:50:16.043Z] 16:50:16     INFO -  1586883016041	Marionette	DEBUG	3 -> [0,6,"Marionette:SetContext",{"value":"chrome"}]
[task 2020-04-14T16:50:16.045Z] 16:50:16     INFO -  1586883016042	Marionette	DEBUG	3 <- [1,6,null,{"value":null}]
[task 2020-04-14T16:50:16.050Z] 16:50:16     INFO -  1586883016047	Marionette	DEBUG	3 -> [0,7,"WebDriver:TakeScreenshot",{"full":true,"hash":false,"id":null,"scroll":true}]
[task 2020-04-14T16:50:16.161Z] 16:50:16     INFO -  1586883016157	Marionette	DEBUG	3 <- [1,7,null,{"value":"iVBORw0KGgoAAAANSUhEUgAABQAAAAQHCAYAAACjlsT7AAAgAElEQVR4nOzdXYydd30n8Lnei72j9Kqly13dlbhG3e1ygYToKpGcgFTJj ... AAAAAwJgABAAAAYEwAAgAAAMCYAAQAAACAMQEIAAAAAGMCEAAAAADGBCAAAAAAjAlAAAAAABgTgAAAAAAwJgABAAAAYCwoNzrsgnmQ8wAAAABJRU5ErkJggg=="}]
[task 2020-04-14T16:50:16.171Z] 16:50:16     INFO -  1586883016166	Marionette	DEBUG	3 -> [0,8,"Marionette:SetContext",{"value":"chrome"}]
[task 2020-04-14T16:50:16.171Z] 16:50:16     INFO -  1586883016167	Marionette	DEBUG	3 <- [1,8,null,{"value":null}]
[task 2020-04-14T16:50:16.176Z] 16:50:16     INFO -  1586883016171	Marionette	DEBUG	3 -> [0,9,"Marionette:GetContext",{}]
[task 2020-04-14T16:50:16.176Z] 16:50:16     INFO -  1586883016172	Marionette	DEBUG	3 <- [1,9,null,{"value":"chrome"}]
[task 2020-04-14T16:50:16.176Z] 16:50:16     INFO -  1586883016175	Marionette	DEBUG	3 -> [0,10,"Marionette:SetContext",{"value":"content"}]
[task 2020-04-14T16:50:16.181Z] 16:50:16     INFO -  1586883016176	Marionette	DEBUG	3 <- [1,10,null,{"value":null}]
[task 2020-04-14T16:50:16.186Z] 16:50:16     INFO -  1586883016180	Marionette	DEBUG	3 -> [0,11,"WebDriver:GetPageSource",{}]
[task 2020-04-14T16:50:16.196Z] 16:50:16     INFO -  1586883016189	Marionette	DEBUG	3 <- [1,11,null,{"value":"<html><head></head><body></body></html>"}]
[task 2020-04-14T16:50:16.196Z] 16:50:16     INFO -  1586883016192	Marionette	DEBUG	3 -> [0,12,"Marionette:SetContext",{"value":"chrome"}]
[task 2020-04-14T16:50:16.196Z] 16:50:16     INFO -  1586883016193	Marionette	DEBUG	3 <- [1,12,null,{"value":null}]
[task 2020-04-14T16:50:16.198Z] 16:50:16    ERROR -  TEST-UNEXPECTED-FAIL | gfx/tests/marionette/test_pref_rollout_workaround.py WrPrefRolloutWorkAroundTestCase.test_wr_rollout_workaround_on_non_qualifying_hw | AssertionError: Should start out as WR opt-in
[task 2020-04-14T16:50:16.198Z] 16:50:16     INFO -  Traceback (most recent call last):
[task 2020-04-14T16:50:16.198Z] 16:50:16     INFO -    File "Z:\task_1586882374\build\venv\lib\site-packages\marionette_harness\marionette_test\testcases.py", line 159, in run
[task 2020-04-14T16:50:16.198Z] 16:50:16     INFO -      testMethod()
[task 2020-04-14T16:50:16.199Z] 16:50:16     INFO -    File "Z:\task_1586882374\build\tests\marionette\tests\gfx\tests\marionette\test_pref_rollout_workaround.py", line 44, in test_wr_rollout_workaround_on_non_qualifying_hw
[task 2020-04-14T16:50:16.199Z] 16:50:16     INFO -      self.assertEqual(status, 'opt-in', 'Should start out as WR opt-in')
[task 2020-04-14T16:50:16.199Z] 16:50:16     INFO -  TEST-INFO took 8555ms
...
...
[task 2020-04-14T16:50:22.505Z] 16:50:22     INFO -  [Child 6788, Main Thread] WARNING: '!aWin', file /builds/worker/checkouts/gecko/dom/base/Document.cpp, line 1395
[task 2020-04-14T16:50:22.766Z] 16:50:22     INFO -  DEBUG: Adding blocker JSON store: writing data for phase AddonManager: Waiting for providers to shut down.
[task 2020-04-14T16:50:22.857Z] 16:50:22     INFO -  DEBUG: Adding blocker Search service: shutting down for phase OS.File: Waiting for clients before profileBeforeChange
[task 2020-04-14T16:50:23.170Z] 16:50:23     INFO -  [Parent 4752, IPDL Background] WARNING: NextRequestSerialNumber doesn't match!: 'aLoggingInfo.nextRequestSerialNumber() == loggingInfo->mLoggingInfo.nextRequestSerialNumber()', file /builds/worker/checkouts/gecko/dom/indexedDB/ActorsParent.cpp, line 13493
[task 2020-04-14T16:50:23.210Z] 16:50:23     INFO -  DEBUG: Adding blocker JSON store: writing data for phase profile-before-change
[task 2020-04-14T16:50:23.260Z] 16:50:23     INFO -  DEBUG: Adding blocker JSON store: writing data for phase profile-before-change
[task 2020-04-14T16:50:23.399Z] 16:50:23     INFO -  1586883023390	Marionette	TRACE	Received observer notification marionette-startup-requested
[task 2020-04-14T16:50:23.399Z] 16:50:23     INFO -  1586883023391	Marionette	TRACE	Waiting until startup recorder finished recording startup scripts...
[task 2020-04-14T16:50:23.680Z] 16:50:23     INFO -  1586883023673	Marionette	TRACE	All scripts recorded.
[task 2020-04-14T16:50:23.726Z] 16:50:23     INFO -  1586883023724	Marionette	INFO	Listening on port 2828
[task 2020-04-14T16:50:23.726Z] 16:50:23     INFO -  1586883023725	Marionette	DEBUG	Marionette is listening
[task 2020-04-14T16:50:23.846Z] 16:50:23     INFO -  1586883023842	Marionette	DEBUG	Accepted connection 0 from 127.0.0.1:50093
[task 2020-04-14T16:50:23.945Z] 16:50:23     INFO -  1586883023940	Marionette	DEBUG	Accepted connection 1 from 127.0.0.1:50094
[task 2020-04-14T16:50:23.947Z] 16:50:23     INFO -  1586883023945	Marionette	DEBUG	Closed connection 1
[task 2020-04-14T16:50:23.949Z] 16:50:23     INFO -  1586883023946	Marionette	DEBUG	Closed connection 0
[task 2020-04-14T16:50:23.954Z] 16:50:23     INFO -  1586883023949	Marionette	DEBUG	Accepted connection 2 from 127.0.0.1:50096
[task 2020-04-14T16:50:23.959Z] 16:50:23     INFO -  1586883023954	Marionette	DEBUG	2 -> [0,1,"WebDriver:NewSession",{"strictFileInteractability":true}]
[task 2020-04-14T16:50:24.039Z] 16:50:24     INFO -  1586883024029	Marionette	TRACE	[4] Frame script loaded
[task 2020-04-14T16:50:24.040Z] 16:50:24     INFO -  1586883024033	Marionette	TRACE	[4] Frame script registered
[task 2020-04-14T16:50:24.042Z] 16:50:24     INFO -  1586883024041	Marionette	DEBUG	2 <- [1,1,null,{"sessionId":"ec061d9b-89e6-46f2-8c87-c2f9d4f45408","capabilities":{"browserName":"firefox","browserVersion":"77.0a ... p\\tmpqwe5hx.mozrunner","moz:shutdownTimeout":60000,"moz:useNonSpecCompliantPointerOrigin":false,"moz:webdriverClick":true}}]
[task 2020-04-14T16:50:24.047Z] 16:50:24     INFO -  1586883024045	Marionette	DEBUG	2 -> [0,2,"Marionette:SetContext",{"value":"content"}]
[task 2020-04-14T16:50:24.049Z] 16:50:24     INFO -  1586883024047	Marionette	DEBUG	2 <- [1,2,null,{"value":null}]
[task 2020-04-14T16:50:24.054Z] 16:50:24     INFO -  1586883024051	Marionette	DEBUG	2 -> [0,3,"Marionette:SetContext",{"value":"chrome"}]
[task 2020-04-14T16:50:24.054Z] 16:50:24     INFO -  1586883024052	Marionette	DEBUG	2 <- [1,3,null,{"value":null}]
[task 2020-04-14T16:50:24.064Z] 16:50:24     INFO -  1586883024060	Marionette	DEBUG	2 -> [0,4,"WebDriver:ExecuteScript",{"script":"try {\n                const gfxInfo = Components.classes['@mozilla.org/gfx/info;1' ... 4\\build\\tests\\marionette\\tests\\gfx\\tests\\marionette\\test_pref_rollout_workaround.py","sandbox":"default","line":114}]
[task 2020-04-14T16:50:24.094Z] 16:50:24     INFO -  1586883024093	Marionette	DEBUG	2 <- [1,4,null,{"value":{"features":{"compositor":"d3d11","gpuProcess":{"status":"available"},"wrQualified":{"status":"available"} ... bGPU","status":"disabled","log":[{"type":"default","status":"disabled","message":"Disabled by default"}]}],"fallbacks":[]}}}]
[task 2020-04-14T16:50:24.096Z] 16:50:24     INFO -  self.wr_status()=opt-in:FEATURE_FAILURE_DEFAULT_OFF,d3d11
[task 2020-04-14T16:50:24.106Z] 16:50:24     INFO -  1586883024099	Marionette	DEBUG	2 -> [0,5,"Marionette:GetContext",{}]
[task 2020-04-14T16:50:24.106Z] 16:50:24     INFO -  1586883024100	Marionette	DEBUG	2 <- [1,5,null,{"value":"chrome"}]
[task 2020-04-14T16:50:24.106Z] 16:50:24     INFO -  1586883024103	Marionette	DEBUG	2 -> [0,6,"Marionette:SetContext",{"value":"chrome"}]
[task 2020-04-14T16:50:24.106Z] 16:50:24     INFO -  1586883024105	Marionette	DEBUG	2 <- [1,6,null,{"value":null}]
[task 2020-04-14T16:50:24.116Z] 16:50:24     INFO -  1586883024110	Marionette	DEBUG	2 -> [0,7,"WebDriver:TakeScreenshot",{"full":true,"hash":false,"id":null,"scroll":true}]
[task 2020-04-14T16:50:24.216Z] 16:50:24     INFO -  1586883024208	Marionette	DEBUG	2 <- [1,7,null,{"value":"iVBORw0KGgoAAAANSUhEUgAABQAAAAQHCAYAAACjlsT7AAAgAElEQVR4nOzdXYydd30n8Lnei72j9Kqly13dlbhG3e1ygYToKpGcgFTJj ... AAAAAwJgABAAAAYEwAAgAAAMCYAAQAAACAMQEIAAAAAGMCEAAAAADGBCAAAAAAjAlAAAAAABgTgAAAAAAwJgABAAAAYCwoNzrsgnmQ8wAAAABJRU5ErkJggg=="}]
[task 2020-04-14T16:50:24.221Z] 16:50:24     INFO -  1586883024216	Marionette	DEBUG	2 -> [0,8,"Marionette:SetContext",{"value":"chrome"}]
[task 2020-04-14T16:50:24.221Z] 16:50:24     INFO -  1586883024218	Marionette	DEBUG	2 <- [1,8,null,{"value":null}]
[task 2020-04-14T16:50:24.227Z] 16:50:24     INFO -  1586883024222	Marionette	DEBUG	2 -> [0,9,"Marionette:GetContext",{}]
[task 2020-04-14T16:50:24.227Z] 16:50:24     INFO -  1586883024223	Marionette	DEBUG	2 <- [1,9,null,{"value":"chrome"}]
[task 2020-04-14T16:50:24.547Z] 16:50:24     INFO -  1586883024538	Marionette	DEBUG	2 -> [0,10,"Marionette:SetContext",{"value":"content"}]
[task 2020-04-14T16:50:24.547Z] 16:50:24     INFO -  1586883024539	Marionette	DEBUG	2 <- [1,10,null,{"value":null}]
[task 2020-04-14T16:50:24.557Z] 16:50:24     INFO -  1586883024552	Marionette	DEBUG	2 -> [0,11,"WebDriver:GetPageSource",{}]
[task 2020-04-14T16:50:24.567Z] 16:50:24     INFO -  1586883024562	Marionette	DEBUG	2 <- [1,11,null,{"value":"<html><head></head><body></body></html>"}]
[task 2020-04-14T16:50:24.567Z] 16:50:24     INFO -  1586883024565	Marionette	DEBUG	2 -> [0,12,"Marionette:SetContext",{"value":"chrome"}]
[task 2020-04-14T16:50:24.567Z] 16:50:24     INFO -  1586883024567	Marionette	DEBUG	2 <- [1,12,null,{"value":null}]
[task 2020-04-14T16:50:24.572Z] 16:50:24    ERROR -  TEST-UNEXPECTED-FAIL | gfx/tests/marionette/test_pref_rollout_workaround.py WrPrefRolloutWorkAroundTestCase.test_wr_rollout_workaround_on_qualifying_hw | AssertionError: Should start out as WR opt-in
[task 2020-04-14T16:50:24.573Z] 16:50:24     INFO -  Traceback (most recent call last):
[task 2020-04-14T16:50:24.573Z] 16:50:24     INFO -    File "Z:\task_1586882374\build\venv\lib\site-packages\marionette_harness\marionette_test\testcases.py", line 159, in run
[task 2020-04-14T16:50:24.573Z] 16:50:24     INFO -      testMethod()
[task 2020-04-14T16:50:24.573Z] 16:50:24     INFO -    File "Z:\task_1586882374\build\tests\marionette\tests\gfx\tests\marionette\test_pref_rollout_workaround.py", line 83, in test_wr_rollout_workaround_on_qualifying_hw
[task 2020-04-14T16:50:24.573Z] 16:50:24     INFO -      self.assertEqual(status, 'opt-in', 'Should start out as WR opt-in')
[task 2020-04-14T16:50:24.574Z] 16:50:24     INFO -  TEST-INFO took 8365ms
[task 2020-04-14T16:50:24.574Z] 16:50:24     INFO -  1586883024572	Marionette	DEBUG	2 -> [0,13,"WebDriver:DeleteSession",{}]
[task 2020-04-14T16:50:24.579Z] 16:50:24     INFO -  1586883024575	Marionette	DEBUG	2 <- [1,13,null,{"value":null}]
[task 2020-04-14T16:50:24.579Z] 16:50:24     INFO -  SUMMARY
[task 2020-04-14T16:50:24.580Z] 16:50:24     INFO -  -------
[task 2020-04-14T16:50:24.580Z] 16:50:24     INFO -  passed: 0
[task 2020-04-14T16:50:24.580Z] 16:50:24     INFO -  failed: 2
[task 2020-04-14T16:50:24.580Z] 16:50:24     INFO -  todo: 0
[task 2020-04-14T16:50:24.581Z] 16:50:24     INFO -  FAILED TESTS
[task 2020-04-14T16:50:24.581Z] 16:50:24     INFO -  -------
[task 2020-04-14T16:50:24.581Z] 16:50:24     INFO -  test_pref_rollout_workaround.py test_pref_rollout_workaround.WrPrefRolloutWorkAroundTestCase.test_wr_rollout_workaround_on_non_qualifying_hw
[task 2020-04-14T16:50:24.581Z] 16:50:24     INFO -  test_pref_rollout_workaround.py test_pref_rollout_workaround.WrPrefRolloutWorkAroundTestCase.test_wr_rollout_workaround_on_qualifying_hw
[task 2020-04-14T16:50:24.582Z] 16:50:24     INFO -  1586883024579	Marionette	DEBUG	Closed connection 2
[task 2020-04-14T16:50:24.592Z] 16:50:24     INFO -  SUITE-END | took 16s

Pushed by jmuizelaar@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/c54901331fd9
Include reason for failure when describing features. r=aosmond

https://hg.mozilla.org/mozilla-central/rev/c54901331fd9

Status: ASSIGNED → RESOLVED
Closed: 1 year ago
status-firefox77: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla77
You need to log in before you can comment on or make changes to this bug.