As for getting raptor-browsertime (with visual metrics) running on fennec (v68) in production, here's a try push: https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=4c563d3372177a1a049c4cf06f42faf4f7d1bfe4 Locally (with ^ patch applied) I can run raptor-browsertime on fennec v68 with: `./mach raptor --test amazon --app fennec --binary org.mozilla.fennec_aurora --activity org.mozilla.gecko.BrowserApp --browser-cycles 2 --browsertime --cold` It does run successfully and grabs the page-load measurements (using the mitm recordings) however it looks like it isn't able to get 'timeToConentfulPaint' on fennec v68: `20:22:52 INFO - results.MissingResultsError: Browsertime cycle missing timeToContentfulPaint measurement` And also there's a webdriver error when trying to shutdown fennec: `20:18:51 INFO - [2020-01-06 15:18:51] DEBUG: [browsertime] Telling browser to quit.` `20:18:51 INFO - 1578341931322 webdriver::server DEBUG -> DELETE /session/33182f50-f282-4ec0-adb4-818852dfbd44` `20:18:51 INFO - 1578341931325 webdriver::server DEBUG <- 500 Internal Server Error {"value":{"error":"unsupported operation","message":"Only supported in Firefox","stacktrace":"WebDriverError@chrome://marionette/content/error.js:175:5\nUnsupportedOperationError@chrome://marionette/content/error.js:493:5\nassert.that/<@chrome://marionette/content/assert.js:428:13\nassert.firefox@chrome://marionette/content/assert.js:97:57\nGeckoDriver.prototype.quit@chrome://marionette/content/driver.js:3459:10\ndespatch@chrome://marionette/content/server.js:305:40\nexecute@chrome://marionette/content/server.js:275:16\nonPacket/<@chrome://marionette/content/server.js:248:20\nonPacket@chrome://marionette/content/server.js:249:9\n_onJSONObjectReady/<@chrome://marionette/content/transport.js:503:20\n"}}`
Bug 1604527 Comment 31 Edit History
Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.
As for getting raptor-browsertime (with visual metrics) running on fennec (v68) in production, here's a try push: https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=4c563d3372177a1a049c4cf06f42faf4f7d1bfe4 Locally (with ^ patch applied) I can run raptor-browsertime on fennec v68 with: `./mach raptor --test amazon --app fennec --binary org.mozilla.fennec_aurora --activity org.mozilla.gecko.BrowserApp --browser-cycles 2 --browsertime --cold` It does run successfully and grabs the page-load measurements (using the mitm recordings) however it looks like it isn't able to get 'timeToContentfulPaint' on fennec v68: `20:22:52 INFO - results.MissingResultsError: Browsertime cycle missing timeToContentfulPaint measurement` And also there's a webdriver error when trying to shutdown fennec: `20:18:51 INFO - [2020-01-06 15:18:51] DEBUG: [browsertime] Telling browser to quit.` `20:18:51 INFO - 1578341931322 webdriver::server DEBUG -> DELETE /session/33182f50-f282-4ec0-adb4-818852dfbd44` `20:18:51 INFO - 1578341931325 webdriver::server DEBUG <- 500 Internal Server Error {"value":{"error":"unsupported operation","message":"Only supported in Firefox","stacktrace":"WebDriverError@chrome://marionette/content/error.js:175:5\nUnsupportedOperationError@chrome://marionette/content/error.js:493:5\nassert.that/<@chrome://marionette/content/assert.js:428:13\nassert.firefox@chrome://marionette/content/assert.js:97:57\nGeckoDriver.prototype.quit@chrome://marionette/content/driver.js:3459:10\ndespatch@chrome://marionette/content/server.js:305:40\nexecute@chrome://marionette/content/server.js:275:16\nonPacket/<@chrome://marionette/content/server.js:248:20\nonPacket@chrome://marionette/content/server.js:249:9\n_onJSONObjectReady/<@chrome://marionette/content/transport.js:503:20\n"}}`