Intermittent ftu_test.js | First Time Use > FTU user timing

NEW
Unassigned

Status

Firefox OS
Gaia::First Time Experience
2 years ago
9 months ago

People

(Reporter: KWierso, Unassigned)

Tracking

({intermittent-failure})

Firefox Tracking Flags

(Not tracked)

Details

(Whiteboard: [systemsfe])

Whiteboard: [systemsfe]
The intermittent failures that opened this bug were assertions indicating that the user timing instrumentation wasn't always working. But those appear to have stopped and recent failures look to be all "crashes" which are actually boot watcher timeouts indicated in the live_backing.log as 'Never saw webapps-registry-ready yes'. Do we have a bug tracking these I can dupe this to? Or better to resolve this one and open another.
See comment #1
Flags: needinfo?(mhenretty)
I'd say resolve this one as fixed, and open a new one related to the Never saw 'webapps-registry-ready yes' problem. Do you know if that error message gets propagated to the failure summary in treeherder? If not, we should make it do that so sheriffs can properly star these tests.
Flags: needinfo?(mhenretty)
Note, we are also seeing failures like the following. Should we track them in this bug?

TEST-UNEXPECTED-FAIL | apps/ftu/test/marionette/ftu_test.js | First Time Use > FTU comes up on profile generation
NoSuchElement: NoSuchElement: Unable to locate element: #windows iframe[src*="app://ftu.gaiamobile.org"]
Remote Stack:
<none>
    at Error.MarionetteError (node_modules/marionette-client/lib/marionette/error.js:105:13)
    at Object.Client._handleCallback (node_modules/marionette-client/lib/marionette/client.js:529:19)
    at Object.<anonymous> (node_modules/marionette-client/lib/marionette/client.js:573:23)
    at TcpSync.sendRaw (node_modules/marionette-client/lib/marionette/drivers/tcp-sync.js:226:10)
    at TcpSync.sendMessage (node_modules/marionette-client/lib/marionette/drivers/tcp-sync.js:209:15)
    at TcpSync.send (node_modules/marionette-client/lib/marionette/drivers/tcp-sync.js:190:17)
    at Object.send (node_modules/marionette-client/lib/marionette/client.js:492:34)
    at Object.Client._sendCommand (node_modules/marionette-client/lib/marionette/client.js:554:21)
    at Object._findElement (node_modules/marionette-client/lib/marionette/client.js:1488:19)
    at Object.findElement (node_modules/marionette-client/lib/marionette/client.js:1519:32)
    at waitForAppSync (node_modules/marionette-apps/lib/waitforapp.js:53:19)
    at waitForApp (node_modules/marionette-apps/lib/waitforapp.js:24:3)
    at node_modules/marionette-apps/lib/switchtoapp.js:29:12
    at node_modules/marionette-apps/lib/getapp.js:89:12
    at node_modules/marionette-apps/lib/getapp.js:133:12
    at Object.<anonymous> (node_modules/marionette-apps/lib/mgmt.js:59:14)
    at Object.Client._handleCallback (node_modules/marionette-client/lib/marionette/client.js:537:23)
    at Object.<anonymous> (node_modules/marionette-client/lib/marionette/client.js:573:23)
    at TcpSync.sendRaw (node_modules/marionette-client/lib/marionette/drivers/tcp-sync.js:226:10)
    at TcpSync.sendMessage (node_modules/marionette-client/lib/marionette/drivers/tcp-sync.js:209:15)
    at TcpSync.send (node_modules/marionette-client/lib/marionette/drivers/tcp-sync.js:190:17)
    at Object.send (node_modules/marionette-client/lib/marionette/client.js:492:34)
    at Object.Client._sendCommand (node_modules/marionette-client/lib/marionette/client.js:554:21)
    at Object._executeScript (node_modules/marionette-client/lib/marionette/client.js:1627:19)
    at Object.Client.executeAsyncScript (node_modules/marionette-client/lib/marionette/client.js:1414:19)
    at Object.Mgmt.getAll (node_modules/marionette-apps/lib/mgmt.js:46:19)
    at list (node_modules/marionette-apps/lib/list.js:15:20)
    at getAppWithCheckOnOriginOnly (node_modules/marionette-apps/lib/getapp.js:113:10)
    at getApp (node_modules/marionette-apps/lib/getapp.js:63:10)
    at switchToApp (node_modules/marionette-apps/lib/switchtoapp.js:24:10)
    at Context.<anonymous> (apps/ftu/test/marionette/ftu_test.js:15:17)
    at Test.MarionetteTest.run (node_modules/marionette-js-runner/lib/ui.js:25:31)
    at node_modules/marionette-js-runner/node_modules/promise/lib/core.js:33:15
    at flush (node_modules/marionette-js-runner/node_modules/promise/node_modules/asap/asap.js:27:13)

https://treeherder.mozilla.org/logviewer.html#?job_id=753666&repo=gaia-master
Flags: needinfo?(sfoster)
(In reply to Michael Henretty [:mhenretty] from comment #4)
> Note, we are also seeing failures like the following. Should we track them
> in this bug?

Yeah we can track this here - this bug can be considered fixed when the suite in ftu_test.js passes reliably.
Flags: needinfo?(sfoster)

Comment 6

9 months ago
Closing all intermittent test failures for Firefox OS (since we're not focusing on it anymore).

Please reopen if my search included your bug by mistake.
You need to log in before you can comment on or make changes to this bug.