963695 - "search" app cause error in |make test-perf|

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::Search, defect, P1)

Description

[Hubert Figuiere [:hub]]

If I run |make test-perf| I get an error on "search"

  "failures": [
    {
      "title": "startup time",
      "fullTitle": "startup test > search > startup time",
      "stack": "{ name: 'NoSuchElement',\n  stack: 'NoSuchElement: (7) Unable to locate element: iframe[src*=\"app://search.gaiamobile.org\"]\\nRemote Stack:\\n<none>\\n    at Error.MarionetteE
rror (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-client/lib/marionette/error.js:67:13)\\n    at Object.Client._handleCallback (/home/hub/source/mozilla/B2G-inari/gaia/node_
modules/marionette-client/lib/marionette/client.js:474:19)\\n    at /home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-client/lib/marionette/client.js:508:21\\n    at TcpSync.send 
(/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-client/lib/marionette/drivers/tcp-sync.js:94:10)\\n    at Object.send (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/mari
onette-client/lib/marionette/client.js:455:36)\\n    at Object.Client._sendCommand (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-client/lib/marionette/client.js:501:19)\\n   
 at Object._findElement (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-client/lib/marionette/client.js:1283:19)\\n    at Object.findElement (/home/hub/source/mozilla/B2G-inari
/gaia/node_modules/marionette-client/lib/marionette/client.js:1332:32)\\n    at waitForAppSync (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-apps/lib/waitforapp.js:40:19)\\n 
   at waitForApp (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-apps/lib/waitforapp.js:23:5)\\n    at /home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-apps/lib/
launch.js:49:12\\n    at /home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-apps/lib/getapp.js:83:12\\n    at Object.<anonymous> (/home/hub/source/mozilla/B2G-inari/gaia/node_modul
es/marionette-apps/lib/mgmt.js:58:14)\\n    at Object.Client._handleCallback (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-client/lib/marionette/client.js:482:23)\\n    at /h
ome/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-client/lib/marionette/client.js:508:21\\n    at TcpSync.send (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-clien
t/lib/marionette/drivers/tcp-sync.js:94:10)\\n    at Object.send (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-client/lib/marionette/client.js:455:36)\\n    at Object.Client.
_sendCommand (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-client/lib/marionette/client.js:501:19)\\n    at Object._executeScript (/home/hub/source/mozilla/B2G-inari/gaia/nod
e_modules/marionette-client/lib/marionette/client.js:1448:19)\\n    at Object.executeAsyncScript (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-client/lib/marionette/client.js
:1229:19)\\n    at Object.Mgmt.getAll (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-apps/lib/mgmt.js:37:19)\\n    at list (/home/hub/source/mozilla/B2G-inari/gaia/node_module
s/marionette-apps/lib/list.js:14:20)\\n    at getApp (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-apps/lib/getapp.js:45:10)\\n    at launch (/home/hub/source/mozilla/B2G-ina
ri/gaia/node_modules/marionette-apps/lib/launch.js:40:10)\\n    at Object.PerfTestApp.launch (/home/hub/source/mozilla/B2G-inari/gaia/tests/performance/app.js:47:22)\\n    at /home/hub/source/m
ozilla/B2G-inari/gaia/tests/performance/startup_test.js:47:11\\n    at Object.PerformanceHelper.task (/home/hub/source/mozilla/B2G-inari/gaia/tests/performance/performance_helper.js:163:7)\\n  
  at /home/hub/source/mozilla/B2G-inari/gaia/tests/performance/performance_helper.js:149:16\\n    at Object.Client.waitForSync (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-c
lient/lib/marionette/client.js:666:18)\\n    at Object.Client.waitFor (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-client/lib/marionette/client.js:648:60)\\n    at Object.He
lper.delay (/home/hub/source/mozilla/B2G-inari/gaia/tests/js-marionette/helper.js:14:12)\\n    at Object.PerformanceHelper.delay (/home/hub/source/mozilla/B2G-inari/gaia/tests/performance/perfo
rmance_helper.js:171:24)\\n    at trigger (/home/hub/source/mozilla/B2G-inari/gaia/tests/performance/performance_helper.js:148:14)\\n    at Object.PerformanceHelper.repeatWithDelay (/home/hub/s
ource/mozilla/B2G-inari/gaia/tests/performance/performance_helper.js:153:7)\\n    at Context.<anonymous> (/home/hub/source/mozilla/B2G-inari/gaia/tests/performance/startup_test.js:46:23)\\n    
at Test.Runnable.run (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/mocha/lib/runnable.js:211:32)\\n    at Runner.runTest (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/mocha/lib/
runner.js:372:10)\\n    at /home/hub/source/mozilla/B2G-inari/gaia/node_modules/mocha/lib/runner.js:448:12\\n    at next (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/mocha/lib/runner.j
s:297:14)\\n    at /home/hub/source/mozilla/B2G-inari/gaia/node_modules/mocha/lib/runner.js:307:7\\n    at next (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/mocha/lib/runner.js:245:23)
\\n    at /home/hub/source/mozilla/B2G-inari/gaia/node_modules/mocha/lib/runner.js:269:7\\n    at Hook.Runnable.run (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/mocha/lib/runnable.js:2
13:5)\\n    at next (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/mocha/lib/runner.js:257:10)\\n    at /home/hub/source/mozilla/B2G-inari/gaia/node_modules/mocha/lib/runner.js:269:7\\n 
   at done (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/mocha/lib/runnable.js:185:5)\\n    at /home/hub/source/mozilla/B2G-inari/gaia/node_modules/mocha/lib/runnable.js:197:9\\n    at 
Object.executeHook (/home/hub/source/mozilla/B2G-inari/gaia/node_modules/marionette-client/lib/marionette/client.js:370:18)\\n    at process._tickCallback (node.js:415:13)',\n  type: 'NoSuchEle
ment',\n  constructorName: 'Error',\n  expected: null,\n  actual: null }",
      "index": 0,
      "msg": "",
      "actual": null,
      "expected": null
    }

Comment 1

[Hubert Figuiere [:hub]]

Blacklisting will be the solution. we'll provide more specific test in the longer term.

Comment 2

[Hubert Figuiere [:hub]]

Attachment: Pull request

Comment 3

[Kevin Grandon :kgrandon]

Comment on attachment 8365287 [details] [review]
Pull request

Thanks!

Comment 4

[Hubert Figuiere [:hub]]

https://github.com/mozilla-b2g/gaia/commit/eb5725076973b80d0e7dbabfb48673d88ff09025