1114646 - [Raptor] Reboot test times out

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::PerformanceTest, defect)

Description

[:Eli Perelman]

When attempting to run the Reboot test, the device correctly reboots, but upon finishing the test does not complete and times out.

---

DEBUG=* node tests/raptor/boot_test.js

[Test] Starting run 1
  raptor:device [Logging] Clearing Log +0ms
  raptor:command [Executing Command] adb logcat -c +1ms
  raptor:device [Rebooting] +35ms
  raptor:command [Executing Command] DEVICETIME=$(adb shell echo '$EPOCHREALTIME') && adb reboot && adb wait-for-device && echo $DEVICETIME +0ms
  raptor:device [Logging] +17s Performance Entry: mark|deviceReboot@System|0|0|1419267938220.085
  raptor:command [Executing Command] adb shell 'log -p i -t GeckoConsole "Performance Entry: mark|deviceReboot@System|0|0|1419267938220.085"' +0ms
  raptor:device [Logging] Clearing Log +2ms
  raptor:command [Executing Command] adb logcat -c +0ms
  raptor:reboot Received performance entry `loadEnd` for GeckoConsole +11s
  raptor:reboot Received performance entry `homescreenStart` for System +12s
  raptor:reboot Received performance entry `navigationLoaded` for Homescreen +14ms
  raptor:reboot Received performance entry `navigationInteractive` for Homescreen +0ms
  raptor:reboot Received performance entry `osLogoEnd` for GeckoConsole +960ms
  raptor:reboot Received performance entry `visuallyLoaded` for Homescreen +680ms
  raptor:reboot Received performance entry `contentInteractive` for Homescreen +5ms
  raptor:reboot Received performance entry `fullyLoaded` for Homescreen +848ms
[Test] Run 1 timed out, retry attempt 1

Comment 1

[:Eli Perelman]

Looks like with a recent change to manifest names, we no longer get a smart map from GeckoConsole to System.

Comment 2

[:Eli Perelman]

Attachment: Link to Github pull-request: https://github.com/mozilla-b2g/raptor/pull/4

Comment 3

[Robert Wood [:rwood]]

Comment on attachment 8540216 [details] [review]
Link to Github pull-request: https://github.com/mozilla-b2g/raptor/pull/4

Fixes a single run, however the test times out if RUNS>1 (in a different place, just after [Test] Run 1 complete).

Comment 4

[:Eli Perelman]

Comment on attachment 8540216 [details] [review]
Link to Github pull-request: https://github.com/mozilla-b2g/raptor/pull/4

Looks like the test was also suffering from a race condition between creating the `deviceReboot` and clearing the log. Give this one a go.

Comment 5

[Robert Wood [:rwood]]

Comment on attachment 8540216 [details] [review]
Link to Github pull-request: https://github.com/mozilla-b2g/raptor/pull/4

Latest PR works great with single or multiple test runs.

Comment 6

[:Eli Perelman]

Attachment: Link to Github pull-request: https://github.com/mozilla-b2g/gaia-node-modules/pull/82

Bumping gaia-raptor module, already r+'d by :rwood.

Comment 7

[:Eli Perelman]

gaia-raptor, master: https://github.com/mozilla-b2g/raptor/commit/f461a50fc09cfd2c1bacee31e2d2178b1ddb85c5
gaia-node-modules master: https://github.com/mozilla-b2g/gaia-node-modules/commit/580c7090140eca853def29bf96b1067fe6a6dddc