828037 - Create manifest of panda-stable UI tests

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia, defect)

Description

[Jonathan Griffin (:jgriffin)]

We need a manifest of Gaia UI tests that can be run consistently on the pandas, for use by buildbot.

Comment 1

[Dave Hunt [:davehunt] [he/him] ⌚BST]

This should be the main manifest file but using the manifest attributes to narrow it down, something like: --type=b2g-carrier-camera-wifi-xfail

Comment 2

[Jonathan Griffin (:jgriffin)]

I agree.  We can add an additional 'panda' attribute to handle cases that are flakey on the panda (and thus ones we don't want to run there) which don't fall into any of the other buckets.  I'll post a mozharness patch for this.

Comment 3

[Jonathan Griffin (:jgriffin)]

Attachment: Add --test-type arg to gaia test script,

I can't test this locally, but since we're only running on cedar right now, it shouldn't be much of a problem.

Comment 4

[Jonathan Griffin (:jgriffin)]

Attachment: Add --test-type arg to gaia test script,

Fixed a mistake.

Comment 5

[Armen [:armenzg]]

Comment on attachment 701313 [details] [diff] [review]
Add --test-type arg to gaia test script,

Feel free to land.

Comment 6

[Jonathan Griffin (:jgriffin)]

http://hg.mozilla.org/build/mozharness/rev/5258cd9f43b2

Comment 7

[Armen [:armenzg]]

I'm seeing now all of the tests failing with this:
TimeoutException: socket.timeout
error: [Errno 113] No route to host

https://tbpl.mozilla.org/php/getParsedLog.php?id=18785788&tree=Cedar&full=1
https://tbpl.mozilla.org/php/getParsedLog.php?id=18783222&tree=Cedar&full=1

Comment 8

[Armen [:armenzg]]

Not related to this bug.
I will file a separate bug.

It happened between
https://tbpl.mozilla.org/?tree=Cedar&jobname=b2g_panda&rev=bacf122225e9
https://tbpl.mozilla.org/?tree=Cedar&jobname=b2g_panda&rev=ae1822e4f9c4