1368051 - add awsy, autophone rca2 and autophone geckoview tests to trychooser

Status: RESOLVED FIXED

(Release Engineering :: General, enhancement)

Description

[Ben Kelly [:bkelly, not reviewing]]

We now have awsy running in automation, but it doesn't seem trychooser supports it yet.

It would also be nice if "all" try builds included it, but I don't know what the resource requirements are.  Maybe its like talos?

Comment 1

[William Lachance (:wlach)]

:jmaher, could you redirect this to someone who would be able to fix this?

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

:bkelly, Which try syntax was used?  Please note, we only run AWSY on linux and windows as those are VM's and we are not limited to hardware.  We have considered making this scheduled via -t since it is more of a performance/measurement test, but that can be confusing.


:bc, is this something you could take on?  I know we an get AWSY to run, but there are probably small nits to resolve.

Comment 3

[Ben Kelly [:bkelly, not reviewing]]

Oh, it does run for "all" try builds.  Sorry, I was confused.

Comment 4

[William Lachance (:wlach)]

IMO at the least "awsy" should be an individually selectable option, rather than requiring the user to specify "-u all" (for all I know it already is, in which case all we need to do is update the trychooser UI to reflect that)

Comment 5

[Bob Clary [:bc] (inactive)]

We need support in https://mozilla-releng.net/trychooser/ and in mach try? I can take a look. Might be a day or two before I get to it.

Comment 6

[William Lachance (:wlach)]

FYI according to erahm this syntax might already work:

"Yeah, not in trychooser yet but I think -u 'awsy-e10s' or 'sy-e10s' works."
https://twitter.com/eroc/status/868169500461367296

In which case this is just about making a small modification to the trychooser web ui.

Comment 7

[Bob Clary [:bc] (inactive)]

Attachment: PR 361

Comment 8

[Bob Clary [:bc] (inactive)]

The pull request failed the checks due to "The AWS Access Key Id you provided does not exist in our records." errors.

Comment 9

[Joel Maher ( :jmaher ) (UTC -8)]

odd; iirc github was having some issues earlier today, maybe it is still problematic

Comment 10

[Bob Clary [:bc] (inactive)]

Comment on attachment 8873082 [details] [review]
PR 361

I'll cancel this request and bundle some additions for autophone.

Comment 11

[Bob Clary [:bc] (inactive)]

Attachment: PR 362

I'm not sure what I'm doing wrong in doing the pull request, but it fails in the integration check.

This adds

* platform android-api-15-gradle
* AWSY test
* Autophone tests
** autophone-mochitest-geckoview-e10s
** autophone-robocoptest-autophone2
** autophone-s1s2geckoview
** autophone-s1s2geckoview-e10s

Comment 12

[Bob Clary [:bc] (inactive)]

Attachment: bug-1352333-autophone-trychooser.patch

A patch matching the pull request.

gbarbas: What am I doing wrong with the PR?

Comment 13

[Bob Clary [:bc] (inactive)]

regardless of my failure in getting the pr right, garbas reviewed, merged and today deployed the changes. Thanks!