772928 - Enable reftests for armv6 builds on tegras

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Armen [:armenzg]]

Since we're reducing # of XUL jobs and we need this much more.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

we can start with reftests, once these are going, we will move onto crashtests/jsreftests.  

Running reftests should be the identical set of commandline arguments as we did on xul or native android.

lets just keep the reftests in 3 chunks!

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

to clarify, we are looking to run this on m-c only, not m-a/m-b/release/esr.  

We can decide at a later date to turn this on other other branches or expand the tests on this branch.

Comment 3

[John O'Duinn [:joduinn] (please use "needinfo?" flag)]

from mtg w/blassey. 

We agree on the need for this armv6-on-tegras as a way to get armv6 testing started ASAP, but are both worried about the load impact to the pool of tegras. Therefore:

1) enabling on try, but not as default.
2) enabling on mozilla-inbound, mozilla-central, mozilla-aurora
3) blocking on bug#750285, bug#777037

We'll revisit as more tegras come online.

Comment 4

[Armen [:armenzg]]

We should start getting work done for this starting next week.
This way we get our toes wet and set up some ground work for adding more tests in the upcoming weeks.

Comment 5

[John O'Duinn [:joduinn] (please use "needinfo?" flag)]

ctalbert/jmaher/blassey: 

So far this bug has been about reftests. While we are doing this, are there other test suites that we can/should enable for armv6 builds on the tegras?

Also, given the reduced scope (ie reduced load) specified in comment#3, and some more tegras coming into production tonight, we dont need to wait for androidXUL builds to be disabled next week.

Comment 6

[Joel Maher ( :jmaher ) (UTC -8)]

There are other tests we can run on armv6/tegra.  The issue to date has been load.  My understanding is a lot of the new tegras are problematic, so counting on 86 tegras being online might be jumping the gun a bit.

Good news is some of those tegras are online and our load is greatly reduced by removing the reboot issue.  I would think we could bring mochitests online.  Talos is a big first to get online, but if this is a temporary platform will it be of great value?

Comment 7

[Justin Wood (:Callek)]

Attachment: Add reftests to ARMv6 v0.5

This patch has yet to be run through a checkconfig or a dump_masters run for sanity. However unless I'm missing something this is all I need to change, ad everywhere. 

f? to aki for any early feedback/notices, no need to nitpick on a syntax errors or something as glaring that checkconfig/dump_master should catch, but happy to take that feedback as well, I'm more looking for something like "You need to change this other file you probably didn't notice", or "This approach is wrong, you should look <here>" type things.

Comment 8

[Aki Sasaki (not active)]

Comment on attachment 659672 [details] [diff] [review]
Add reftests to ARMv6 v0.5

I think you're on the right track.
I'm not sure if you want 'tegra_android': {} or 'tegra_android-armv6': {}; whichever one results in armv6 tests triggering is probably right.

Comment 9

[Justin Wood (:Callek)]

Attachment: [configs] v1

Still have to properly stage this and see how it runs, (with sendchanges in the staging)

Not 100% sure this is already doing sendchange in prod, but afaict it is.

Comment 10

[Justin Wood (:Callek)]

Attachment: [custom] v1

Comment 11

[Justin Wood (:Callek)]

Attachment: [tools] v1

Comment 12

[Aki Sasaki (not active)]

Comment on attachment 659989 [details] [diff] [review]
[tools] v1

I think you missed bm10.
r=me with that.

Comment 13

[Aki Sasaki (not active)]

Comment on attachment 659987 [details] [diff] [review]
[configs] v1

Lgtm.  I was able to see the armv6 reftests on my staging master, and sent a sendchange.

Comment 14

[Justin Wood (:Callek)]

Attachment: [puppet-manifests] add to Slaves PW Template

I realized we need a puppet patch for this

Comment 15

[Justin Wood (:Callek)]

This went live, now (+ beta/aurora in Bug 791103)