918463 - update talos configs to reflect updated tests

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

we need to switch tsvg -> tsvgx
we need to switch ts -> ts_paint
we need to make sure these are on aurora (after the merge)

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: update talos mobile configs (1.0)

Comment 2

[Kim Moir [:kmoir] ET]

Comment on attachment 807369 [details] [diff] [review]
update talos mobile configs (1.0)

lgtm I tested the patch on my staging master

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

landed this:
https://hg.mozilla.org/build/buildbot-configs/rev/c79c55ed0764

this will get picked up in the next reconfig.

Comment 6

[Armen [:armenzg]]

I'm trying to figure out what we want to do in here.
jmaher, please correct me if I got this wrong.

Why is tcanvasmark in the patch?

I believe these are the changes (IIUC) we have to make:
- Common flags
   - enable  tsvgx & ts_paint by default ('enable_by_default': True)
   - disable tsvg & ts by default ('enable_by_default': False)
- Make these changes on mozilla-beta (FF25), mozilla-release (FF24)
   - disable tsvgx & ts_paint
+BRANCHES['mozilla-beta']['remote-tsvgx_tests'] = (0, False, TALOS_REMOTE_FENNEC_OPTS, ANDROID_NOT_MOZPOOL)
+BRANCHES['mozilla-beta']['remote-ts_paint_tests'] = (0, False, TALOS_REMOTE_FENNEC_OPTS, ANDROID_NOT_MOZPOOL)
+BRANCHES['mozilla-release']['remote-tsvgx_tests'] = (0, False, TALOS_REMOTE_FENNEC_OPTS, ANDROID_NOT_MOZPOOL)
+BRANCHES['mozilla-release']['remote-ts_paint_tests'] = (0, False, TALOS_REMOTE_FENNEC_OPTS, ANDROID_NOT_MOZPOOL)
   - enable tsvg & ts
+BRANCHES['mozilla-beta']['remote-ts_tests'] = (1, False, TALOS_REMOTE_FENNEC_OPTS, ANDROID_NOT_MOZPOOL)
+BRANCHES['mozilla-beta']['remote-tsvg_tests'] = (1, False, TALOS_REMOTE_FENNEC_OPTS, ANDROID_NOT_MOZPOOL)
+BRANCHES['mozilla-release']['remote-ts_tests'] = (1, False, TALOS_REMOTE_FENNEC_OPTS, ANDROID_NOT_MOZPOOL)
+BRANCHES['mozilla-release']['remote-tsvg_tests'] = (1, False, TALOS_REMOTE_FENNEC_OPTS, ANDROID_NOT_MOZPOOL)

NOTE: We don't run mobile testing on ESR releases

Right now I see these [1]:
- tsvgx enabled for m-c & m-a
- ts_paint enabled nowhere
- tsvg enabled for FF27 branches (except m-c), m-b & m-r
- ts enabled FF27 branches (except m-c), m-b, m-r


[1] ./setup-master.py master bm10-tests1-tegra && ~/repos/releng/braindump/buildbot-related/builder_list.py master.cfg > builder_list.txt

Comment 7

[Joel Maher ( :jmaher ) (UTC -8)]

ok, Canvasmark was added to aurora as it is firefox 26+, I am not sure of the best way to make tests follow the release trains.

let me work on a patch to enable the tests by default, turn them off on m-r, m-b and then leave the old ones on only for m-r/m-b.

Comment 8

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: updated mobile configs to ride the trains (1.0)

Comment 9

[Armen [:armenzg]]

Attachment: differences.diff

This is the diff of the old builders versus the new ones (with this patch applied).

This lists are produced with builder_list.py from the braindump repo.

Comment 10

[Armen [:armenzg]]

Comment on attachment 809137 [details] [diff] [review]
updated mobile configs to ride the trains (1.0)

Review of attachment 809137 [details] [diff] [review]:
-----------------------------------------------------------------

r+ conditional on adding a "mozilla-release" block similar to the "mozilla-beta" block.

Everything else is perfect.

Comment 11

[Joel Maher ( :jmaher ) (UTC -8)]

landed:
https://hg.mozilla.org/build/buildbot-configs/rev/18a48374b3cd

this can be picked up in the next reconfig, no rush for this specific patch.

Comment 12

[Kim Moir [:kmoir] ET]

In production