989462 - Schedule Android 2.3 mochitest,xpcshell,robocop tests (only) on all trunk trees and make them ride the trains

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Geoff Brown [:gbrown]]

Some Android 2.3 test suites are now running reliably and meet the requirements on https://wiki.mozilla.org/Sheriffing/Job_Visibility_Policy:

https://tbpl.mozilla.org/?tree=Ash&jobname=Android.*2.3.*

We should run what we can on trunk trees to avoid introducing new problems while we sort out the remaining issues (bug 967704).

At this time I am proposing that we start running 

M1 ... M12 (but NOT M-gl)
rc1, rc2, rc3, rc4
X1, X2, X3

Comment 1

[Geoff Brown [:gbrown]]

In the March 29 merge to ash, X3 failed. I am looking into the problem and expect it to be resolved today.

Comment 2

[Kim Moir [:kmoir] ET]

Attachment: bug989462.patch

Will attach builder diff too

Comment 3

[Kim Moir [:kmoir] ET]

Attachment: builder diff

Comment 4

[Armen [:armenzg]]

Comment on attachment 8399453 [details] [diff] [review]
bug989462.patch

Hi Kim, my apologies for the r- but I would like us to take another approach for the long term readability of mobile_config.py.

Could you please split ANDROID_2_3_MOZHARNESS_DICT into two? (enabled VS not enabled).

Also change the 'opt_unittest_suites':
1356 ANDROID_2_3_MOZHARNESS_UNITTEST_DICT = {
1357    'opt_unittest_suites': NEW_DICT_THAT_HAS_ENABLED_BY_DEFAULT_JOBS

Over here add both dictionaries:
1548 BRANCHES['ash']['platforms']['android']['vm_android_2_3'] = {
1549     'opt_unittest_suites': deepcopy(ANDROID_2_3_MOZHARNESS_DICT)
1550 }

I think this should simplify the for loop you're adding.

Comment 5

[Kim Moir [:kmoir] ET]

Attachment: bug989462.patch

Comment 6

[Kim Moir [:kmoir] ET]

Attachment: bug989462-2.diff

new builder diff. changes on ash are just ordering

Comment 7

[Armen [:armenzg]]

Comment on attachment 8399549 [details] [diff] [review]
bug989462.patch

Review of attachment 8399549 [details] [diff] [review]:
-----------------------------------------------------------------

Thank you Kim!

Comment 8

[Kim Moir [:kmoir] ET]

In production and verified in tbpl