888464 - Retire Android Talos test testCheck, aka rck / tcheckerboard

Status: RESOLVED FIXED

(Testing :: Talos, defect)

Description

[Geoff Brown [:gbrown]]

This is a proposal to remove (stop running, probably delete the code) the Talos testCheck / tcheckerboard test for Android.

This test has reported a result of 0 very consistently for several months now -- it seems ineffective, for our current browser. (testCheck2 seems to be a more demanding "checkerboarding" test.)

If testCheck is no longer useful, we should stop running it, to improve our test capacity / free up test slaves for other jobs.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

I believe we need the page this references for rck2, but otherwise I am happy to make the adjustment.  Please hit jhammel up if this is a priority, otherwise I will address this when I am back from vacation starting the 9th of July.

Please confirm this is a decision the mobile team can agree upon.

Comment 2

[Kartikaya Gupta (email:[e-mail])]

Fine by me.

Comment 3

[Chris Lord [:cwiiis]]

Fine by me too.

Comment 4

[Geoff Brown [:gbrown]]

Joel -- over to you to remove at your convenience.

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: disable rck on all branches (1.0)

do we want to disable this on all branches, if so this patch is your ticket!

Comment 6

[Geoff Brown [:gbrown]]

Comment on attachment 772030 [details] [diff] [review]
disable rck on all branches (1.0)

Review of attachment 772030 [details] [diff] [review]:
-----------------------------------------------------------------

Yes, removal from all branches is desired.

Should we also remove from trychooser at this time? http://mxr.mozilla.org/build/source/tools/trychooser/index.html?force=1#250

Comment 7

[Joel Maher ( :jmaher ) (UTC -8)]

https://hg.mozilla.org/build/buildbot-configs/rev/39fea76dba77

Comment 8

[Justin Wood (:Callek)]

(we leave open until reconfig)

Comment 9

[Justin Wood (:Callek)]

In production

Comment 10

[Ed Morley [:emorley]]

(In reply to Geoff Brown [:gbrown] from comment #6)
> Should we also remove from trychooser at this time?
> http://mxr.mozilla.org/build/source/tools/trychooser/index.html?force=1#250

Filed bug 893733.