815786 - Disable testCheck3 in Talos

Status: RESOLVED FIXED

(Testing :: Talos, defect)

Description

[Geoff Brown [:gbrown]]

Android Talos test "testCheck3" (aka rck3, tcheck3, remote-trobocheck3) has evolved to be functionally equivalent to testCheck2. 

The testCheck2 and testCheck3 have been producing virtually identical results for some time now:

http://graphs.mozilla.org/graph.html#tests=[[204,63,20],[201,63,20]]&sel=none&displayrange=7&datatype=running

We should stop running testCheck3 to save tbpl test time, and then I think there will be no reason to keep the testCheck3 code:

https://hg.mozilla.org/mozilla-central/file/ae2d36c5dc26/mobile/android/base/tests/testCheck3.java.in

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: remove trobocheck3 from the buildbot configs (1.0)

this removes all instances of trobocheck3 from the buildbot-configs repo.  I assume there is another definition for this somewhere, but I was unable to find it in buildbot-configs or buildbotcustom repositories.

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: remove tcheck3 from talos repository (1.0)

and the patches keep rolling in.

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: remove tcheck3 sources from mozilla-central repository (1.0)

and 3 makes a trifecta.

Comment 4

[Geoff Brown [:gbrown]]

Comment on attachment 686895 [details] [diff] [review]
remove tcheck3 sources from mozilla-central repository (1.0)

Thanks!

Comment 5

[Justin Wood (:Callek)]

Comment on attachment 686890 [details] [diff] [review]
remove trobocheck3 from the buildbot configs (1.0)

Review of attachment 686890 [details] [diff] [review]:
-----------------------------------------------------------------

We also need to/should update http://mxr.mozilla.org/build/source/tools/trychooser/index.html?force=1#150  Please do that with rs+=me and land it (I forget the process to deploying trychooser updates though)

Comment 6

[Joel Maher ( :jmaher ) (UTC -8)]

http://hg.mozilla.org/build/buildbot-configs/rev/af8dcb18ed0c

I don't know the process for try chooser, that is a new venue for me to work in.

Comment 7

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: remove rck3 from trychooser (1.0)

Comment 8

[Joel Maher ( :jmaher ) (UTC -8)]

landed in tools repo for try chooser:
https://hg.mozilla.org/build/tools/rev/8489dcda1573

Comment 9

[[e-mail] (:bhearsum)]

This is in production.

Comment 10

[[e-mail] (:bhearsum)]

The buildbotb part, I mean.

Comment 11

[Joel Maher ( :jmaher ) (UTC -8)]

inbound:
https://hg.mozilla.org/integration/mozilla-inbound/rev/82dab468b195

Comment 12

[Joel Maher ( :jmaher ) (UTC -8)]

landed on talos:
http://hg.mozilla.org/build/talos/rev/0f264d4c4205

I will let this close out when the inbound patch makes it through to central.  The rest is just cleanup at this point.

Comment 13

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/mozilla-central/rev/82dab468b195