1080134 - Disable win8-32 testing and enable win8-64 testing

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Chris AtLee [:catlee]]

In order to have enough testing capacity for 64-bit windows, we need to disable some existing tests.

The best option we have right now is to disable 32-bit win8 tests. We can then use the win8 machines for testing 64-bit windows builds on trunk branches.

We'll need to keep release branches with 32-bit win8 tests enabled for the meanwhile.

Comment 1

[Chris AtLee [:catlee]]

Attachment: disables vm tests; enables talos

step 1 - let's get date close to what we want the rest of the branches to look like.

Builders added:
+ win8_64 date talos chromez
+ win8_64 date talos dromaeojs
+ win8_64 date talos g1
+ win8_64 date talos other_nol64
+ win8_64 date talos svgr
+ win8_64 date talos tp5o
Builders removed
- win64_vm date debug test cppunit
- win64_vm date debug test crashtest
- win64_vm date debug test jetpack
- win64_vm date debug test jittest
- win64_vm date debug test jsreftest
- win64_vm date debug test mochitest-1
- win64_vm date debug test mochitest-2
- win64_vm date debug test mochitest-3
- win64_vm date debug test mochitest-4
- win64_vm date debug test mochitest-5
- win64_vm date debug test mochitest-browser-chrome-1
- win64_vm date debug test mochitest-browser-chrome-2
- win64_vm date debug test mochitest-browser-chrome-3
- win64_vm date debug test mochitest-devtools-chrome-1
- win64_vm date debug test mochitest-devtools-chrome-2
- win64_vm date debug test mochitest-devtools-chrome-3
- win64_vm date debug test mochitest-other
- win64_vm date debug test reftest
- win64_vm date debug test xpcshell
- win64_vm date opt test cppunit
- win64_vm date opt test crashtest
- win64_vm date opt test jetpack
- win64_vm date opt test jittest
- win64_vm date opt test jsreftest
- win64_vm date opt test mochitest-1
- win64_vm date opt test mochitest-2
- win64_vm date opt test mochitest-3
- win64_vm date opt test mochitest-4
- win64_vm date opt test mochitest-5
- win64_vm date opt test mochitest-browser-chrome-1
- win64_vm date opt test mochitest-browser-chrome-2
- win64_vm date opt test mochitest-browser-chrome-3
- win64_vm date opt test mochitest-devtools-chrome
- win64_vm date opt test mochitest-other
- win64_vm date opt test reftest
- win64_vm date opt test reftest-no-accel
- win64_vm date opt test xpcshell

Comment 2

[Rail Aliiev [:rail]]

Comment on attachment 8503330 [details] [diff] [review]
disables vm tests; enables talos

lgtm

Comment 3

[Pete Moore [:pmoore][:pete]]

Checked in code landed in production

Comment 4

[Armen [:armenzg]]

There are some DB entries for the win8 64 vms:
https://secure.pub.build.mozilla.org/buildapi/revision/date/ed32730dc8e1

Comment 5

[Chris AtLee [:catlee]]

Attachment: disable 32-bit win8 testing

The default {talos_,}slave_platforms for win32 are ['xp-ix', 'win7-ix', 'win8'].

We need to remove win8 from the list of slave platforms for win32 and add 'win8_64' to the list of slave platforms for win64.

I think this patch gets us to the desired goal on the date branch. If it looks good on date, then we can change these settings for the other branches.

The 'enable_talos' flag here is useless, so I removed it.

Comment 6

[Chris Cooper [:coop] (he/him)]

Merged to production, and deployed.

Comment 7

[Chris AtLee [:catlee]]

Attachment: remove unneeded code

this code doesn't do anything now that we switched to mozharness

Comment 8

[Chris AtLee [:catlee]]

Attachment: stop win64 sendchange from win32 builds.

this will stop triggering tests of the 32-bit builds on the 64-bit win8 machines.

Comment 9

[Pete Moore]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/ae0f93785b10

Comment 10

[Pete Moore]

In production: https://hg.mozilla.org/build/mozharness/rev/1b96260e00c5

Comment 11

[Armen [:armenzg]]

Is win8_64 going to be the final platform name for the buildername? (instead of "Windows 8 64-bit")
I have to adjust titanic to accept this different platform name.

Comment 12

[Ryan VanderMeulen [:RyanVM]]

Sure hope so since we already landed TPBL/TH patches under that assumption.

Comment 13

[Chris AtLee [:catlee]]

I'm not sure. The other options I can think of are:
"WINNT 6.2 64-bit"
"WINNT 6.2 x64"

some previous examples:
"WINNT 6.2" - our current 32-bit win8 tests, which are going away
"Windows 7 32-bit" - for our current 32-bit win7 tests, which aren't changing
"Ubuntu VM 12.04 x64" - for 64-bit linux tests
"Ubuntu VM 12.04" - for 32-bit linux tests

Yay consistency.

Comment 14

[Ryan VanderMeulen [:RyanVM]]

*If* we end up changing them, I think "Windows 8 64-bit" makes the most sense. But given that our names are already an inconsistent mess and our tools are already looking for the current names, I'm not sure if it's really worth the effort either.

Comment 15

[Armen [:armenzg]]

I would be happier if at least within the three Windows platforms we had consistency.

A while back when I added the iX batch of machines we started using "Windows {7|xp} {$arch}-bit".
I think Win8 arrived first to the iX machines and we kept the original WINNT X.Y format.

Could we please move to Windows 8 64-bit to make the Windows flavors consistent?

Comment 16

[Armen [:armenzg]]

Attachment: rename_win8_64.diff

Comment 17

[Ryan VanderMeulen [:RyanVM]]

Comment on attachment 8507199 [details] [diff] [review]
rename_win8_64.diff

Review of attachment 8507199 [details] [diff] [review]:
-----------------------------------------------------------------

Please file TBPL and TH bugs for supporting this change. Definitely better to make it now while they're still running on Date, though.

Comment 18

[Armen [:armenzg]]

Great! I will wait for catlee reviewing the patch before filing those bugs.

Comment 19

[Chris AtLee [:catlee]]

Comment on attachment 8507199 [details] [diff] [review]
rename_win8_64.diff

Review of attachment 8507199 [details] [diff] [review]:
-----------------------------------------------------------------

lgtm

Comment 20

[Armen [:armenzg]]

Comment on attachment 8507199 [details] [diff] [review]
rename_win8_64.diff

https://hg.mozilla.org/build/buildbot-configs/rev/4aecd2e78d93

I will file the mentioned bugs.

Comment 21

[Armen [:armenzg]]

Filed bug 1084520, bug 1085549 and bug 1084520.

Comment 22

[Release Engineering SlaveAPI Service]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/4aecd2e78d93

Comment 24

[Chris AtLee [:catlee]]

Attachment: switch win8 from 32-bit to 64-bit testing

I love our configs.

So, we can't just remove 'win8' from the lists of slave_platforms for 'win32', since the global PLATFORMS is used in various places. The approach I took was to add 'win8_64' as a slave platform of 'win64', and then to use LOOOOOOOPS to add/remove the correct win8 platforms from various branches according to their version.

I also cleaned up some talos suites that are no longer used.

The result should be that for all trunk-based branches, the old 'WINNT 6.2' builders are replaced with 'Windows 8 64-bit' builders, except for PGO, which we're not running yet. Bug 1086703 for that.

The rest of the patch is fixing up various project branches that were hardcoding platforms, and I assume should be using win64 now as well if they were using win32 previously.

Comment 25

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 8508901 [details] [diff] [review]
switch win8 from 32-bit to 64-bit testing

Review of attachment 8508901 [details] [diff] [review]:
-----------------------------------------------------------------

the talos bits looks pretty good.  Glancing over the rest, I don't see anything that jumps out at me as scary.

::: mozilla-tests/config.py
@@ +220,4 @@
>  LINUX64_ONLY = get_talos_slave_platforms(PLATFORMS, platforms=('linux64',))
>  NO_LINUX64 = get_talos_slave_platforms(PLATFORMS, platforms=('linux', 'win32', 'macosx64', 'win64'))
>  
> +def win864_to_win8(platforms):

I don't understand this.

Comment 26

[Chris AtLee [:catlee]]

Comment on attachment 8508901 [details] [diff] [review]
switch win8 from 32-bit to 64-bit testing

Review of attachment 8508901 [details] [diff] [review]:
-----------------------------------------------------------------

::: mozilla-tests/config.py
@@ +220,4 @@
>  LINUX64_ONLY = get_talos_slave_platforms(PLATFORMS, platforms=('linux64',))
>  NO_LINUX64 = get_talos_slave_platforms(PLATFORMS, platforms=('linux', 'win32', 'macosx64', 'win64'))
>  
> +def win864_to_win8(platforms):

hmm, looks like this isn't required any more. I'll remove it, and how it's called below.

Comment 27

[[e-mail] (:bhearsum)]

Comment on attachment 8508901 [details] [diff] [review]
switch win8 from 32-bit to 64-bit testing

Review of attachment 8508901 [details] [diff] [review]:
-----------------------------------------------------------------

Looks fine to me. Thank you for doing cleanup, you're a saint! Give this man more config bugs!!!

Comment 28

[Chris AtLee [:catlee]]

Attachment: enable win64 builds on trunk

Comment 29

[Chris Cooper [:coop] (he/him)]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/e26e8936c6db

Comment 30

[Chris Cooper [:coop] (he/him)]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/598fc4933add

Comment 31

[Armen [:armenzg]]

Did we enable pgo for win64?

Comment 32

[Nicholas Nethercote [inactive]]

Is the "win64 (not run by default)" string on TryChooser no longer accurate?

Comment 33

[Nicholas Nethercote [inactive]]

> Is the "win64 (not run by default)" string on TryChooser no longer accurate?

I filed bug 1088371 about updating TryChooser.

Comment 34

[Joel Maher ( :jmaher ) (UTC -8)]

is there anything left here?  We have effectively completed  this.