1860111 - migrate perf tests from win10 reference hardware to new win11 reference hardware

Status: RESOLVED FIXED

(Testing :: Performance, task, P2)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

the old pool releng-hardware/gecko-t-win10-64-ref-hw is ready to be replaced by releng-hardware/win11-64-2009-hw-ref

the old pool has 2 workers, the new pool has 7 with a few more coming online. This will allow for more tests.

I see this order of operations:

1. add new tasks utilizing the new pool
2. turn on new jobs in parallel (2 weeks)
3. consider adding other tasks now that we have more capacity
4. fix any platform names, etc. for proper treeherder/perfherder visibility
5. upgrade graphs and other tools to reference new hardware
6. update documentation for new hardware
7. when 2 weeks are up, turn off old win10-ref-hw pool.

I don't see any of these tasks running downstream, only on mozilla-central.

Comment 1

[Greg Mierzwinski [:sparky]]

This will be worked on by the perftest team in ~Q1 2024.

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

with bug 1861755, the plumbing will exist to run tests on the new hardware. This should significantly reduce the amount of work to get new tests running (i.e. a couple lines of code)

Comment 3

[Greg Mierzwinski [:sparky]]

:jmaher, could you provide me with the specs for these win11 reference hardware machines or add them to this wiki page? https://wiki.mozilla.org/Performance/Platforms

Comment 4

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1860111 - Run talos-webgl-gli tests on windows 11 ref hw. r?#perftest,afinder

This patch enables the talos-webgl-gli tests on the windows 11 reference hardware which will replace the windows 10 reference hardware.

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

:jmoss, can you get the hardware specs?

Comment 6

[:jmoss]

Windows 11 Reference Hardware

Platforms: Windows 11 x64
Location: MDC1

Model Name: NUC12WSKi3
Model Identifier: 
Processor Name: Intel Core i3-1220P
Processor Speed: 2.96 GHz
Number of Processors: 12
Total Number of Cores: 10
GPU: Intel® UHD Graphics for 12th Gen Intel® Processors
Memory: 8GB
Disk: 500GB SSD
Resolution: 1920 x 1080

Comment 7

[Greg Mierzwinski [:sparky]]

Thanks! I've added that to the platforms wiki.

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/f408182c4687
Run talos-webgl-gli tests on windows 11 ref hw. r=afinder,perftest-reviewers

Comment 9

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/f408182c4687

Comment 10

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1860111 - Remove win10 reference hardware talos tests, and platform. r?#perftest,kshampur

This patch removes the windows 10 reference hardware talos tests. It also remove the platform config for it.

Comment 11

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1860111 - Remove talos windows10 ref hw tests, and platform configurations. r?#perftest,kshampur,jmaher

With talos tests disabled on the windows10 reference hardware, we can remove any configuration steps that we have for that platform since there are no other tests running on those machines.

Depends on D205079

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/9bad61381e60
Remove talos windows10 ref hw tests, and platform configurations. r=jmaher,taskgraph-reviewers,perftest-reviewers,kshampur

Comment 13

[Norisz Fay [:noriszfay]]

Backed out for causing python failure on test_set_test_setting

Backout link

Push with failures

Failure log

Comment 14

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/25852a1e2059
Remove talos windows10 ref hw tests, and platform configurations. r=jmaher,taskgraph-reviewers,perftest-reviewers,kshampur

Comment 15

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/25852a1e2059