1731850 - ensure resolution on perf machines are representative of our user base

Status: RESOLVED FIXED

(Testing :: Performance, task, P1)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

sticking to desktop, we have 3 different configs:

• windows 10 - 1024x768 (only perf tests run on here now - max: 3840 x 2160, can run 1080p via try with runtime script to adjust resolution)
• macosx 10.15 - 1600x1200 (shared with unittests - not so realistic to change)
• linux 18.04 - TBD (can set to what we need)

clearly we want to adjust our windows 10. Our pages are recorded at 1366x695, so anything bigger than that might not be beneficial.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

:dhouse, can you help out with what the current linux moonshots have for a resolution.

Comment 2

[:dhouse]

:aerickson confirmed the linux workers, ubuntu 18.04, are running at 1600x1200: https://github.com/mozilla-platform-ops/ronin_puppet/blob/master/modules/linux_gui/manifests/init.pp#L14

Comment 3

[:dhouse]

[dhouse@t-linux64-ms-013 ~]$ DISPLAY=:0 sudo xrandr --listmonitors
Monitors: 1
 0: +*VIRTUAL1 1600/423x1200/317+0+0  VIRTUAL1

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

:denispal- are there resolutions on windows/linux that you would prefer? if we do 1600x1200 on windows that would make the resolutions the same on all 3 desktop platforms.

Comment 5

[:dhouse]

macos 10.15 unit/perf testers are running at 1920 x 1080
The resolutions possible, on the hdmi dongle plugged into them, are from vga to 4k: https://bugzilla.mozilla.org/show_bug.cgi?id=1668886#c15

Comment 6

[Joel Maher ( :jmaher ) (UTC -8)]

thanks :dhouse!

Comment 7

[Denis Palmeiro [:denispal]]

(In reply to Joel Maher ( :jmaher ) (UTC -0800) from comment #4)

:denispal- are there resolutions on windows/linux that you would prefer? if we do 1600x1200 on windows that would make the resolutions the same on all 3 desktop platforms.

1600x1200 is certainly better than 1024x768, but I think 1920x1080 would be the best. Something higher would also be good to have in addition, but I'm not sure how that complicates things.

Comment 8

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: Bug 1731850 - adjust screen resolution of windows hardware to be 1080p. r=#perftest-reviewers!

try push:
https://treeherder.mozilla.org/jobs?repo=try&revision=7d181c478f4d369484259aba4e501b434d5758d3

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a4f5951baac5
adjust screen resolution of windows hardware to be 1080p. r=perftest-reviewers,sparky

Comment 10

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/a4f5951baac5

Comment 11

[Intermittent Failures Robot]

1 failures in 3376 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1731850&startday=2021-09-27&endday=2021-10-03&tree=all

Comment 12

[Andra Esanu (needinfo me)]

== Change summary for alert #31659 (as of Mon, 04 Oct 2021 09:32:23 GMT) ==

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)
13%	glterrain	windows10-64-qr	e10s stylo webgl-ipc webrender	2.05 -> 1.79
11%	glterrain	windows10-64-shippable-qr	e10s stylo webrender	1.97 -> 1.75
11%	glterrain	windows10-64-qr	e10s stylo webgl-ipc webrender	2.01 -> 1.80
10%	glterrain	windows10-64-shippable-qr	e10s stylo webrender	1.95 -> 1.75
10%	glterrain	windows10-64-shippable-qr	e10s stylo webgl-ipc webrender	1.98 -> 1.79

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=31659