2030161 - Generate ETW (xperf) profiles for Speedometer 3 tests on Windows

Status: RESOLVED FIXED

(Testing :: Performance, task, P3)

Description

[Abhishek Nimalan [:animalan]]

In our effort to produce Speedometer 3 profiles for each platform, this bug tracks the work to collect full-system xperf profiles from Speedometer 3 tests run on Windows.

We can leverage Kash's xperf patch for this.

According to mcornmesser, the xperf schedule tasks are running on the main pool with this command (which will help with getting elevated permission to profile).

For symbolicating these profiles and integrating everything into Raptor, we can reference the work in our Android sp3 profile patches (Bug 1978586).

Comment 1

[Markus Stange [:mstange]]

We'll want xperf profiles in addition to Gecko profiler profiles, for two reasons:

• xperf works for both Firefox and Chrome, so we can compare equivalently-collected profiles
• the Gecko profiler has higher overhead, and Firefox uses different code paths when profiling is active, which distorts sp3 profiles

Comment 2

[Markus Stange [:mstange]]

To do this, we will want to record the tests using xperf, and then process the etl files using samply.

xperf needs to be run as Administrator, and our sp3 jobs execute as a non-Administrator account. To bridge the gap, we use "scheduled tasks" to invoke Administrator-privileged powershell scripts for starting and stopping xperf. These scripts are already on the CI perf testing Windows machines, and can be found here: https://github.com/mozilla-platform-ops/ronin_puppet/tree/22ae7fce5c52138bb774655dd8a1255306294e09/modules/win_hw_profiling/files

Comment 3

[Abhishek Nimalan [:animalan]]

Attachment: Bug 2030161 - Add Xperf (ETW) profiling support for Windows Raptor tests. r?#perftest

Co-authored-by: KS <[e-mail]>

Comment 4

[Abhishek Nimalan [:animalan]]

Attachment: WIP: Bug 2030161 - Symbolicate ETW profiles with Samply. r?#perftest

Comment 5

[Abhishek Nimalan [:animalan]]

Attachment: WIP: Bug 2030161 - Archive ETW profiles. r?#perftest

Comment 6

[Abhishek Nimalan [:animalan]]

Attachment: WIP: Bug 2030161 - Profile entire Browsertime instance with xperf. r?#perftest

Comment 7

[Abhishek Nimalan [:animalan]]

Attachment: WIP: Bug 2030161 - Add etw-profile flags. r?#perftest

Comment 8

[Abhishek Nimalan [:animalan]]

Attachment: WIP: Bug 2030161 - Increase Browsertime timeout for ETW profiling. r?#perftest

Comment 9

[Abhishek Nimalan [:animalan]]

Attachment: Bug 2030161 - Add transform and Autoland tasks for Speedometer 3 native profiling on Windows. r?#perftest

Comment 10

[Abhishek Nimalan [:animalan]]

Attachment: WIP: Bug 2030161 - Use 20 browser cycles when running Speedometer 3 tests with ETW profiling. r?#perftest

Comment 11

[Abhishek Nimalan [:animalan]]

Attachment: WIP: Bug 2030161 - Create labelled and compact versions of the ETW profile with profiler-edit. r?#perftest

Comment 12

[Abhishek Nimalan [:animalan]]

Attachment: WIP: Bug 2030161 - Add xperf ETW profiling support for Windows Raptor tests. r?#perftest

Co-authored-by: KS <[e-mail]>
Co-authored-by: Markus Stange <[e-mail]>

Comment 13

[Abhishek Nimalan [:animalan]]

Attachment: Bug 2030161 - Update perfdocs to include info on native profiling on Windows. r?#perftest

Comment 14

[Phabricator Automation]

Comment on attachment 9584664 [details]
WIP: Bug 2030161 - Create labelled and compact versions of the ETW profile with profiler-edit. r?#perftest

Revision D299443 was moved to bug 2042905. Setting attachment 9584664 [details] to obsolete.

Comment 15

[Abhishek Nimalan [:animalan]]

Attachment: Bug 2030161 - Support chromium-as-release Speedometer 3 Profiles on Windows. r?#perftest

Comment 16

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/2d3f535a6fa4
https://hg.mozilla.org/integration/autoland/rev/56a9e4aa9efb
Add Xperf (ETW) profiling support for Windows Raptor tests. r=perftest-reviewers,kshampur
https://github.com/mozilla-firefox/firefox/commit/3b47aab54439
https://hg.mozilla.org/integration/autoland/rev/dfb6bded4e24
Add transform and Autoland tasks for Speedometer 3 native profiling on Windows. r=perftest-reviewers,kshampur
https://github.com/mozilla-firefox/firefox/commit/5d43bc46abb9
https://hg.mozilla.org/integration/autoland/rev/daf56cd32356
Support chromium-as-release Speedometer 3 Profiles on Windows. r=perftest-reviewers,kshampur
https://github.com/mozilla-firefox/firefox/commit/4ecaa0eefe39
https://hg.mozilla.org/integration/autoland/rev/dfe2c2006c99
Update perfdocs to include info on native profiling on Windows. r=perftest-reviewers,kshampur

Comment 17

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/56a9e4aa9efb
https://hg.mozilla.org/mozilla-central/rev/dfb6bded4e24
https://hg.mozilla.org/mozilla-central/rev/daf56cd32356
https://hg.mozilla.org/mozilla-central/rev/dfe2c2006c99

Comment 18

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/56a9e4aa9efb
https://hg.mozilla.org/mozilla-central/rev/dfb6bded4e24
https://hg.mozilla.org/mozilla-central/rev/daf56cd32356
https://hg.mozilla.org/mozilla-central/rev/dfe2c2006c99