1717600 - Add browsertime and awsy perf tests for firefox built with clang-trunk

Status: RESOLVED FIXED

(Testing :: General, task)

Description

[Andi [:andi]]

On a daily basis we have two targets that build firefox on m-c and m-b with a fresh snapshot of clang-trunk. In order to track performance over time for clang-trunk we need to add perf tests for the ff build using clang-trunk.

Comment 1

[Andi [:andi]]

Attachment: Bug 1717600 - Add browsertime perf tests for FF built with clang-trunk. r=jmaher

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/9bf2df766379
Add browsertime perf tests for FF built with clang-trunk. r=perftest-reviewers,jmaher,davehunt

Comment 3

[Atila Butkovits]

Backed out for causing linting failures.

Backout link: https://hg.mozilla.org/integration/autoland/rev/d348162773828452359b3f8a7339f11cd13c815c

Push with failures: https://treeherder.mozilla.org/jobs?repo=autoland&selectedTaskRun=ecHDg4rMRn6Q3w8i0NnXfw.0&revision=9bf2df766379111c68114c9c112eb064b7e32c80&searchStr=linting%2Copt%2Ccheck%2Con%2Ctexts%2Csource-test-mozlint-perfdocs-verify%2Cperfdocs

Failure log: https://treeherder.mozilla.org/logviewer?job_id=343766341&repo=autoland&lineNumber=68

Comment 4

[Andi [:andi]]

I've updated the docs.

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a945a3b80736
Add browsertime perf tests for FF built with clang-trunk. r=perftest-reviewers,jmaher,davehunt

Comment 6

[Cristian Brindusan [:cbrindusan]]

https://hg.mozilla.org/mozilla-central/rev/a945a3b80736

Comment 7

[Joel Maher ( :jmaher ) (UTC -8)]

:andi, I don't see any perf tests running on mozilla-central, are these tests still desired? Who is looking at the data regularly?

Comment 8

[Andi [:andi]]

Yes, these have been moved.

Comment 9

[Greg Mierzwinski [:sparky]]

Hi :andi, is anyone monitoring the results from these tests? If not, is there a reason why performance tests are running on this platform? The tier-2 clang build is causing issues for some of our test setup changes (increasing tiers), so I'm considering either reducing the number of test that run with the clang build, or disabling browsertime on this platform.

Comment 10

[Andi [:andi]]

Yes, we want to have an idea where changes from clang-trunk might affect firefox perf. If we wouldn't have these tests when we will update to the next clang version we might hit perf issues that could have been foreseen.

Comment 11

[Greg Mierzwinski [:sparky]]

Ok great thanks! So what we'll do is remove the problematic tests from the clang builds since they can't run at tier-1 using a tier-2 build.