Closed Bug 1594438 Opened 4 years ago Closed 4 years ago

Add more cold page load tests to browsertime on integration branches.

Categories

(Testing :: Raptor, task, P1)

Version 3
task

Tracking

(Not tracked)

RESOLVED MOVED

People

(Reporter: sparky, Assigned: sparky)

References

Details

Attachments

(1 file, 1 obsolete file)

This bug is for adding more cold page load tests to browsertime on integration branches to check if we can catch the same regressions as raptor-webext.

Priority: -- → P1

This patch adds more cold page load tests to browsertime running on integration. Specifically, the following pages will now be tested:

TP6-24: Wikipedia
TP6-17: Yahoo News
TP6-11: Bing
TP6-7: Google Slides
TP6-4: Youtube
TP6-3: Google
TP6-2: Facebook

This graph was used to determine the "most valuable" tests that we should be running. All cold page load tests in the graph are added, as well as some of the other tests with a high enough rate of catching regressions.

Pushed by gmierz2@outlook.com:
https://hg.mozilla.org/integration/autoland/rev/38f7b7e307b3
Add cold page load tests for browsertime on integration branches. r=perftest-reviewers,stephendonner
Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla72

Backed out for causing high load on linux and windows hardware test machines https://hg.mozilla.org/integration/autoland/rev/3a7d12c89f4cc7745efedb01a5522211fa609a89

Flags: needinfo?(gmierz2)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Target Milestone: mozilla72 → ---
Depends on: 1595789

Thanks for backing this out :apavel, there's an error (which caused the long running task) that started in this push which we hadn't noticed: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&tier=1%2C2%2C3&searchStr=btime&revision=dff542b772e590137a2e3d9785f5c32878f256f1

Bug 1595789 will start fixing the issue.

Flags: needinfo?(gmierz2)

Is this still running per-push anywhere? I still see lots of running/pending jobs on autoland:

https://treeherder.mozilla.org/#/jobs?repo=autoland&tier=1%2C2%2C3&searchStr=Windows10%2Cbrowsertime%2Ccold&selectedJob=276005619

This needs to be disabled everywhere except opt-in on Try until it's fixed.

Depends on: 1596102

There's a r+ patch which didn't land and no activity in this bug for 2 weeks.
:sparky, could you have a look please?
For more information, please visit auto_nag documentation.

Flags: needinfo?(gmierz2)
Attachment #9106908 - Attachment is obsolete: true

This work has been moved into bug 1590561.

Status: REOPENED → RESOLVED
Closed: 4 years ago4 years ago
Flags: needinfo?(gmierz2)
Resolution: --- → MOVED
See Also: → 1615347
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: