Open Bug 1563082 (browsertime-ci) Opened 5 years ago Updated 2 years ago

[meta] Run browsertime and compute visualmetrics in CI

Categories

(Testing :: Performance, task)

Product:
Testing
Component:
Performance
Version:
Version 3
Type:
task

Tracking

(Not tracked)

People

(Reporter: nalexander, Unassigned)

References

(Depends on 6 open bugs, Blocks 1 open bug)

Details

(Keywords: meta)

This is a meta ticket tracking running browsertime for performance testing, and computing visualmetrics, in CI.

The first step towards this has a much smaller scope. Bug 1561939 tracks an MVP: running browsertime on Win 10 against mitmproxy.

This quasi-depends on Bug 1543247. That ticket implemented mach browsertime --setup, but due to how the Raptor tests currently run (via mozharness) it's pretty unlikely we'll use that directly.

Depends on: 1543247

I sketched my initial thoughts on the task architecture we might drive towards here. One of the big pieces is around profile conditioning, tracked broadly by Bug 1562870.

Depends on: 1562870
Depends on: 1563090
Summary: Run browsertime and compute visualmetrics in CI → [meta] Run browsertime and compute visualmetrics in CI
Depends on: 1577905
Depends on: 1583284
Depends on: 1584245
Depends on: 1599424
Depends on: 1601045
Type: enhancement → task
Depends on: 1585013
Depends on: 1585046
Depends on: 1587500
Depends on: 1587761
Depends on: 1587828
Depends on: 1591560
Depends on: 1591875
Depends on: 1592333
Depends on: 1592633
Depends on: 1592746
Depends on: 1593109
Depends on: 1602577
Depends on: 1603152
Depends on: 1601414
Depends on: 1604527
No longer depends on: 1604527
Depends on: 1604638
Depends on: 1602657
Depends on: 1607851
Depends on: 1608033
Depends on: 1602893
Depends on: 1608863
Depends on: 1610389
Depends on: 1612042
Depends on: 1615347
Depends on: 1616845
Depends on: 1617239
Depends on: 1633519
Depends on: 1645187
Depends on: 1650133
Depends on: 1650871
Depends on: 1664551
Depends on: 1665911
Depends on: 1665925
Depends on: 1633336
Depends on: 1668049
Depends on: 1693108
Depends on: 1684946
Depends on: 1710452
Depends on: 1763457
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.