Open
Bug 2088061
Opened 14 days ago
[meta] Track temporary workarounds in the perf test harnesses
Categories
(Testing :: Performance, task)
Testing
Performance
Tracking
(Not tracked)
NEW
People
(Reporter: aglavic, Unassigned)
References
(Depends on 4 open bugs)
Details
(Keywords: meta)
The perf harness code has workarounds marked as temporary ("remove once bug X lands", "for the time being", "temporarily") that outlive the bug they were waiting on and get forgotten. Bug 1766112 (forced --clean after a browsertime install in mach raptor, added in 2022) is one example.
This meta bug tracks them so they do not get lost. When you add a temporary workaround to raptor, talos, mozperftest, AWSY, mach try perf, tools/browsertime, the mozharness perf scripts or the perf taskcluster kinds, make this bug depend on the bug it is waiting for (or on a removal bug), and add a row to the tables below in a comment.
Waiting on an open bug
This bug depends on each blocking bug, so it shows when one of them is resolved and the workaround can go.
| # | Location | Temporary code | Blocking bug |
|---|---|---|---|
| 1 | testing/raptor/raptor/browsertime/base.py (get_failure_screenshot) |
Failure screenshots disabled on Windows for Chrome-family browsers | Bug 1884178 |
| 2 | testing/raptor/raptor/browsertime/base.py |
Special-case handling of extracted chromedriver names | Bug 1844578 |
| 3 | testing/raptor/raptor/browsertime/base.py |
Sets what the bundled geckodriver does not (bug 2083658 workaround), marked "Remove once browsertime is updated" | Bug 2083786 |
| 4 | taskcluster/kinds/browsertime/desktop.yml, taskcluster/kinds/browsertime/mobile.yml |
tp6 and tp6m webextensions tasks kept at tier 3, "promote to tier 2 after confirming no issue" | Bug 1867781 |
| 5 | taskcluster/kinds/perftest/*.yml |
Duplicated task definitions, "We can consolidate this once bug 1865852 lands" | Bug 1865852 |
| 6 | testing/talos/talos/gecko_profile.py |
Same as row 3, if bug 1648324 turns out not to be enough | Bug 1648325 |
You need to log in
before you can comment on or make changes to this bug.
Description
•