Open Bug 2088061 Opened 14 days ago

[meta] Track temporary workarounds in the perf test harnesses

Categories

(Testing :: Performance, task)

task

Tracking

(Not tracked)

People

(Reporter: aglavic, Unassigned)

References

(Depends on 4 open bugs)

Details

(Keywords: meta)

The perf harness code has workarounds marked as temporary ("remove once bug X lands", "for the time being", "temporarily") that outlive the bug they were waiting on and get forgotten. Bug 1766112 (forced --clean after a browsertime install in mach raptor, added in 2022) is one example.

This meta bug tracks them so they do not get lost. When you add a temporary workaround to raptor, talos, mozperftest, AWSY, mach try perf, tools/browsertime, the mozharness perf scripts or the perf taskcluster kinds, make this bug depend on the bug it is waiting for (or on a removal bug), and add a row to the tables below in a comment.

Waiting on an open bug

This bug depends on each blocking bug, so it shows when one of them is resolved and the workaround can go.

# Location Temporary code Blocking bug
1 testing/raptor/raptor/browsertime/base.py (get_failure_screenshot) Failure screenshots disabled on Windows for Chrome-family browsers Bug 1884178
2 testing/raptor/raptor/browsertime/base.py Special-case handling of extracted chromedriver names Bug 1844578
3 testing/raptor/raptor/browsertime/base.py Sets what the bundled geckodriver does not (bug 2083658 workaround), marked "Remove once browsertime is updated" Bug 2083786
4 taskcluster/kinds/browsertime/desktop.yml, taskcluster/kinds/browsertime/mobile.yml tp6 and tp6m webextensions tasks kept at tier 3, "promote to tier 2 after confirming no issue" Bug 1867781
5 taskcluster/kinds/perftest/*.yml Duplicated task definitions, "We can consolidate this once bug 1865852 lands" Bug 1865852
6 testing/talos/talos/gecko_profile.py Same as row 3, if bug 1648324 turns out not to be enough Bug 1648325
You need to log in before you can comment on or make changes to this bug.