Open Bug 2070797 Opened 3 days ago Updated 2 days ago

[meta] Fix the flakiness in devtools/client/debugger/test/mochitest

Categories

(DevTools :: Debugger, task)

task

Tracking

(Not tracked)

People

(Reporter: florian, Assigned: florian)

References

(Depends on 12 open bugs, Blocks 1 open bug)

Details

(Keywords: leave-open, meta)

Attachments

(1 file)

Tracking bug for the flakiness burndown of devtools/client/debugger/test/mochitest. This bug is the landing target for the annotation removals that have no failures still reproducing on try, and the meta bug tracking the individual fixes.

Over 2026-08-18 - 2026-09-07 the folder's 233 tests produced 249 failures, 291 timeouts, 17 crashes and 41,523 skipped runs, with 60 tests carrying at least one issue.

One finding worth mentioning: a skip-if does not just silence a test failure, it lets it rot: browser_dbg-watchpoints.js needed three separate fixes before it would pass again, sourcemaps/browser_dbg-sourcemapped-stepping.js four, and browser_dbg-reloading.js three; in each case later refactors updated the living siblings in the same file and passed over the disabled test. sourcemaps/browser_dbg-sourcemapped-stepping.js landed already skipped in May 2018 and has never once run in mozilla-central.

Depends on: 2070908
Depends on: 2070909
Depends on: 2070911
Depends on: 2070914
Depends on: 2070917
Depends on: 2070920
Depends on: 2070923
Depends on: 2070924
Depends on: 2070925
Depends on: 2070926
Depends on: 2070932
Depends on: 2070933
Depends on: 2070936
Depends on: 2070937
Depends on: 2070955
Depends on: 2070970

No failure on try. Bug 1607636, cited by one of them, is a general intermittent
rather than a tsan defect; Bug 1591064 is a task about enabling ToolboxTask
tests on asan.

Bug 1959062's mac skip can never apply on macosx1470-64, whose test set is
cppunittest only, and Bug 2028047 mirrored it onto macOS 15 across every test
carrying it, without evidence for this file.

Keywords: leave-open
Pushed by fqueze@mozilla.com: https://github.com/mozilla-firefox/firefox/commit/0e7fcd812fdd https://hg.mozilla.org/integration/autoland/rev/6cb4fd2f9b69 Stop skipping debugger tests on tsan, asan and mac, r=devtools-reviewers,ochameau.
Depends on: 2071227
Depends on: 2071228
Depends on: 2071230
Depends on: 2071231
Depends on: 2071232
Depends on: 2071233
Depends on: 2071234
Depends on: 2071236
Depends on: 2071237
Depends on: 2071238
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: