1814901 - Add documentation for debugging tips for intermittent test failures

Status: RESOLVED FIXED

(Developer Infrastructure :: Firefox Source Docs: Content, task)

Description

[Mike Conley (:mconley) (:⚙️)]

We already have documentation for avoiding intermittents: https://firefox-source-docs.mozilla.org/testing/intermittent/index.html

We should add some documentation for debugging intermittents. The DevTools folk already have such documentation here: https://firefox-source-docs.mozilla.org/devtools/tests/debugging-intermittents.html... maybe we can use that as a starting point.

At the very least, the thing I do want to include in this new documentation is the technique that Florian introduced for using the Profiler as an analysis tool for intermittent test failures: https://docs.google.com/document/d/1xnWaYifFhPDe7agD1cmSlHeHR-sDPIeJ-vd-7g0lym0/edit#heading=h.u0swmx3h6z8

Comment 1

[Sylvestre Ledru [:Sylvestre]]

Florian,
Do you think you could document this ? (or do you know someone who would be a good candidate to do it?)
merci!

Comment 3

[Sylvestre Ledru [:Sylvestre]]

Joel, Sebastian, do you know who could help with this ? thanks

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

Is the goal to move the devtools stuff and Florian's stuff to the same place? Maybe add in pernosco? It should probably be nearby the avoiding intermittents referenced above. I am not sure who would be the best person for this, I guess identifying references to existing documentation and adding links to that would be relatively simple and would probably be a massive improvement over nothing that we have now.

Comment 5

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

We can create a new doc which incorporates the devtools dos + convert the Profiler document to be included in firefox-source-docs.

Comment 6

[Julien Wajsberg [:julienw]]

Attachment: Bug 1814901 - Add some tips to firefox-source-docs about debugging intermittents with the Firefox Profiler r=florian

Comment 7

[Julien Wajsberg [:julienw]]

Attachment: Bug 1814901 - Move the "Debugging Intermittents" documentation to a more central location r=#devtools-reviewers,florian!

Comment 8

[Julien Wajsberg [:julienw]]

Attachment: Bug 1814901 - Add some information about how to profile an xpcshell r=florian!

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/a81a55abb750
https://hg.mozilla.org/integration/autoland/rev/a51d024d52a7
Add some tips to firefox-source-docs about debugging intermittents with the Firefox Profiler r=florian,devtools-reviewers,ochameau
https://github.com/mozilla-firefox/firefox/commit/99b18511f2ca
https://hg.mozilla.org/integration/autoland/rev/dd5130a5a888
Move the "Debugging Intermittents" documentation to a more central location r=necko-reviewers,geckoview-reviewers,owlish,kershaw,ochameau
https://github.com/mozilla-firefox/firefox/commit/9c5ce672938e
https://hg.mozilla.org/integration/autoland/rev/698d436652d4
Add some information about how to profile an xpcshell r=florian

Comment 10

[Cristian Tuns]

https://hg.mozilla.org/mozilla-central/rev/a51d024d52a7
https://hg.mozilla.org/mozilla-central/rev/dd5130a5a888
https://hg.mozilla.org/mozilla-central/rev/698d436652d4