1060189 - Mochitests should only use the tbplformatter for automation

Status: NEW

(Testing :: Mochitest, defect, P4)

Description

[Chris Manchester (limited bugmail, email directly)]

From bug 1045525 - the mochitest's formatter is really only needed for automation code paths. The mach formatter is probably an appropriate default for running locally.

Comment 1

[Ahmed Kachkach [:akachkach]]

I'm all for this. The mach formatter supports output coloring and has a great failure summary. (we should remove that from mochitest/mach_commands.py:384 by the way, to avoid duplicated reporting)

I think that with bug 1045525, the tbpl formatter is dynamically "replaced" by the custom mochitest tbpl formatter? When that lands we'll just have to add --log-tbpl=- in the command line arguments, and use {'mach': sys.stdout} when setting up the logger.

Comment 2

[Chris Manchester (limited bugmail, email directly)]

Attachment: Make mach formatter the default for mochitests, put tbpl formatter in the tree config.

Here's the patch that does this. I'm a bit concerned this will be perceived as a regression by those running tests locally because the mach formatter doesn't print passing subtests.

Maybe it's time to add a verbosity option to our formatters?

Comment 3

[Chris Manchester (limited bugmail, email directly)]

I'm not planning to pursue this.