1406160 - Reftest suite-start message contains all tests, even when chunked

Status: RESOLVED FIXED

(Testing :: Reftest, enhancement)

Description

[Geoff Brown [:gbrown]]

When reftests are chunked, the list of tests logged in the suite-start message contains all of the reftests found in all manifests -- including tests not part of the chunk being run. This contributes to the excessive length of the suite-start message noted in bug 1324961.

Comment 1

[Geoff Brown [:gbrown]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=1c5ac76b47153bd07cedeb5fa5c20b236aff93ee

Comment 2

[Geoff Brown [:gbrown]]

Attachment: report tests accurately in chunked reftest suite-start

This reduces the length of the suite-start message to 1/(total-chunks)'th the current length, and accurately reports the tests actually run in the chunk.

https://treeherder.mozilla.org/#/jobs?repo=try&revision=423def6405e1b065cfe0ea76fee9ed275a9735bc

Comment 3

[Andrew Halberstadt [:ahal]]

Comment on attachment 8915778 [details] [diff] [review]
report tests accurately in chunked reftest suite-start

Review of attachment 8915778 [details] [diff] [review]:
-----------------------------------------------------------------

Thanks! Looks good, please fix the issue before landing.

::: layout/tools/reftest/reftest.jsm
@@ +593,5 @@
> +
> +                if (gURLs[i].needsFocus && !Focus())
> +                    continue;
> +
> +                if (gURLs[i].slow && !gRunSlowTests)

We don't need to check for these conditions here. I think it was actually a bug that they weren't being logged as part of "suite_start" before. Removing these also means we could use 'gURLs.map(...)' instead of a for loop.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/ad66d82161cf
Adjust chunked reftest suite_start to only report tests run in chunk; r=ahal

Comment 5

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/ad66d82161cf