1085729 - --start-at and --end-at options broken for mochitests

Status: RESOLVED FIXED

(Testing :: Mochitest, defect)

Description

[Bill McCloskey [inactive unless it's an emergency] (:billm)]

Attachment: fix-start-at

Something seems to have changed here. This patch fixes the problem.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 8508359 [details] [diff] [review]
fix-start-at

Review of attachment 8508359 [details] [diff] [review]:
-----------------------------------------------------------------

this will work for the regular case, but not for android or some other corner cases with the old manifest format.

::: testing/mochitest/chunkifyTests.js
@@ +71,5 @@
>  function skipTests(tests, startTestPattern, endTestPattern) {
>    var startIndex = 0, endIndex = tests.length - 1;
>    for (var i = 0; i < tests.length; ++i) {
> +    var test_path;
> +    if ('test' in tests[i]) {

I would verifiy tests[i] is of a type object:
http://dxr.mozilla.org/mozilla-central/source/testing/mochitest/manifestLibrary.js#105

@@ +74,5 @@
> +    var test_path;
> +    if ('test' in tests[i]) {
> +      test_path = tests[i]['test']['url'];
> +    } else {
> +      test_path = tests[i]['url'];

I believe this else condition should be:
test_path = tests[i];

do let me know if you have other evidence.

Comment 2

[Bill McCloskey [inactive unless it's an emergency] (:billm)]

I copied this chunk of code from chunkifyTests, which runs on essentially the same data as skipTests. If my patch is wrong, then I think they're both broken.

I started trying to trace through where the data comes from but I gave up.

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 8508359 [details] [diff] [review]
fix-start-at

ok, I went back and looked at this.  It worked fine for me locally and we are almost done deprecating the old format (active work has been done this week in bug 1083347).  Apologies for the confusion.

Comment 4

[Vaibhav (:vaibhav1994)]

Attachment: skiptests.patch

In bug 1089771, I have made changes to chunkifyTests function, and I think we need to do the same for the skipTests function. Attaching a similar patch for it.

:billm, could you upload the patch that uses --start-at and --end-at, so that we can push to try and see if it works fine.

Comment 5

[Bill McCloskey [inactive unless it's an emergency] (:billm)]

These two patches were basically the same so I just landed Vaibhav's.

There aren't any uses of --start-at or --end-at in the tree. It's just a command line option for running tests.

Comment 6

[Bill McCloskey [inactive unless it's an emergency] (:billm)]

https://hg.mozilla.org/integration/mozilla-inbound/rev/cb2065b39352

Comment 7

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/cb2065b39352