1240723 - head and tail entries mandatory for remote xpcshell tests on B2G

Status: RESOLVED FIXED

(Testing :: General, defect)

Description

[Andreas Tolfsen ❲:ato❳]

The `head` and `tail` configuration entries on the manifest .ini file for remote xpcshell tests on B2G are mandatory:

 20:40:29     INFO -  KeyError: 'head'
 20:40:29     INFO -  Traceback (most recent call last):
 20:40:29     INFO -    File "runtestsb2g.py", line 142, in run_remote_xpcshell
 20:40:29     INFO -      **vars(options)):
 20:40:29     INFO -    File "/builds/slave/test/build/tests/xpcshell/runxpcshelltests.py", line 1436, in runTests
 20:40:29     INFO -      raise exceptions[0]
 20:40:29     INFO -  KeyError: 'head'
 20:40:29     INFO -  Automation Error: Exception caught while running tests
 20:40:34     INFO - Return code: 1

The tests run fine without these on desktop, so I’d expect them not to be mandatory.

Comment 1

[Andreas Tolfsen ❲:ato❳]

 20:40:29     INFO -  Traceback (most recent call last):
 20:40:29     INFO -    File "/builds/slave/test/build/tests/xpcshell/runxpcshelltests.py", line 166, in run
 20:40:29     INFO -      self.run_test()
 20:40:29     INFO -    File "/builds/slave/test/build/tests/xpcshell/runxpcshelltests.py", line 622, in run_test
 20:40:29     INFO -      head_files, tail_files = self.getHeadAndTailFiles(self.test_object)
 20:40:29     INFO -    File "/builds/slave/test/build/tests/xpcshell/remotexpcshelltests.py", line 107, in getHeadAndTailFiles
 20:40:29     INFO -      return (list(sanitize_list(test['head'], 'head')),
 20:40:29     INFO -  KeyError: 'head'

Comment 2

[Andreas Tolfsen ❲:ato❳]

As gijs pointed out, https://hg.mozilla.org/mozilla-central/rev/7f7abc547fb9 doesn’t agree with the remote version in https://dxr.mozilla.org/mozilla-central/source/testing/xpcshell/remotexpcshelltests.py#107.  We should harmonise the two to agree.

Comment 3

[Andreas Tolfsen ❲:ato❳]

Attachment: MozReview Request: Bug 1240723 - Harmonise xpcshell head- and tail list computation; r?ted

Head- and tail entries in manifest files are not mandatory on
local/desktop xpcshell tests, and they should not be on remote/B2G either.

This change makes remotexpcshelltests and runxpcshelltests agree on how
to get head- and tail files.

Review commit: https://reviewboard.mozilla.org/r/31433/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/31433/

Comment 4

[(not currently active) Ted Mielczarek]

Comment on attachment 8709413 [details]
MozReview Request: Bug 1240723 - Harmonise xpcshell head- and tail list computation; r?ted

https://reviewboard.mozilla.org/r/31433/#review28155

::: testing/xpcshell/remotexpcshelltests.py:94
(Diff revision 1)
> +        """

The docstring comment could be *slightly* clearer, maybe "Returns a tuple containing a list of head files and a list of tail files."

::: testing/xpcshell/remotexpcshelltests.py:96
(Diff revision 1)
> -            for f in s.strip().split(' '):
> +            for f in s.strip().split(" "):

We appear to be super inconsistent about what type of quotes to use in this file, but our unofficial style is single quotes.

::: testing/xpcshell/runxpcshelltests.py:394
(Diff revision 1)
> -        """Obtain the list of head and tail files.
> +        """Obtain lists of head- and tail files.  Returns a tuple of head-

It sure would be nice if we could make these use the same code instead of doing the exact same thing but joining the file paths with a different base path. You don't have to fix that, it just makes me sad.

Comment 5

[Andreas Tolfsen ❲:ato❳]

https://reviewboard.mozilla.org/r/31433/#review28155

> The docstring comment could be *slightly* clearer, maybe "Returns a tuple containing a list of head files and a list of tail files."

Fixed.

> We appear to be super inconsistent about what type of quotes to use in this file, but our unofficial style is single quotes.

Fixed up both functions.

> It sure would be nice if we could make these use the same code instead of doing the exact same thing but joining the file paths with a different base path. You don't have to fix that, it just makes me sad.

Ditto.

Comment 6

[Andreas Tolfsen ❲:ato❳]

Comment on attachment 8709413 [details]
MozReview Request: Bug 1240723 - Harmonise xpcshell head- and tail list computation; r?ted

Review request updated; see interdiff: https://reviewboard.mozilla.org/r/31433/diff/1-2/

Comment 7

[Pulsebot]

https://hg.mozilla.org/integration/mozilla-inbound/rev/31f33400c019

Comment 8

[Andreas Tolfsen ❲:ato❳]

Comment on attachment 8709413 [details]
MozReview Request: Bug 1240723 - Harmonise xpcshell head- and tail list computation; r?ted

Review request updated; see interdiff: https://reviewboard.mozilla.org/r/31433/diff/2-3/

Comment 9

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/31f33400c019