Closed Bug 1388016 Opened 7 years ago Closed 6 years ago

Add a task for running the mozbase python tests against Python 3

Categories

(Firefox Build System :: General, enhancement)

Product:
Firefox Build System
Component:
General
Type:
enhancement
Priority:
Not set
Severity:
normal

Tracking

(firefox57 wontfix, firefox63 fixed)

Status:
RESOLVED FIXED
Milestone:
mozilla63
Tracking Flags:
Tracking Status
firefox57 --- wontfix
firefox63 --- fixed

People

(Reporter: davehunt, Assigned: davehunt, Mentored)

References

Details

Attachments

(3 files)

Bug 1388016 - Add support for specifying the Python version to use in TaskCluster;
59 bytes, text/x-review-board-request
ahal
: review+
Details
Bug 1388016 - Run mozterm tests against Python 2 and 3;
59 bytes, text/x-review-board-request
ahal
: review+
Details
Bug 1388016 - Run mozbase tests against Python 2 and 3;
59 bytes, text/x-review-board-request
ahal
: review+
Details 
Once bug 1388013 is resolved we should create a new task for running the mozbase Python tests against Python 3. This will allow us to start adding support for Python 3 into our mozbase packages.

Ideally we should avoid duplicating the task definition by generating tasks for Python 2 and 3 at the same time.
I'm currently digging through the taskcluster taskgraph code for other reasons, so I might as well put some links here. The standalone mozbase Python test task is defined here:
https://dxr.mozilla.org/mozilla-central/rev/52285ea5e54c73d3ed824544cef2ee3f195f05e6/taskcluster/ci/source-test/python-tests.yml#82

Some generic info for the 'source-test' task kind is defined in the kind.yml alongside it:
https://dxr.mozilla.org/mozilla-central/source/taskcluster/ci/source-test/kind.yml

Specifically, the kind.yml file instructs the taskgraph to run those task definitions through the source_test transforms:
https://dxr.mozilla.org/mozilla-central/source/taskcluster/taskgraph/transforms/source_test.py

If you wanted to make it so we generated Python 2 + Python 3 tasks from the same task definition, you could do something like the `expand_platforms` transform, which makes a task run on a specified set of platforms:
https://dxr.mozilla.org/mozilla-central/rev/52285ea5e54c73d3ed824544cef2ee3f195f05e6/taskcluster/taskgraph/transforms/source_test.py#78

You could add a field to the `source_test_description_schema` earlier in the file like `python-versions: [int]`. You'd need to add an additional transform function that checked `job['python-versions']` and yielded a task per-version listed there, and use that to add the `--python3` argument to the test command.

Then in the python-tests.yml file you could make individual task types request Python 3 tasks like:
```
python-versions:
    - 2
    - 3
```
Blocks: mozbase-py3
Product: Core → Firefox Build System
Blocks: 1466211
No longer blocks: 1466211
Depends on: 1466211
Assignee: nobody → dave.hunt
Status: NEW → ASSIGNED
Comment on attachment 8986688 [details]
Bug 1388016 - Add support for specifying the Python version to use in TaskCluster;

https://reviewboard.mozilla.org/r/251986/#review258472

Thanks, lgtm!

::: taskcluster/ci/config.yml:8
(Diff revision 1)
>  treeherder:
>      group-names:
>          'cram': 'Cram tests'
>          'js-bench': 'JavaScript shell benchmarks'
>          'mocha': 'Mocha unit tests'
>          'py': 'Python unit tests'

Please remove this group

::: taskcluster/ci/source-test/python.yml:27
(Diff revision 1)
>  taskgraph-tests:
>      description: taskcluster/taskgraph unit tests
> +    python-version:
> +        - 2
>      treeherder:
>          symbol: py(tg)

Might as well remove the `py()` from all these symbols. I'm pretty sure it'll just work with your existing code.

::: taskcluster/taskgraph/transforms/job/python_test.py:33
(Diff revision 1)
> +@run_job_using(
> +    'native-engine',
> +    'python-test',
> +    schema=python_test_schema,
> +    defaults={'python-version': 2, 'subsuite': 'default'})

You can probably remove this, I don't think there are (or will be) any `native-engine` python test tasks. That is only used for things that need to run on physical hardware (like Talos)

::: taskcluster/taskgraph/transforms/source_test.py:109
(Diff revision 1)
> +@transforms.add
> +def split_python(config, jobs):

I guess this is here because it wasn't possible to split a task by the time it got to the code in `python_test.py`?
Attachment #8986688 - Flags: review?(ahal) → review+
Comment on attachment 8986689 [details]
Bug 1388016 - Run mozterm tests against Python 2 and 3;

https://reviewboard.mozilla.org/r/251988/#review258522

::: taskcluster/ci/source-test/python.yml:139
(Diff revision 1)
>  
>  mozterm:
>      description: python/mozterm unit tests
>      python-version:
>          - 2
> +        - 3

Won't make this an issue, but fyi you can use:

    python-version: [2, 3]

if you find that more readable.
Attachment #8986689 - Flags: review?(ahal) → review+
Comment on attachment 8986690 [details]
Bug 1388016 - Run mozbase tests against Python 2 and 3;

https://reviewboard.mozilla.org/r/251990/#review258524

Awesome, thanks! I think this will end up becoming a nice source of [good first bug]! (Assuming there are parts that aren't time sensitive)
Attachment #8986690 - Flags: review?(ahal) → review+
Comment on attachment 8986688 [details]
Bug 1388016 - Add support for specifying the Python version to use in TaskCluster;

https://reviewboard.mozilla.org/r/251986/#review258472

> I guess this is here because it wasn't possible to split a task by the time it got to the code in `python_test.py`?

As far as I could tell, yes. I've just tried implementing this in `python_test.py` and I didn't get the additional tasks generated.
Blocks: 1471171
Pushed by dhunt@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/81962d389280
Add support for specifying the Python version to use in TaskCluster; r=ahal
https://hg.mozilla.org/integration/autoland/rev/09747ac119be
Run mozterm tests against Python 2 and 3; r=ahal
https://hg.mozilla.org/integration/autoland/rev/06fcd1d66bf3
Run mozbase tests against Python 2 and 3; r=ahal
https://hg.mozilla.org/mozilla-central/rev/81962d389280
https://hg.mozilla.org/mozilla-central/rev/09747ac119be
https://hg.mozilla.org/mozilla-central/rev/06fcd1d66bf3
Status: ASSIGNED → RESOLVED
Closed: 6 years ago
status-firefox63: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla63
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: