1573418 - Run Talos harness tests in CI

Status: RESOLVED FIXED

(Testing :: Talos, task, P2)

Description

[Dave Hunt [:davehunt] [he/him] ⌚BST]

The Talos harness tests are not currently running in CI. We should clean these up and get them running whenever a change is made to testing/talos. We can use the Raptor harness tests as an example: https://searchfox.org/mozilla-central/rev/30b01f4f60dbcbd6b01500a26b3100c28005cf62/taskcluster/ci/source-test/python.yml#203-216

Comment 1

[Robert Wood [:rwood]]

Talos unit tests are found here:

https://searchfox.org/mozilla-central/source/testing/talos/talos/unittests

They could be turned on for Py2 only at the start. In future they can be ported to Python 3 and turned on for Py3.

:bebe is there someone on SV who could pick this up?

Comment 2

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Uhm... :igoldan, is it possible that the duplication of windows10-64-ccov/debug key from taskcluster/ci/talos.yml to cause any talos regressions/failures?

Comment 3

[Ionuț Goldan [:igoldan]]

(In reply to Alexandru Ionescu :alexandrui from comment #2)

Uhm... :igoldan, is it possible that the duplication of windows10-64-ccov/debug key from taskcluster/ci/talos.yml to cause any talos regressions/failures?

Marco, is it possible that those 2 duplicated lines slipped in unintentionally?

Comment 4

[Marco Castelluccio [:marco]]

(In reply to Ionuț Goldan [:igoldan], Performance Sheriff from comment #3)

(In reply to Alexandru Ionescu :alexandrui from comment #2)

Uhm... :igoldan, is it possible that the duplication of windows10-64-ccov/debug key from taskcluster/ci/talos.yml to cause any talos regressions/failures?

Marco, is it possible that those 2 duplicated lines slipped in unintentionally?

Yes, the second should be windows10-64-ccov/opt. I've filed bug 1598437 to fix that.

Comment 5

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Attachment: Bug 1573418 Run Talos harness tests in CI r?#perftest,igoldan

Comment 6

[Alexandru Ionescu (needinfo me) [:alexandrui]]

This possibly depends on 1602775 also.

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/2d73dd4ab498
Run Talos harness tests in CI r=rwood,igoldan,perftest-reviewers

Comment 8

[Cristian Brindusan [:cbrindusan]]

https://hg.mozilla.org/mozilla-central/rev/2d73dd4ab498