1904288 - Allow to skip some tests in the pdfpaint task

Status: RESOLVED FIXED

(Testing :: Talos, task, P3)

Description

[Calixte Denizet (:calixte)]

It'd be nice to be able to skip some tests because they're either useless or too long to run.
For example for an entry in test_manifest.json we could add a property talos (or a better name) set to false when we want to skip it.

Comment 1

[Greg Mierzwinski [:sparky]]

I think adding something to test_manifest.json would be ideal. Let me know when you've added this field, and I can make the changes on our side to take it into account.

Comment 2

[Calixte Denizet (:calixte)]

I added talos: false for a specific test:
https://github.com/mozilla/pdf.js/pull/18341

Comment 3

[Calixte Denizet (:calixte)]

Attachment: Bug 1904288 - Allow to skip some tests in the pdfpaint task r=sparky

Comment 4

[Calixte Denizet (:calixte)]

A try:
https://treeherder.mozilla.org/jobs?repo=try&revision=7c437f40434b24b0b33b530fb4c7826b4804f2d1

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/f2a1d0b442ab
Allow to skip some tests in the pdfpaint task r=sparky

Comment 6

[Norisz Fay [:noriszfay]]

https://hg.mozilla.org/mozilla-central/rev/f2a1d0b442ab

Comment 7

[Norisz Fay [:noriszfay]]

Backed out for causing pdfpaint perma timeout failures

Backout link

Push with failures

Failure log

Comment 8

[Iulian Moraru]

Backout merged to central: https://hg.mozilla.org/mozilla-central/rev/d29bb4b5d463

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a879571cdfa0
Allow to skip some tests in the pdfpaint task r=sparky,perftest-reviewers

Comment 10

[pstanciu]

https://hg.mozilla.org/mozilla-central/rev/a879571cdfa0