1832590 - Add an action task that lets us provide custom arguments to Raptor CI tests

Status: RESOLVED FIXED

(Testing :: Raptor, task, P1)

Description

[Greg Mierzwinski [:sparky]]

This bug is for adding an action task (similar to the gecko-profile one) that would allow us to specify custom arguments/options to include in the task run. This will make it possible for us to debug branch-specific failures further. At the moment, there's no way for us to replicate these failures locally, or on try so we need a way to do debugging on-the-fly within those branches and an action task would provide that capability.

Comment 1

[Kash Shampur [:kshampur] ⌚EST]

Attachment: Bug 1832590 - Add an action task that lets users provide custom arguments to Raptor tests in CI. r?#perftest

This patch adds the ability to pass extra arguments into raptor-browsertime tests in the treeherder interface.
This will be useful for debugging CI specific failures e.g. on specific branches like we've sometimes seen with Beta.

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/3a16cb4731cd
Add an action task that lets users provide custom arguments to Raptor tests in CI. r=perftest-reviewers,taskgraph-reviewers,releng-reviewers,sparky,bhearsum

Comment 3

[Kash Shampur [:kshampur] ⌚EST]

Comment on attachment 9339367 [details]
Bug 1832590 - Add an action task that lets users provide custom arguments to Raptor tests in CI. r?#perftest

Beta/Release Uplift Approval Request

• User impact if declined: None
• Is this code covered by automated tests?: Yes
• Has the fix been verified in Nightly?: Yes
• Needs manual test from QE?: No
• If yes, steps to reproduce:
• List of other uplifts needed: None
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky): This is just a custom action task for raptor-browsertime tests. The action needs to be triggered manually by a user so it is low risk
• String changes made/needed:
• Is Android affected?: No

Comment 4

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/3a16cb4731cd

Comment 5

[Donal Meehan [:dmeehan]]

Comment on attachment 9339367 [details]
Bug 1832590 - Add an action task that lets users provide custom arguments to Raptor tests in CI. r?#perftest

Approved for 115.0 RC1.

Comment 6

[Donal Meehan [:dmeehan]]

https://hg.mozilla.org/releases/mozilla-beta/rev/6c222240ff31