1903320 - Create dedicated task routes for Pernosco

Status: ASSIGNED

(Firefox Build System :: Task Configuration, task)

Description

[Andrew Halberstadt [:ahal]]

The Pernosco service interfaces with Firefox-CI via pulse exchanges. Currently, they listen to all tasks on the taskcluster-queue/v1/task-completed exchange, grab the task definition and filter out to only the tasks that are supported then run their analysis on them.

However, this means their consumers need to process ~10k tasks per hour and if their consumers ever fall over or there's some network problems preventing messages from being delivered, it starts to cause problems in our RabbitMQ instances which can bring the whole Firefox-CI Taskcluster instance to a halt. We're planning some longer term improvements to make sure this won't happen.

But in the shorter term, a simpler thing we can do is to create a dedicated pernosco route on only the tasks that are supported, and only when the PERNOSCO env is enabled. This should reduce the volume of tasks from many tens of thousands of tasks per day, to merely dozens. In effect, it would be moving the logic around which tasks to run the analysis on from the Pernosco side over to the Mozilla side.

The Pernosco pulse consumers would need to be updated to use this new exchange rather than the queue service's exchange. Though we can leave the PERNOSCO env in place for now to preserve backwards compatibility such that the Pernosco consumers can be updated at a later time.

Comment 1

[Andrew Halberstadt [:ahal]]

This is blocked on https://github.com/taskcluster/taskcluster/pull/7069/files being deployed to fxci (currently scheduled June 27th, 2024).