1303071 - pulse_actions - Automatic extra talos PGO jobs get stuck in the queue and we can't tell the root issue

Status: RESOLVED FIXED

(Testing :: General, defect)

Description

[Armen [:armenzg]]

Attachment: log from papertrail

What to fix:
1 - Track what kind of request was requested
2 - Track the exception instead of loosing it
3 - A 'Sch' job did not get scheduled

Comment 1

[Armen [:armenzg]]

I got confused thinking that it was a user request.
Instead it was the handler to add more talos jobs for PGO builds.

I've improved the logging to make it easier to notice.

We now don't raise an exception and requeue the message.

There's no need for 'Sch' jobs.

These changes will now enable me to see why the jobs could not be scheduled (I should see the exception being dumped).
https://github.com/mozilla/pulse_actions/commit/b0d588f1b5d788edc551745106a83d369a3516ef
https://github.com/mozilla/mozilla_ci_tools/commit/f9593601b11f098dbe3079c8f68754472e7d82bc

Comment 2

[Armen [:armenzg]]

The message got out of the queue.

I'm calling this fixed for now and file a new bug if the exceptions appear in the logs.