1857600 - automatically ignore tasks for unsupported branches of github projects without the use of a manual list

Status: NEW

(Tree Management :: Treeherder: Data Ingestion, task)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

• Treeherder either only ingests tasks for pushes to branches on an allowlist (think main etc.) or all of them (even if does not ingest every branch). The list of the repositories for the former is manually maintained. The former is done to save resources.
• For the filtering, it gets MOBILE_BASE_REPOSITORY and MOBILE_HEAD_REPOSITORY to detect PRs (and ignore them) and also fetches MOBILE_HEAD_REF.
• application-services uses APPSERVICES_ instead of MOBILE_

The repositories.json file already defines the branches which get ingested and tasks should be ingested based on this without the need for a list of repositories which shall be checked for this.

bhearsum explained one can reply on only one *_BASE_REPOSITORY (etc.) variable being included in the task payload (and cycle over all variables to find them). Taskcluster reads the values here.

Comment 1

[Alex [:moijes12]]

Sebastian

For the generic implementation, what would be the preferred way (or a method recommended/followed in mozilla) to retrieve the branch from a task payload across all projects? Should I rely on the decision_task routes/scopes (which is currently used as a fallback in handler.py
), or is there a specific field in the task payload that is guaranteed to be present for all repositories?

Comment 2

[Alex [:moijes12]]

Attachment: GitHub Pull Request

Fix for issue