1634126 - Add Fenix to intermittent-failures.html for ui-test intermittents

Status: RESOLVED FIXED

(Tree Management :: Treeherder, enhancement)

Description

[Aaron Train [:aaronmt]]

Originally filed on Github (https://github.com/mozilla/treeherder/issues/6369)

Hey folks,

I'm wondering if/how Fenix can be accomidated as a tree added to the intermittent-failures.html view (or perhaps some entirely different simplified page)?

The setup for Fenix is of course different than from what one would find in the other trees (issues on Github, labelling, and current manual process for filing intermittent failures).

https://treeherder.mozilla.org/#/jobs?repo=fenix

For our team we would be interested in looking at ui-test opt [tier 2] failures and treat them as intermittent. The same graphing would be of interest to us (date of first occurrence, failure count, etc).

I'm curious what kind of support can be added for Fenix, is it possible? If not, I am looking for recommendations on how one might acquire similar data manually then (failure count, first occurrence, etc).

Comment 1

[Sarah Clements [:sclements]]

Since it looks like the sheriffs are already classifying failures, it'll be a simple change to add Fenix to Intermittent Failures View. If there's anything you expect to see but don't, let me know.

Comment 2

[GitHub Bugzilla PR Linker]

Attachment: Link to GitHub pull-request: https://github.com/mozilla/treeherder/pull/6381

Comment 3

[Sarah Clements [:sclements]]

Merged: https://github.com/mozilla/treeherder/commit/2d0ab7d8dbd8f582d0b28814010fb0221daf93f1

It'll be deployed to production on Monday.

Comment 4

[Aaron Train [:aaronmt]]

(In reply to Sarah Clements [:sclements] from comment #1)

Since it looks like the sheriffs are already classifying failures, it'll be a simple change to add Fenix to Intermittent Failures View. If there's anything you expect to see but don't, let me know.

Thanks. I see the change with the deploy. Is there any way to capture a starred intermittent from ui-test opt debug [tier-2 ui-test-x86] ?

Here's an example intermittent: https://treeherder.mozilla.org/#/jobs?repo=fenix&revision=6ad046714dfc6b31c05bf7e4e7f9eeab290fa202&selectedTaskRun=OE1tQYisQMO7vaEhlkfYgg-0

Comment 5

[Sarah Clements [:sclements]]

Ah, so the the manual classification of failures creates a map between a job (task/run) and a bugzilla bug, stored in a table. We have a task that queries bugzilla regularly to retrieve bugs (for the list of suggested bugs to classify the failure to), that we store in another table. The many-to-one relationship between the job and bug_job_map tables is how we derive the failure counts (via a Django/sql query). But we don't have support for bugs filed on Github.

I chatted with :Aryx about it and he said it was agreed upon between the sheriffs and the fenix team not to extend the tooling (it would not be a trivial amount of work to support this). Sorry I missed that detail before - about the specific request for ui-test opt failures.