1321953 - MozReview should not count failed excluded jobs

Status: RESOLVED DUPLICATE of bug 1261469

(Conduit Graveyard :: Transplant, defect)

Description

[Masatoshi Kimura [:emk]]

STR:
1. Open https://reviewboard.mozilla.org/r/97302/diff/2#index_header

AR:
MozReview claims
> 413 jobs success,19 jobs testfailed

But I do not see any failed jobs when I click "See it in Treeherder". If I click "Excluded Jobs" on treeherder, it will show the failed jobs. But excluded jobs are excluded because they are expected to fail. So it should not obstruct landing.

Comment 1

[Masatoshi Kimura [:emk]]

This bug will obstruct landing my patch again (in bug 1322646).
I reported three bugs to the MozReview product (this bug, bug 1316227, and bug 1321699). But all of them had no activities at all since reported.

I seriously consider to stop using MozReview. Really frustrating.

Comment 2

[Masatoshi Kimura [:emk]]

Just in case, have you ever seen this bug? If not, what I should have done to file MozReview bugs?

Comment 3

[Gregory Szorc [:gps]]

You are filing bugs in the correct component. From my casual following of that bug product, usually there is a response to bugs within a day or two. I'm not sure why you are having bad luck :/

I'm not really doing MozReview development any more.

I would encourage you to escalate MozReview complaints to mcote. I've needinfo'd him here.

Comment 4

[Mark Côté [:mcote]]

Sorry, with the All Hands last week we have been slow to reply to issues, and a lot of us are on PTO this week.

The message from Try is informational only.  It does not prevent you from autolanding.  That said, I agree that the UI should not include, or should clarify, excluded results.

We are doing some major work on autoland in Q1 and will be addressing a lot of UI issues.  We'll be sure to include this.

Comment 5

[Steven MacLeod [:smacleod]]

This was arguably a treeherder bug, though we'll want to make sure information we expose about test runs in Lando has a good UX. This case is already tracked by Bug 1261469 though so duplicating.