B2G emulator crashtests are marked with T-FAIL even when they were successful

RESOLVED FIXED

Status

Release Engineering
General Automation
RESOLVED FIXED
5 years ago
5 years ago

People

(Reporter: ahal, Assigned: ahal)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Whiteboard: [mozharness])

Attachments

(1 attachment)

(Assignee)

Updated

5 years ago
Component: Reftest → Release Engineering: Automation (General)
Product: Testing → mozilla.org
QA Contact: catlee
Version: unspecified → other
(Assignee)

Updated

5 years ago
Whiteboard: [mozharness]
(Assignee)

Comment 1

5 years ago
Created attachment 705888 [details] [diff] [review]
Patch 1.0 - add crashtest entry to tinderboxprintre

This fixes the problem, but makes me wonder.. Should crashtests be a separate test suite at all? Or should the buildbot-configs just pass in the crashtest manifest to the reftest suite?
Attachment #705888 - Flags: review?(aki)

Comment 2

5 years ago
Comment on attachment 705888 [details] [diff] [review]
Patch 1.0 - add crashtest entry to tinderboxprintre

> This fixes the problem, but makes me wonder.. Should crashtests be a separate test suite at all? Or should the buildbot-configs just pass in the crashtest manifest to the reftest suite?

Possibly.
We've treated crashtests as separate historically, but if refactoring saves us enough it might be worth it.
Attachment #705888 - Flags: review?(aki) → review+
(Assignee)

Comment 3

5 years ago
I'll leave it as is, refactoring doesn't really save anything. I just didn't know how it was normally done.

https://hg.mozilla.org/build/mozharness/rev/7b46580edbc7

For some reason that link isn't showing me the diff, but it's there when I click "diff" on the file. Bug in hgweb?
Status: ASSIGNED → RESOLVED
Last Resolved: 5 years ago
Resolution: --- → FIXED

Comment 4

5 years ago
(In reply to Andrew Halberstadt [:ahal] from comment #3)
> https://hg.mozilla.org/build/mozharness/rev/7b46580edbc7
> 
> For some reason that link isn't showing me the diff, but it's there when I
> click "diff" on the file. Bug in hgweb?

wfm?
(Assignee)

Comment 5

5 years ago
Weird, ctrl-shift-r fixed it. /me shrugs
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.