1239600 - Get emu-x86-kk Mochitest and crashtest Tier-2 on Treeherder

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, task)

Description

[Hsin-Yi Tsai [:hsinyi]]

We enabled emu-x86-kk Mochitest and Crashtest on Production on Bug 1220631 and Bug 1214475. After a while, these two were hidden due to frequent oranges on bug 1143380 comment 643. Fixing bug 1143380 improves the intermittent failure rate a lot while we still see several issues appearing. To keep stabilizing emu-x86-kk, we'd like to request get these two tests Tier-2 on Treeherder so that test results are visible to the team, and there will be bugs tracking failures that helps us triage them. 

To meet the requirements [1], Ken Chang will be the active owner. These tests are listed in [2].

[1] https://wiki.mozilla.org/Sheriffing/Job_Visibility_Policy#Requirements_for_jobs_shown_in_the_default_Treeherder_view
[2] https://developer.mozilla.org/en-US/docs/Mozilla/QA/Automated_testing

Comment 1

[Hsin-Yi Tsai [:hsinyi]]

Attachment: 1239600.patch - flag tier2 for emu mochitest and crashtest

Hi Greg, could you please help review this for me? Thanks!

Comment 2

[Hsin-Yi Tsai [:hsinyi]]

Hi Phil,
In addition to comment 0, anything needs to be addressed to make these tier-2 on treeherder? Thank you.

Comment 3

[Hsin-Yi Tsai [:hsinyi]]

(In reply to Hsin-Yi Tsai [:hsinyi] from comment #1)
> Created attachment 8707777 [details] [diff] [review]
> 1239600.patch - flag tier2 for emu mochitest and crashtest
> 
> Hi Greg, could you please help review this for me? Thanks!

here's the try push https://treeherder.mozilla.org/#/jobs?repo=try&revision=5fa62c56f66b&exclusion_profile=false

Comment 4

[Phil Ringnalda (:philor)]

Why tier-2?

Comment 5

[Hsin-Yi Tsai [:hsinyi]]

Basically as mentioned in comment 0 - we are keeping stabilizing emu-x96-kk on Treeherder. Towards to the completion of stabilization we understand we need to monitor how it runs on Treeherder, have a way to track failures and the reproduce rate, and address those failures. It would be more effective if we work with Sheriffs as Sheriffs are the one watching Treeherder status closely. According to wiki, tier-2 provides a mechanism which helps this kind of stabilizing stuff. Thanks!

Comment 6

[Hsin-Yi Tsai [:hsinyi]]

https://hg.mozilla.org/integration/b2g-inbound/rev/c2a5f604c552360b2731c4eb2e8ea5c9d0f89415
Bug 1239600 - Get emu-x86-kk Mochitest and crashtest Tier-2 on Treeherder. r=garndt

Comment 7

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/c2a5f604c552