1188473 - Create a gatekeeper Jenkins job to run the brick test

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::UI Tests, defect)

Description

[Johan Lorenzo [:jlorenzo]]

The brick test was implemented in bug 1139083, let's create a new jenkins job that runs right after the download build and then run the other job if it passes.

Comment 1

[Johan Lorenzo [:jlorenzo]]

Review of the brick jobs.

Jobs also triggers jobs that are neither in bitbar nor the brick test. So, for the Mountain View lab, the brick test would be ineffective.
* http://jenkins1.qa.scl3.mozilla.com/job/flame-kk.mozilla-central.nightly.download/
* http://jenkins1.qa.scl3.mozilla.com/job/flame-kk.b2g-inbound.tinderbox.download/
* http://jenkins1.qa.scl3.mozilla.com/job/flame-kk.mozilla-central.tinderbox.download/

Jobs that are okay to me:
* http://jenkins1.qa.scl3.mozilla.com/job/flame-kk.mozilla-inbound.tinderbox.download/
* http://jenkins1.qa.scl3.mozilla.com/job/flame-kk-spark.mozilla-central.nightly.download.tc/

These brick jobs are executed against Bitbar, even though bitbar is not mentioned in the name:
* http://jenkins1.qa.scl3.mozilla.com/job/flame-kk-319.mozilla-inbound.tinderbox.ui.brick.sanity/
* http://jenkins1.qa.scl3.mozilla.com/job/flame-kk-319.b2g-inbound.tinderbox.ui.brick.bitbar/
* http://jenkins1.qa.scl3.mozilla.com/job/flame-kk-319.mozilla-central.tinderbox.ui.brick/
* http://jenkins1.qa.scl3.mozilla.com/job/flame-kk-319.mozilla-central.nightly.ui.brick/ 
* http://jenkins1.qa.scl3.mozilla.com/job/flame-kk-spark-319.mozilla-central.nightly.ui.brick.spark/

After taking a closer look, even the jobs that have an actual "bitbar" sibling, also run the brick test on bitbar. That's problematic we want to make sure that the bitbar is failing but not the lab, or the other way around.

I think "sanity" is not necessary at the end of http://jenkins1.qa.scl3.mozilla.com/job/flame-kk-319.mozilla-inbound.tinderbox.ui.brick.sanity/
Same thing for http://jenkins1.qa.scl3.mozilla.com/job/flame-kk-spark-319.mozilla-central.nightly.ui.brick.spark/

Comment 2

[Johan Lorenzo [:jlorenzo]]

Note: Bitbar hasn't been flaky for the last 3 days. That brick test passed[1], so the smoke job[2] was triggered without any action from my side. As a consequence, unlike I said on Friday, I didn't change any brick job today. :Silne30, you can change every job mentioned in comment 1.

[1] http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.brick/12/
[2] http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.smoke/404

Comment 3

[John Dorlus [:Silne30]]

Hey johan. Thanks for looking into these. The jobs are still failing but they are set up correctly now. Clearing NI.

Comment 4

[Martijn Wargers (dead)]

Yes, that's due to bug 1198950.
Since the brick has been fixed, there are some green runs, but still failures because of bug 1198950.
http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.brick/
http://jenkins1.qa.scl3.mozilla.com/view/Bitbar/job/flame-kk-319.b2g-inbound.tinderbox.ui.brick.bitbar/
http://jenkins1.qa.scl3.mozilla.com/view/Bitbar/job/flame-kk-319.mozilla-central.nightly.ui.brick.bitbar/

Comment 5

[Johan Lorenzo [:jlorenzo]]

The effect seen in bug 1198950 doesn't seem to appear very constantly. I finished up the brick job configuration. At that time, no test is red[1].

Closing this bug, as the configuration is done.

[1] http://jenkins1.qa.scl3.mozilla.com/view/Brick/