1166745 - Nightly builds running on b2g-inbound

Status: RESOLVED FIXED

(Taskcluster :: General, defect, P1)

Description

[Wander Lairson Costa]

As b2g-inbound job flags inherit from mozilla-central, we are running nightly builds on b2g-inbound, wasting instance resources.

Comment 1

[Wander Lairson Costa]

http://docs.taskcluster.net/tools/task-graph-inspector/#hUEREeGfQI209UJ7ich2zA

Comment 2

[Wander Lairson Costa]

Attachment: MozReview Request: bz://1166745/wcosta

/r/9123 - Bug 1166745: Disable nightly tasks in b2g-inbound.

Pull down this commit:

hg pull -r 96bf34d76b1a477fc14cc072c92ae6f3ab18c71a https://reviewboard-hg.mozilla.org/gecko/

Comment 3

[Greg Arndt [:garndt]]

Comment on attachment 8608144 [details]
MozReview Request: bz://1166745/wcosta

https://reviewboard.mozilla.org/r/9121/#review7777

::: testing/taskcluster/tasks/branches/b2g-inbound/job_flags.yml:101
(Diff revision 1)
> +  gaia-ui-test-functional:

This also appears below (for the test suite that was originally part of b2g-inbound's job flags list)

::: testing/taskcluster/tasks/branches/b2g-inbound/job_flags.yml:107
(Diff revision 1)
> +  gaia-ui-test-unit:

This also appears below (for the test suite that was originally part of b2g-inbound's job flags list)

Comment 4

[Greg Arndt [:garndt]]

Comment on attachment 8608144 [details]
MozReview Request: bz://1166745/wcosta

r+ as long as the gaia-ui-test-functional and gaia-ui-test-unit tests get combined.  Because they existed in b2g-i prior to merging the m-c tasks in, you have them twice and only the second ones get scheduled.

Please fix, and push to try.

Comment 5

[Greg Arndt [:garndt]]

sorry, not try, push a graph to TC :)

Comment 6

[Wander Lairson Costa]

(In reply to Greg Arndt [:garndt] from comment #3)
> Comment on attachment 8608144 [details]
> MozReview Request: bz://1166745/wcosta
> 
> https://reviewboard.mozilla.org/r/9121/#review7777
> 
> ::: testing/taskcluster/tasks/branches/b2g-inbound/job_flags.yml:101
> (Diff revision 1)
> > +  gaia-ui-test-functional:
> 
> This also appears below (for the test suite that was originally part of
> b2g-inbound's job flags list)
> 
> ::: testing/taskcluster/tasks/branches/b2g-inbound/job_flags.yml:107
> (Diff revision 1)
> > +  gaia-ui-test-unit:
> 
> This also appears below (for the test suite that was originally part of
> b2g-inbound's job flags list)

ok, fixed.

Comment 7

[Wander Lairson Costa]

http://docs.taskcluster.net/tools/task-graph-inspector/#ywgthOnDSieFVILH5_BSdw/28Pe4cHcSouTbh67kUw5wQ

Comment 8

[Wander Lairson Costa]

Comment on attachment 8608144 [details]
MozReview Request: bz://1166745/wcosta

/r/9123 - Bug 1166745: Disable nightly tasks in b2g-inbound.

Pull down this commit:

hg pull -r d75ce667a5c368704dd1deda3548d459faccdc29 https://reviewboard-hg.mozilla.org/gecko/

Comment 9

[Wander Lairson Costa]

Comment on attachment 8608144 [details]
MozReview Request: bz://1166745/wcosta

/r/9123 - Bug 1166745: Disable nightly tasks in b2g-inbound.

Pull down this commit:

hg pull -r 183d190a3500e56350269bca06851e9583ccf71c https://reviewboard-hg.mozilla.org/gecko/

Comment 10

[Greg Arndt [:garndt]]

Comment on attachment 8608144 [details]
MozReview Request: bz://1166745/wcosta

https://reviewboard.mozilla.org/r/9121/#review7905

Ship It!

Comment 11

[Wander Lairson Costa]

https://hg.mozilla.org/integration/b2g-inbound/rev/04cb8c5a3270

Comment 12

[Phil Ringnalda (:philor)]

https://hg.mozilla.org/mozilla-central/rev/04cb8c5a3270

Comment 13

[Wander Lairson Costa]

https://hg.mozilla.org/integration/b2g-inbound/rev/328baf667e38

Comment 14

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/mozilla-central/rev/328baf667e38

Comment 15

[Wander Lairson Costa]

Attachment: MozReview Request: Bug 1166745: Avoid name clashes in taskcluster index.

Bug 1166745: Reorganize tasks.

- Rename nightly -> ota.
- Rename lightsaber -> spark.
- Add flame kk debug tasks.
- Add aries build tasks in treeherder.
- Add aries to try.
- Add fx-team and inbound tasks.
- Only run OTA build on m-c.

Comment 16

[Wander Lairson Costa]

http://docs.taskcluster.net/tools/task-graph-inspector/#PTrOaLy8TFGOKsTE1UPfaw
http://docs.taskcluster.net/tools/task-graph-inspector/#VpTKqtEkTn6GGCKHlS4HXQ

Comment 17

[Greg Arndt [:garndt]]

Comment on attachment 8612325 [details]
MozReview Request: Bug 1166745: Avoid name clashes in taskcluster index.

Hrm, it looks like I was reviewing an obsolete one on the other bug.  I'm copying/pasting my comments here.  I'm curious about the inbound job flags vs base job flags.


::: testing/taskcluster/scripts/phone-builder/build-spark-ota.sh:1
(Diff revision 1)
> +#!/bin/bash -vex

So it looks like this script does very similar things as build-phone-ota.sh except for a different mozharness config.  Perhaps in the future we could look at what dustin and morgan are doing with supplying the configs as ENV variables and then constructing them when running mozharness.

https://dxr.mozilla.org/mozilla-central/source/testing/docker/desktop-build/bin/build.sh#128

::: testing/taskcluster/tasks/branches/inbound/job_flags.yml:1
(Diff revision 1)
> +---

What will this file be used for? Looks like it was added but not used for anything and it just inherits from base_jobs.yml like everything else.

::: testing/taskcluster/tasks/branches/base_jobs.yml:1
(Diff revision 1)
> +---

Perhaps we want to update the mach stuff to default to use base_jobs.yml instead of mozilla-central/job_flags.yml when no project is given or recognized.

::: testing/taskcluster/tasks/builds/b2g_flame_kk_ota_debug.yml:9
(Diff revision 1)
> +  workerType: balrog

This could be removed, it's in the base yml

Comment 18

[James Lal [:lightsofapollo]]

Comment on attachment 8612325 [details]
MozReview Request: Bug 1166745: Avoid name clashes in taskcluster index.

https://reviewboard.mozilla.org/r/9123/#review8345

Ship It!

Comment 19

[Wander Lairson Costa]

(In reply to Greg Arndt [:garndt] from comment #17)
> Comment on attachment 8612325 [details]
> MozReview Request: Bug 1166745: Reorganize tasks.
> 
> Hrm, it looks like I was reviewing an obsolete one on the other bug.  I'm
> copying/pasting my comments here.  I'm curious about the inbound job flags
> vs base job flags.
> 
> 
> ::: testing/taskcluster/scripts/phone-builder/build-spark-ota.sh:1
> (Diff revision 1)
> > +#!/bin/bash -vex
> 
> So it looks like this script does very similar things as build-phone-ota.sh
> except for a different mozharness config.  Perhaps in the future we could
> look at what dustin and morgan are doing with supplying the configs as ENV
> variables and then constructing them when running mozharness.
> 
> https://dxr.mozilla.org/mozilla-central/source/testing/docker/desktop-build/
> bin/build.sh#128
> 

This is being worked out in bug 1164194.

> ::: testing/taskcluster/tasks/branches/inbound/job_flags.yml:1
> (Diff revision 1)
> > +---
> 
> What will this file be used for? Looks like it was added but not used for
> anything and it just inherits from base_jobs.yml like everything else.
> 

While working on it, I just didn't stop to think if it's worth merging it into base_jobs.yml.

> ::: testing/taskcluster/tasks/branches/base_jobs.yml:1
> (Diff revision 1)
> > +---
> 
> Perhaps we want to update the mach stuff to default to use base_jobs.yml
> instead of mozilla-central/job_flags.yml when no project is given or
> recognized.
> 
> ::: testing/taskcluster/tasks/builds/b2g_flame_kk_ota_debug.yml:9
> (Diff revision 1)
> > +  workerType: balrog
> 
> This could be removed, it's in the base yml

Ok.

Comment 20

[Wander Lairson Costa]

Comment on attachment 8612325 [details]
MozReview Request: Bug 1166745: Avoid name clashes in taskcluster index.

Bug 1166745: Reorganize tasks.

- Rename nightly -> ota.
- Rename lightsaber -> spark.
- Add flame kk debug tasks.
- Add aries build tasks in treeherder.
- Add aries to try.
- Add fx-team and inbound tasks.
- Only run OTA build on m-c.

Comment 21

[Greg Arndt [:garndt]]

Comment on attachment 8612325 [details]
MozReview Request: Bug 1166745: Avoid name clashes in taskcluster index.

https://reviewboard.mozilla.org/r/9123/#review8353

Ship It!

Comment 22

[Wander Lairson Costa]

Comment on attachment 8612325 [details]
MozReview Request: Bug 1166745: Avoid name clashes in taskcluster index.

Bug 1166745: Reorganize tasks.

- Rename nightly -> ota.
- Rename lightsaber -> spark.
- Add flame kk debug tasks.
- Add aries build tasks in treeherder.
- Add aries to try.
- Add fx-team and inbound tasks.
- Only run OTA build on m-c.

Comment 23

[Greg Arndt [:garndt]]

Comment on attachment 8612325 [details]
MozReview Request: Bug 1166745: Avoid name clashes in taskcluster index.

https://reviewboard.mozilla.org/r/9123/#review8359

Ship It!

Comment 24

[Wander Lairson Costa]

https://hg.mozilla.org/integration/b2g-inbound/rev/8c405367bfc6

Comment 25

[Wander Lairson Costa]

Comment on attachment 8612325 [details]
MozReview Request: Bug 1166745: Avoid name clashes in taskcluster index.

Bug 1166745: Avoid name clashes in taskcluster index.

Call ota builds <phone>-ota to avoid name clashes with non-ota builds.

Comment 26

[James Lal [:lightsofapollo]]

https://reviewboard.mozilla.org/r/9121/#review8383

Comment 27

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/mozilla-central/rev/8c405367bfc6

Comment 29

[Wander Lairson Costa]

Attachment: MozReview Request: Bug 1166745: Avoid name clashes in taskcluster index.

Comment 30

[Pete Moore [:pmoore][:pete]]

Resetting Version and Target Milestone that accidentally got changed...