Closed Bug 1402457 Opened 7 years ago Closed 7 years ago

Run buildbot's periodic_file_update job scheduled via taskcluster.

Categories

(Firefox Build System :: Task Configuration, task)

task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED
mozilla58

People

(Reporter: Callek, Assigned: Callek)

References

Details

Attachments

(4 files)

This bug will be 2 parts:
* Create a kind/task that can schedule in buildbot periodic file update jobs (to update hsts hpkp and blocklist)
* Create the cron.yml entry to actually schedule these, and the relevant target_tasks method.

This is so that we can do the hsts/hpkp scheduling via taskcluster, we need the job defined to do so.
Assignee: nobody → bugspam.Callek
Comment on attachment 8911911 [details]
Bug 1402457 - Actually schedule periodic file updates.

https://reviewboard.mozilla.org/r/183314/#review188886
Attachment #8911911 - Flags: review?(dustin) → review+
Comment on attachment 8911347 [details]
Bug 1402457 - Add periodic file update task, but don't run it yet.

https://reviewboard.mozilla.org/r/182808/#review188884

::: taskcluster/taskgraph/transforms/job/buildbot.py:37
(Diff revision 1)
> +    run = job['run']
> +    worker = taskdesc['worker']
> +    branch = config.params['project']
> +    product = run['product']
> +
> +    worker.pop('env', None)

Is something setting `env` here?  That's sort of unfortunate..
Attachment #8911347 - Flags: review?(dustin) → review+
Comment on attachment 8911347 [details]
Bug 1402457 - Add periodic file update task, but don't run it yet.

https://reviewboard.mozilla.org/r/182808/#review188884

> Is something setting `env` here?  That's sort of unfortunate..

It was actually done in the mozharness BBB section which I copied, I just tested that its not needed here, so I removed it entirely.
Pushed by Callek@gmail.com:
https://hg.mozilla.org/integration/autoland/rev/7b7658f89b02
Add periodic file update task, but don't run it yet. r=dustin
https://hg.mozilla.org/integration/autoland/rev/1009ff962050
Actually schedule periodic file updates. r=dustin
I was asked by Callek to disable this cron job for now due to some unforeseen issues with the amount of work it's doing.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Target Milestone: mozilla58 → ---
Pushed by ryanvm@gmail.com:
https://hg.mozilla.org/mozilla-central/rev/935eca685536
Disable the TC periodic-update cron job due to more work being scheduled than expected. r=Callek, a=me
This reverts RyanVM's `when` clearing that I requested, and fixes the underlying issue.
Attachment #8916078 - Flags: review?(aki)
Attachment #8916078 - Flags: review?(aki) → review+
Pushed by Callek@gmail.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/f6f706a84c45
fix the file update target task to not schedule the world. r=aki
https://hg.mozilla.org/mozilla-central/rev/f6f706a84c45
Status: REOPENED → RESOLVED
Closed: 7 years ago7 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla58
Comment on attachment 8917524 [details] [diff] [review]
[bb-configs] Disable the daily-* scheduler, which only schedules periodic file updates.

universal_master_sqlite.cfg needs to be modified too
Attachment #8917524 - Flags: review?(kmoir) → review+
Depends on: 1412602
Product: TaskCluster → Firefox Build System
You need to log in before you can comment on or make changes to this bug.