1538735 - [Tracking] FIC and TWC on buildduty-tools.

Status: RESOLVED INVALID

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Danut Labici [:dlabici]]

This is a tracking bug for all the tasks that we are required to do in order to get FIC [1] and TWC [2] running on buildduty tools server.

[1] https://github.com/mozilla-releng/firefox-infra-changelog
[2] https://github.com/Akhliskun/taskcluster-worker-checker

Comment 1

[Roland Mutter Michael (:rmutter)]

Attachment: patch.txt

This patch adds the logic for cloning the repo and creating the cron job for it. According to my logic, we also have to create a new folder under \build-puppet\modules\buildduty_tools named templates (currently there is none) where the following attachment should stay (the cron itself)

Comment 2

[Roland Mutter Michael (:rmutter)]

Attachment: firefoxinfrachangelog.cron.erb

This should stay in \build-puppet\modules\buildduty_tools\templates for the previous logic to work.

Comment 3

[Radu Iman[:riman]]

Attachment: builddutytool-config.patch

• this patch changes the buildduty-ssh-config.erb file to automatically use the correct ssh key for Git repository

Comment 4

[Danut Labici [:dlabici]]

Comment on attachment 9055711 [details] [diff] [review]
builddutytool-config.patch

Review of attachment 9055711 [details] [diff] [review]:
-----------------------------------------------------------------

The identity file, part of the code, is wrong, as we will need to download the key on the machine and then point it to it.
When working with .ssh/config you always point to the private key, not public :)

Comment 5

[Danut Labici [:dlabici]]

Comment on attachment 9053921 [details] [diff] [review]
patch.txt

We will change this to use the `cron { ... }` builtin Puppet function.

Comment 6

[Danut Labici [:dlabici]]

Things are moving along!
We have managed to get FIC up and running under my puppet environment.

As an update, we had to upload the following python packages on our internal pypi

- py-dateutil 2.2 (whl+ tar.gz)
- requests 2.21.0 (whl + tar.gz)
- GitPython 2.1.11 (whl + tar.gz)
- wrapt 1.10.11 (tar.gz)
- Click 7.0 (whl)

- PyGithub (1.43.7 (tar.gz)
-- Deprecated 1.2.5 (whl + tar.gz) 
-- PyJWT 1.7.1 (tar.gz)

- github3.py 1.3.0 (whl + tar.gz)
-- gitdb2 2.0.5 (whl + tar.gz)
--- smmap2 2.0.5 (whl + tar.gz)
-- uritemplate 3.0.0 (whl + tar.gz)
-- jwcrypto 0.6.0 (whl + tar.gz)

Comment 7

[Jordan Lund (:jlund)]

all releng aws hosts have been shutdown so FIC and TWC no longer apply