1261974 - Setup interim replacement for cruncher

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Chris Cooper [:coop] (he/him)]

cruncher went offline last week, and while we want to fix it properly (https://bugzilla.mozilla.org/show_bug.cgi?id=1235851#c9) we still need some of the data it was providing in the interim.

I have a node setup in AWS, cruncher-aws.build.mozilla.org, that we can use for this. The node is currently attached to my personal puppet env on releng-puppet2.

Comment 1

[Chris Cooper [:coop] (he/him)]

Slave health and allthethings are now updating properly, and the data is being synced through to the releng cluster.

catlee: reportor is running, but it's generating empty js files. Care to have a look on cruncher-aws and see what's wrong? We may need extra network flows that I'm not aware of.

Comment 2

[Chris AtLee [:catlee]]

We need to have crendentials.ini populated with statusdb/schedulerdb credentials.

Also, it looks like we're missing some dependencies: simplejson and sqlalchemy stand out. Are you using the dependencies in setup.py, or managing them separately?

Comment 3

[Chris Cooper [:coop] (he/him)]

(In reply to Chris AtLee [:catlee] from comment #2)
> We need to have crendentials.ini populated with statusdb/schedulerdb
> credentials.
> 
> Also, it looks like we're missing some dependencies: simplejson and
> sqlalchemy stand out. Are you using the dependencies in setup.py, or
> managing them separately?

With catlee's help, I found the missing dependencies and creds. reportor is now running, but I still have some work to do to get its puppet config finished.

Comment 4

[Chris Cooper [:coop] (he/him)]

Attachment: [puppet] Configs for cruncher-aws

cruncher-aws seems to be humming along with these configs. We should get them committed.

Comment 5

[Chris Cooper [:coop] (he/him)]

https://hg.mozilla.org/build/puppet/rev/c986fe048169321ef1d760c66b822fb9c48b4cd3
Bug 1261974 - puppet configs for cruncher-aws - r=kmoir

Comment 6

[Rail Aliiev [:rail]]

Comment on attachment 8752882 [details] [diff] [review]
[puppet] Configs for cruncher-aws

in production https://hg.mozilla.org/build/puppet/rev/481123b31592

Comment 7

[Chris Cooper [:coop] (he/him)]

https://hg.mozilla.org/build/puppet/rev/1a9312975c9d7cc5cbde5cc029f7a372de18204f
Bug 1261974 - fix linting errors - r=bustage