880048 - adjust pig cronjobs to ssh to remote server

Status: VERIFIED FIXED

(Socorro :: Infra, task)

Description

[Robert Helmer [:rhelmer]]

So it turns out we're not going to be able to have socorro admin boxes connect directly to hadoop anymore (except via thrift), tmary suggests having them ssh to the metrics gw boxes instead.

I guess we'll need to also copy the environment over, since it's part of the socorro build.

Comment 1

[Robert Helmer [:rhelmer]]

r? https://github.com/mozilla/socorro/pull/1323

Comment 2

[Robert Helmer [:rhelmer]]

I have set up a temporary crontab for socorro@sp-admin01, until this ships:

--
[[e-mail]1 ~]$ crontab -l
# TEMPORARY for bug 880048 - Correlation report for crash-analysis 
05 00 * * * /home/socorro/cron_modulelist-bug880048.sh
--

Forgetting to remove it will not be fatal but is a waste, so we should remember to do so.

Comment 3

[[github robot]]

Commits pushed to master at https://github.com/mozilla/socorro

https://github.com/mozilla/socorro/commit/941dc1a705def3f9cfc133b9502da742c43112cf
bug 880048 - hadoop jobs now run on remote gateway server

https://github.com/mozilla/socorro/commit/6f773caacf5c1ac0656e9b6cfc6e96a88f54ea22
Merge pull request #1323 from rhelmer/bug880048-remote-hadoop-gw

fixes bug 880048 - hadoop jobs now run on remote gateway server

Comment 4

[Robert Helmer [:rhelmer]]

It looks like this didn't actually happen, see bug 909127

Comment 5

[Robert Helmer [:rhelmer]]

OK so it looks like everything landed here, I just dropped the ball on asking for IT help getting this into prod. Will file a followup for this.

Comment 6

[Matt Brandt [:mbrandt]]

Bumping to verified as [qa-].