1213346 - [sync] Run mozilla-en-US script on Heroku

Status: RESOLVED FIXED

(Webtools Graveyard :: Pontoon, defect, P2)

Description

[Osmose [:osmose, :mkelly]]

We're currently keeping the dev server around to run the mozilla-en-US script for creating the en-US mozilla-central repos. With the advent of parallel syncing upon us, would it be possible to run the script on the sync workers as well? We could schedule it to be queued on the half-hours so that it doesn't interfere with sync.

mathjazz: Thoughts?

Comment 1

[Osmose [:osmose, :mkelly]]

CC fox2mike since resolving this would allow us to decommission the old Pontoon dev server.

Comment 2

[Matjaz Horvat [:mathjazz]]

The script doesn't push changes very often, as you can see from the log:
http://hg.mozilla.org/users/m_owca.info/firefox-aurora/

It only does that on a merge days (every 6 weeks) and on string freeze breaks. So even running it once a day would be good enough for our current sync frequency.

That being said, we should still try to figure out how often does the worker loose non-persistent storage. Every time it has to clone huge mozilla-aurora (or -beta or -central) repository instead of pull, a pony dies.

Comment 3

[Matjaz Horvat [:mathjazz]]

The SCL3 data center will be shutting down at the end of Q2. We either need to fix this bug by then or fix bug 1385834.

Fixing bug 1385834 is the proper solution, because it means we no longer need to run the job.

In case we won't be ready by then, I'm keeping this one open. It should be pretty straightforward, especially now that gecko-strings is used as the source repository instead of the massive mozilla-central.

Comment 4

[GitHub Bugzilla PR Linker]

Attachment: Link to GitHub pull-request: https://github.com/mozilla/pontoon/pull/925

Comment 5

[Matjaz Horvat [:mathjazz]]

The script is now running on Heroku at :00, :20 and :40.

The script on the old server is disabled.

I'll be watching closely for a few days and if all goes well, I'll tell IT pontoon1.dev.webapp.scl3.mozilla.com is ready to be decommissioned.