657046 - move private talos bundles to another vhost

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P3)

Description

[Dustin J. Mitchell [:dustin] (he/him)]

We download talos bundles internally (only) from build.mozilla.org.

These should be served from a CNAME, although that can still point to db-wwwbuild01 - bug 604688.

However, can we serve these from bm-remote?

Comment 1

[Chris Cooper [:coop] (he/him)]

Armen: is this obviated by your talos.json work?

Comment 2

[Armen [:armenzg]]

(In reply to Chris Cooper [:coop] from comment #1)
> Armen: is this obviated by your talos.json work?

No, not really.

(In reply to Dustin J. Mitchell [:dustin] from comment #0) 
> However, can we serve these from bm-remote?

Yes, we could.

What is the reason to move them?

Comment 3

[Dustin J. Mitchell [:dustin] (he/him)]

(In reply to Armen Zambrano G. [:armenzg] - Release Engineer from comment #2)
> What is the reason to move them?

I'm no longer in favor of that option.

Comment 4

[Armen [:armenzg]]

RESOLVED INVALID?

Comment 5

[Dustin J. Mitchell [:dustin] (he/him)]

No, the first part still applies

Comment 6

[Dustin J. Mitchell [:dustin] (he/him)]

Oh, I see your confusion.  We need to put these on another vhost, e.g., talos-bundles.pvt.build.mozilla.org, but that shouldn't be hosted on the bm-remote lb.

Comment 7

[Dustin J. Mitchell [:dustin] (he/him)]

There are some crontabs on cruncher to generate the dirty profiles, and then copy those dirty profiles to dm-wwwbuild01 (and now relengweb1).  These crontasks should probably run on the host serving the files, or stick with it in puppet at any rate. (just a note to myself)

Comment 8

[Dustin J. Mitchell [:dustin] (he/him)]

In particular:

(root's crontab)
10 */2 * * * /usr/bin/rsync -a -e 'ssh -i /root/.ssh/id_dsa.syncbld' /var/www/html/talos_profiles/ [e-mail]:/var/www/html/build/talos/profiles/

(talos's crontab)
0 0 * * * (/usr/local/bin/python /home/talos/public_html/updateGenerated.py) >> /home/talos/public_html/reporter.log && mv /home/talos/public_html/dirtyDBs.zip /var/www/html/talos_profiles/. &&  mv /home/talos/public_html/dirtyMaxDBs.zip /var/www/html/talos_profiles/. && cp /var/www/ht

Comment 9

[Dustin J. Mitchell [:dustin] (he/him)]

OK, this is up and running at
 http://talos-bundles.pvt.build.mozilla.org/
and the crontask is taken care of (it was already in puppet, so I just moved it to the new class).

So, we'll need to do something similar to what is happening with clobberer in bug 657024:

 sed -i 's!http://build.mozilla.org/talos!http://talos-bundles.pvt.build.mozilla.org!g'

This is part of eliminating the use of http://build.mozilla.org, and also blocks moving this service to a real web cluster, and *should* be relatively simple, so I'd love to see it done soonish :)

NOTE: this vhost doesn't implement https -- I don't *think* this service is used on https, although it's supported on https://build.mozilla.org/talos.  The below suggests https is not used:

./buildbot-configs/mozilla-tests/config.py:    BRANCHES[branch]['support_url_base'] = branchConfig.get('support_url_base', 'http://build.mozilla.org/talos')
./buildbot-configs/mozilla-tests/config.py:    BRANCHES[branch]['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/simple-talos/README:                  http://build.mozilla.org/talos is a good value for this.
./buildbot-configs/simple-talos/README:    buildbot sendchange -m localhost:9118 -u bhearsum -p 'configurationOptions:--activeTests,ts,--noShutdown,--sampleConfig,addon.config' -p 'supportUrlBase:http://build.mozilla.org/talos' --branch=win7 -p 'addonUrl:/pub/mozilla.org/addons/722/noscript-2.1.5-fn+sm+fx.xpi' -p'extraTalosArg:--amo' http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-central/firefox-10.0a1.en-US.win32.installer.exe
./buildbot-configs/simple-talos/README:    buildbot sendchange -m localhost:9118 -u bhearsum -p 'configurationOptions:--activeTests,tp5,--mozAfterPaint' -p 'supportUrlBase:http://build.mozilla.org/talos' --branch=snowleopard -p 'pageset1:zips/tp5.zip' http://stage.mozilla.org/pub/mozilla.org/firefox/releases/7.0.1/mac/en-US/Firefox%207.0.1.dmg
./buildbot-configs/simple-talos/README:    buildbot sendchange -m localhost:9118 -u bhearsum -p 'configurationOptions:--activeTests,ts_places_generated_min:ts_places_generated_med:ts_places_generated_max' -p 'supportUrlBase:http://build.mozilla.org/talos' --branch=snowleopard -p 'talosAddon1:profiles/dirtyDBs.zip' -p 'talosAddon2:profiles/dirtyMaxDBs.zip' http://stage.mozilla.org/pub/mozilla.org/firefox/releases/7.0.1/mac/en-US/Firefox%207.0.1.dmg
./buildbot-configs/talos-pool/config.py:BRANCHES['mozilla-1.9.1']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-pool/config.py:BRANCHES['mozilla-1.9.2']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-r3/config.py:BRANCHES['mozilla-central']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-r3/config.py:BRANCHES['mozilla-2.0']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-r3/config.py:BRANCHES['mozilla-1.9.1']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-r3/config.py:BRANCHES['mozilla-1.9.2']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-r3/config.py:BRANCHES['addontester']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-r3/config.py:BRANCHES['places']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-r3/config.py:BRANCHES['electrolysis']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-r3/config.py:BRANCHES['maple']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-r3/config.py:BRANCHES['cedar']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-r3/config.py:BRANCHES['birch']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-r3/config.py:BRANCHES['jaegermonkey']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-r3/config.py:BRANCHES['tryserver']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-staging-pool/config.py:BRANCHES['mozilla-central']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-staging-pool/config.py:BRANCHES['mozilla-2.0']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-staging-pool/config.py:BRANCHES['mozilla-1.9.1']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-staging-pool/config.py:BRANCHES['mozilla-1.9.2']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-staging-pool/config.py:BRANCHES['addontester']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-staging-pool/config.py:BRANCHES['places']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-staging-pool/config.py:BRANCHES['electrolysis']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-staging-pool/config.py:BRANCHES['maple']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-staging-pool/config.py:BRANCHES['cedar']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-staging-pool/config.py:BRANCHES['birch']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-staging-pool/config.py:BRANCHES['jaegermonkey']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbot-configs/talos-staging-pool/config.py:BRANCHES['tryserver']['support_url_base'] = 'http://build.mozilla.org/talos'
./buildbotcustom/process/factory.py:             url='http://build.mozilla.org/talos/zips/retry.zip',
./buildbotcustom/process/factory.py:                          'http://build.mozilla.org/talos/zips/talos.mobile.old.zip'],
./buildbotcustom/process/factory.py:                 url='http://build.mozilla.org/talos/zips/mobile_tp4.zip',
./tools/sut_tools/updateSUT.py:    url = 'http://build.mozilla.org/talos/mobile/sutAgentAndroid.%s.apk' % target_version
dustin@euclid ~/code/moz/t/bbinfra $ grep -r build.mozilla.org/talos . | grep https
dustin@euclid ~/code/moz/t/bbinfra $

Comment 10

[Dustin J. Mitchell [:dustin] (he/him)]

I'd like to wrap bug 604688 up this quarter, if possible.  Is this a config change we could make fairly expeditiously?

Comment 11

[Dustin J. Mitchell [:dustin] (he/him)]

Bueller?

This is the last production service on build.mozilla.org and the last thing on relengweb1.  The change suggested in comment 9 isn't too complex, and should be pretty easy to test (the resulting fetches either work or they don't).

Comment 12

[Dustin J. Mitchell [:dustin] (he/him)]

Due to higher-than-expected load (this is about 140 Mbps!), let's hold off on this until at least bug 887304 is complete.

Comment 13

[Dustin J. Mitchell [:dustin] (he/him)]

887304 will be done in the July 13 downtime, so this change can happen at any time after that with no impact in terms of load shifts.

Comment 14

[Nick Thomas [:nthomas] (UTC+12)]

This doc will need up dating post move:
 https://wiki.mozilla.org/ReleaseEngineering:Buildduty:Other_Duties#How_to_update_the_talos_zips

Comment 15

[Dustin J. Mitchell [:dustin] (he/him)]

Armen knocked this out of the park in bug 899095.  I updated the docs linked in comment 14 (just changing the validation URL - everything else was accurate).