775791 - sync: server-storage dev/stage deploy: server_storage -> 1.13-4, server_core -> 2.10-4

Status: VERIFIED FIXED

(Cloud Services :: Operations: Deployment Requests - DEPRECATED, task)

Description

[Rob Miller [:rmiller]]

Please deploy server_storage 1.13-2 to dev and stage sync server environments. The following build command ran w/ no problems on r6 for me:

make build PYPI=http://pypi.build.mtv1.svc.mozilla.com/simple PYPIEXTRAS=http://pypi.build.mtv1.svc.mozilla.com/extras PYPISTRICT=1 SERVER_STORAGE=rpm-1.13-2 SERVER_CORE=rpm-2.10-1 build_rpms

In addition, the puppetized /etc/sync/sync.conf file needs an update. The `[metlog]` section of this file should be replaced w/ the following:


[metlog]
logger = syncstorage
sender_class = metlog.senders.udp.UdpSender
sender_host = 127.0.0.1
sender_port = 5566


Everything else in the file should remain as before.

Thanks!

Comment 1

[James Bonacci [:jbonacci]]

Moving over "depends on" and "blocks" from bug 770406

Comment 2

[Ryan Kelly [:rfkelly]]

Since Bug 770406 didn't make it to stage, we also need to apply the config changes from that bug.  Merging with Rob's updates from above, the relevant sections of the config file need to look like this:

        [app]
        modules = metlog_loader

        [metlog_loader]
        backend = services.metrics.MetlogLoader
        config = %(here)s/sync.conf

        [metlog]
        logger = syncstorage
        sender_class = metlog.senders.udp.UdpSender
        sender_host = 127.0.0.1
        sender_port = 5566

Comment 3

[Rob Miller [:rmiller]]

Bumped the server_storage version to 1.13-3 to reflect updated metlog-py dependency. Build command:


make build PYPI=http://pypi.build.mtv1.svc.mozilla.com/simple PYPIEXTRAS=http://pypi.build.mtv1.svc.mozilla.com/extras PYPISTRICT=1 SERVER_STORAGE=rpm-1.13-3 SERVER_CORE=rpm-2.10-1 build_rpms

Comment 4

[Rob Miller [:rmiller]]

Whoops, forgot to specify the channels. The correct command should be as follows:

make build PYPI=http://pypi.build.mtv1.svc.mozilla.com/simple PYPIEXTRAS=http://pypi.build.mtv1.svc.mozilla.com/extras PYPISTRICT=1 SERVER_STORAGE=rpm-1.13-3 SERVER_CORE=rpm-2.10-1 CHANNEL=prod RPM_CHANNEL=prod build_rpms



(In reply to Rob Miller [:RaFromBRC :rmiller] from comment #3)
> Bumped the server_storage version to 1.13-3 to reflect updated metlog-py
> dependency. Build command:
> 
> 
> make build PYPI=http://pypi.build.mtv1.svc.mozilla.com/simple
> PYPIEXTRAS=http://pypi.build.mtv1.svc.mozilla.com/extras PYPISTRICT=1
> SERVER_STORAGE=rpm-1.13-3 SERVER_CORE=rpm-2.10-1 build_rpms

Comment 5

[James Bonacci [:jbonacci]]

This was deployed to Dev and Stage last night.

Comment 6

[James Bonacci [:jbonacci]]

Verified the following in Stage (assume same for Dev):
Webheads
sync{1..4}.web.scl2.stage.svc.mozilla.com
RPMs:
python26-services-2.10-1.noarch
python26-syncstorage-1.13-3.noarch

Processes:
/usr/bin/python /usr/bin/gunicorn -k gevent -w 4 -b 127.0.0.1:8000 syncstorage.run:application
(5 per webhead)
plus couchbase, nginx, logstash, and statsd processes

Comment 7

[James Bonacci [:jbonacci]]

Forgot to add that I verified changes to ./etc/sync/sync.conf...

Comment 8

[Ryan Kelly [:rfkelly]]

server-core 2.10-1 was missing this change, which is required for the "check_node" functionality to work correctly: http://hg.mozilla.org/services/server-core/rev/90d8035df324

I guess it must have got clobbered when merging back to the default branch, and we didn't notice.  Bug 781019 opened since we obviously need some tests to guard against this in future.

I re-applied the change and tagged server-core 2.10-3.

Comment 9

[Bob Micheletto [:bobm]]

Deployed.

Comment 10

[Rob Miller [:rmiller]]

Attachment: metlog-ify cachemanager.py

Turns out cachemanager.py still had a reference to old logger.

Comment 11

[Ryan Kelly [:rfkelly]]

Comment on attachment 649858 [details] [diff] [review]
metlog-ify cachemanager.py

LGTM

Comment 12

[Rob Miller [:rmiller]]

New release, use the following command:

make build PYPI=http://pypi.build.mtv1.svc.mozilla.com/simple PYPIEXTRAS=http://pypi.build.mtv1.svc.mozilla.com/extras PYPISTRICT=1 SERVER_STORAGE=rpm-1.13-4 SERVER_CORE=rpm-2.10-1 CHANNEL=prod RPM_CHANNEL=prod build_rpms

Comment 13

[Ryan Kelly [:rfkelly]]

Also need to build the latest server-core tag, command should be:

make build PYPI=http://pypi.build.mtv1.svc.mozilla.com/simple PYPIEXTRAS=http://pypi.build.mtv1.svc.mozilla.com/extras PYPISTRICT=1 SERVER_STORAGE=rpm-1.13-4 SERVER_CORE=rpm-2.10-3 CHANNEL=prod RPM_CHANNEL=prod build_rpms

Comment 14

[Ryan Kelly [:rfkelly]]

Aaaaand the server-core rpm-2.10-3 tag didn't bump the version in the specfile.  I've tagged rpm-2.10-4 to fix that.  Definitely final build command now :-)


make build PYPI=http://pypi.build.mtv1.svc.mozilla.com/simple PYPIEXTRAS=http://pypi.build.mtv1.svc.mozilla.com/extras PYPISTRICT=1 SERVER_STORAGE=rpm-1.13-4 SERVER_CORE=rpm-2.10-4 CHANNEL=prod RPM_CHANNEL=prod build_rpms

Comment 15

[James Bonacci [:jbonacci]]

Re-deployed by :bobm

Comment 16

[James Bonacci [:jbonacci]]

OK, now we have it:
python26-services-2.10-4.noarch
python26-syncstorage-1.13-4.noarch