868140 - Installation of alembic on database servers: best practice?

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task, P4)

Description

[Selena Deckelmann :selenamarie :selena]

I've got a database migration tool that needs things installed into a bin directory and requires a few dependencies like SQLAlchemy.

I chatted with :mpressman and he suggested that there might be an RPM, but I wasn't sure how to check.

I see that 0.4.2 RPMs exist for RHEL 6: http://rpm.pbone.net/index.php3/stat/4/idpl/20707957/dir/redhat_el_6/com/python-alembic-0.4.2-1.el6.noarch.rpm.html

Could I get a hand with figuring this out?

Comment 1

[Daniel Maher [:phrawzty]]

If we can't find a handy RPM somewhere I can probably make one. :)

Is there a particular version you require ?

Comment 2

[Selena Deckelmann :selenamarie :selena]

(In reply to Daniel Maher [:phrawzty] from comment #1)
> If we can't find a handy RPM somewhere I can probably make one. :)
> 
> Is there a particular version you require ?

I'd like 0.5.0 please!  Thanks.

Comment 3

[Daniel Maher [:phrawzty]]

$ yum list python-alembic | grep alembic
python-alembic.noarch                  0.5.0-1                   mozilla

Which machine(s) would you like this package to be installed on ?

Comment 4

[Selena Deckelmann :selenamarie :selena]

\o/

We need it on: 

socorro1.dev.db.phx1.mozilla.com
socorro1.stage.db.phx1.mozilla.com

tp-socorro01-master01
tp-socorro01-master02

Comment 5

[Daniel Maher [:phrawzty]]

I note that those machines all configured primarily via the "postgres2" module in Puppet - would you suggest that python-alembic be installed along with postgres in general, or should it truly be fixed to the machines noted (comment #4) ?

Comment 6

[Selena Deckelmann :selenamarie :selena]

(In reply to Daniel Maher [:phrawzty] from comment #5)
> I note that those machines all configured primarily via the "postgres2"
> module in Puppet - would you suggest that python-alembic be installed along
> with postgres in general, or should it truly be fixed to the machines noted
> (comment #4) ?

It can be installed along with postgres in general... Although that requires SQLAlchemy as well -- you probably already saw that dep.

Comment 7

[Daniel Maher [:phrawzty]]

Sorry for the delay - there were some packaging / repo concerns that I needed to sort out before python-alembic could be rolled out to the postgres machines.  I have committed the change to Puppet, so the package will be available on all the Puppet-managed postgres servers within an hour.

Comment 8

[Selena Deckelmann :selenamarie :selena]

Thanks so much!

Unfortunately, there's a small problem: 

[[e-mail]1 bin]$ python /usr/bin/alembic
Traceback (most recent call last):
  File "/usr/bin/alembic", line 5, in <module>
    from pkg_resources import load_entry_point
ImportError: No module named pkg_resources

I'm looking into how it can be fixed.

Comment 9

[Selena Deckelmann :selenamarie :selena]

Working on a series of dependancies: 

python-setuptools.noarch 0:0.6.10-3.el6
python-markupsafe.x86_64 0:0.9.2-4.el6


And now SQLAlchemy 0.7.3

Comment 10

[Daniel Maher [:phrawzty]]

I re-packaged the python-alembic and python-sqlalchemy packages in order to reflect the dependencies more accurately, and ensured that the postgres2 packages.pp is aware of the required deps as well.

09:19:07 < selenamarie> SUCCESS!!!!!
09:21:27  * selenamarie configures alembic on stage

Comment 11

[:Atoll]

Declaring Package[python-setuptools] here broke catalog compilation on jenkins1.dmz.phx1 as of 2013-05-10 09:31, reopening to ensure that whatever fix we come up with still works here.

Duplicate declaration: Package[python-setuptools] is already declared in file /etc/puppet/modules/webapp/manifests/python.pp at line 31; cannot redeclare on node jenkins1.dmz.phx1.mozilla.com

Comment 12

[:Atoll]

I merged the webapp::python and postgres2::packages declarations for python-setuptools into base::python_setuptools, which results in no changes to socorro1.stage.db.phx1 and fixes jenkins1.dmz.phx1 catalog compilation.