980188 - please install the perl ElasticSearch module on all bmo webheads

Status: RESOLVED FIXED

(bugzilla.mozilla.org :: Infrastructure, defect)

Description

[:glob ✱]

please install the perl ElasticSearch module on all bmo webheads.

note there's two different ES perl modules, "Elasticsearch" and "ElasticSearch".
we want http://search.cpan.org/~drtech/ElasticSearch/

Comment 1

[Dave Miller [:justdave]]

There is no RPM for RHEL6 for this module.  so...

cd into the Bugzilla docroot on the master server that you do the code pushes from.

perl install-module.pl ElasticSearch

That should install a local copy of it from cpan into Bugzilla's docroot.  Then you can push it out the same way you normally do code pushes for Bugzilla.

Comment 2

[Dave Miller [:justdave]]

The down side of installing it that way is we have to remember to manually do it again if that module ever has a security update.

Comment 3

[Mark Côté [:mcote]]

Do you think we should go this route?

Question for anyone: how do we ensure that we remember to do this next time?  Is it better to roll our own package?

Comment 4

[:glob ✱]

(In reply to Mark Côté ( :mcote ) from comment #3)
> Do you think we should go this route?

since we moved to the scl3 cluster we haven't used install-module.pl (our lib directory is empty).
iirc they need to be packaged and then added to bugzilla::packages in puppet.

fox2mike: are you able to help out here with pointers to the right process?

Comment 5

[Kendall Libby [:fubar] (he/him)]

I know what the process is to build an rpm; it just depends on how hairy it gets, because perl. The question is, is that easier/better than using install-module.pl? That we haven't used it since moving to SCL3 doesn't actually answer that.

(And having to remember to upgrade the package for security issues/new versions is the same in either case)

Comment 6

[Brandon Burton [:solarce]]

Rejoice! For FPM supports CPAN now: https://github.com/jordansissel/fpm/wiki/Perl-Packaging-With-FPM

Comment 7

[David Lawrence [:dkl]]

(In reply to Brandon Burton [:solarce] from comment #6)
> Rejoice! For FPM supports CPAN now:
> https://github.com/jordansissel/fpm/wiki/Perl-Packaging-With-FPM

That generates debian packages and not rpms. I know there are conversion tools to go from deb packages to rpms but not sure if the file paths will be the same for running on RHEL. Still better to just use cpanspec or similar with rpmbuild IMO.

I can look at generating the elasticsearch rpms since I have a centos6 build environment already set up.

dkl

Comment 8

[Kendall Libby [:fubar] (he/him)]

That's just an example; fpm builds for deb, rpm, solaris (really? still? buncha diehards...). I'm currently building and rpm now.

Comment 9

[Shyam Mani [:fox2mike]]

(In reply to Kendall Libby [:fubar] from comment #8)
> That's just an example; fpm builds for deb, rpm, solaris (really? still?
> buncha diehards...). I'm currently building and rpm now.

If that doesn't work, most of the bugzilla stuff I built was using cpan2rpm and that worked like a charm!

Comment 10

[Kendall Libby [:fubar] (he/him)]

rpm created and added to puppet in r84314. should be on all nodes in the next hour.

Comment 11

[:glob ✱]

there appear to be missing dependencies:

[[e-mail]3 ~]$ perl -MElasticSearch -e0
Can't locate Any/URI/Escape.pm in @INC (@INC contains: /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 .) at /usr/local/share/perl5/ElasticSearch/RequestParser.pm line 5.
BEGIN failed--compilation aborted at /usr/local/share/perl5/ElasticSearch/RequestParser.pm line 5.
Compilation failed in require at /usr/local/share/perl5/ElasticSearch.pm line 7.
BEGIN failed--compilation aborted at /usr/local/share/perl5/ElasticSearch.pm line 7.
Compilation failed in require.
BEGIN failed--compilation aborted.

it looks like we're missing:
Any::URI::Escape
HTTP::Lite
HTTP::Tiny

Comment 12

[Kendall Libby [:fubar] (he/him)]

And, of course, only one of those has an rpm. Re-build the ES rpm, and build the other two using cpan2rpm, since it's more user- and mock-friendly. Should be on the hosts within an hour.

Leaving open until it works. :)

Comment 13

[Kendall Libby [:fubar] (he/him)]

I think we're all set here; re-open if that's not the case.