752691 - SeaMonkey-related bin/build-exclusive.pl can't locate Proc/PID/File.pm

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Description

[Jens Hatlak (:InvisibleSmiley)]

The following started to show up 1-2 hours ago and appears every 10 minutes since then (triggered by a cronjob). I guess that is related to some server moves going on but I'm not too involved in that (I'm just the website maintainer). CC'ing Callek for the releng side of things.

Subject: Cron <root@ip-admin02> (cd /data/build/seamonkeyproject-org ; bin/build-exclusive.pl)
From: [e-mail]
To: [e-mail]

Can't locate Proc/PID/File.pm in @INC (@INC contains: /usr/lib64/perl5/site_perl/5.8.8/x86_64-linux-thread-multi /usr/lib/perl5/site_perl/5.8.8 /usr/lib/perl5/site_perl /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi /usr/lib/perl5/vendor_perl/5.8.8 /usr/lib/perl5/vendor_perl /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi /usr/lib/perl5/5.8.8 .) at bin/build-exclusive.pl line 33.
BEGIN failed--compilation aborted at bin/build-exclusive.pl line 33.

Comment 1

[Brandon Burton [:solarce]]

Installed needed Perl module, I ran it afterwards and got a bunch of CVS output.

Added package to Puppet

Comment 2

[Jens Hatlak (:InvisibleSmiley)]

Thanks Brandon!

One error message gone, now continuing with a new one (see below). Do you want me to open a new bug for each error message until it's all fixed, or shall we reopen this bug and use it until it's all fixed for good?

mkdir dest: File exists at /usr/bin/ttree line 319
  ! plugin error - XML.XPath: plugin not found

Comment 3

[Robert Kaiser]

Yes, even the requirements for Template Toolkit are a bitch. :(
Jens, did we fix this dependency on an old version of Template Toolkit at least?

Comment 4

[Jason Crowe [:jd]]

Hi all,

I fixed this (mkdir dest: File exists at /usr/bin/ttree line 319) up so it at least completes the cron tasks.  The one remaining issue is the:

plugin error - XML.XPath: plugin not found

however:

Installed Packages
Name       : perl-XML-XPath
Arch       : noarch
Version    : 1.13
Release    : 4.el5
Size       : 188 k
Repo       : installed
~ snip ~

Can anyone tell me how to resolve this issue for this project?

Thanks

Comment 5

[Jens Hatlak (:InvisibleSmiley)]

No idea how exactly to solve the issue for RHEL5 but this is what I have locally running (and working) on Ubuntu Precise 12.04:

expat                             2.0.1-7.2ubuntu1
libtemplate-perl                  2.22-0.1build2
libtemplate-plugin-xml-perl       2.17-3
libxml-xpath-perl                 1.13-7

All of the above packages are available directly in Precise, with the exception of libtemplate-plugin-xml-perl which is available from universe (the extended repository).

Comment 6

[Jason Crowe [:jd]]

(In reply to Jens Hatlak (:InvisibleSmiley) from comment #5)
> No idea how exactly to solve the issue for RHEL5 but this is what I have
> locally running (and working) on Ubuntu Precise 12.04:
> 
> expat                             2.0.1-7.2ubuntu1
> libtemplate-perl                  2.22-0.1build2
> libtemplate-plugin-xml-perl       2.17-3
> libxml-xpath-perl                 1.13-7
> 
> All of the above packages are available directly in Precise, with the
> exception of libtemplate-plugin-xml-perl which is available from universe
> (the extended repository).

Well the old device went off-line in the mean time so I can no longer check dependencies over there.  I will paste what i found on the server but really don't have the time to dig further at the moment.  If you see somethign obvious let me know and I can try it.  The other box is being physically moved to another data center so I can look more there after it is back online.  Not exactly sure about the timeline but it will be tomorrow morning at the earliest.  Let me know if this is more critical than that for some reason.


Installed Packages
Name       : expat
Arch       : i386
Version    : 1.95.8
Release    : 8.3.el5_5.3
Size       : 158 k
Repo       : installed

Installed Packages
Name       : perl-libxml-perl
Arch       : noarch
Version    : 0.08
Release    : 1.2.1
Size       : 179 k
Repo       : installed

# yum search libtemplate
Warning: No matches found for: libtemplate

# yum search perl | grep Template
perl-Apache-SimpleTemplate.noarch : Simple templates
perl-CGI-FastTemplate.noarch : Extension for managing templates and performing
perl-Catalyst-View-TT.noarch : Template View Class
perl-Class-Template.noarch : Struct/member template builder
perl-HTML-Template.noarch : HTML Templates for CGI scripts
perl-HTML-Template-Expr.noarch : HTML::Template extension adding expression
perl-HTML-Template-Pro.x86_64 : Perl/XS module to use HTML Templates from CGI
perl-Kolab-Templates.noarch : Perl extension for Kolab template generation
perl-OODoc-Template.noarch : Simple template system
perl-Template-Alloy.noarch : Perl module that implements a TT2/3, HT, HTE, Tmpl,
perl-Template-Declare.noarch : Perlish declarative templates
perl-Template-GD.noarch : Perl module that implements GD plugin(s) for the
                        : Template Toolkit
perl-Template-Magic.noarch : Magic merger of runtime values with templates
perl-Template-Plugin-Class.noarch : Allow calling of class methods on arbitrary
perl-Template-Plugin-NoFollow.noarch : Template filter for adding nofollow
perl-Template-Plugin-Number-Format.x86_64 : Plugin/filter interface to
perl-Template-Plugin-ResolveLink.noarch : Template plugin for HTML::ResolveLink
perl-Template-Plugin-Shorten.noarch : Template plugin to shorten/lengthen URLs
perl-Template-Plugin-YAML.noarch : Plugin interface to YAML
perl-Template-Provider-DBIC.noarch : Load templates using DBIx::Class
perl-Template-Provider-Encoding.noarch : Template plugin to specify encoding
perl-Template-Timer.noarch : Rudimentary profiling for Template Toolkit
perl-Template-Toolkit.x86_64 : Template processing system
perl-Template-Toolkit-examples.x86_64 : Examples of how to use Template Toolkit
perl-Text-BasicTemplate.noarch : Simple lexical text/html/etc template parser
perl-Text-MicroTemplate.noarch : Micro template engine in Perl
perl-Text-SimpleTemplate.noarch : Yet another module for template processing
perl-Text-Template.noarch : Text templates functions
perl-Text-Template-Simple.noarch : Simple text template engine
perl-Text-Templet.noarch : Template processor which uses eval
perl-URI-Template.noarch : Perl module that provides an object for handling URI
perl-XMLNews-HTMLTemplate.noarch : Module for converting NITF to HTML
perl-ZM-Template.noarch : Perl module to merges runtime data with static HTML or

Comment 7

[Jens Hatlak (:InvisibleSmiley)]

So assuming that perl-Template-Toolkit (the equivalent of libtemplate-perl) version 2.22 is installed, the only thing missing is what would probably be called perl-Template-Plugin-XML (the equivalent of libtemplate-plugin-xml-perl). Unfortunately I couldn't find that package so I guess it's not packaged for RHEL. 

The original is here:
http://search.cpan.org/dist/Template-XML/

The Debian package is here:
http://packages.debian.org/squeeze/libtemplate-plugin-xml-perl

Maybe the following noarch RPM package could be installed:
http://rpm.pbone.net/index.php3/stat/4/idpl/5744049/dir/pld/com/perl-Template-XML-2.17-1.noarch.rpm.html

(or repackaged from Debian, or packaged from the source, or ...)

[Until this issue is solved, the SeaMonkey website cannot be updated, which also means we cannot release any product versions, which delays our imminent beta.]

Comment 8

[Robert Kaiser]

I know that justdave did most of the setup for the old host, so CCing him here.

Also, IIRC, the Bugzilla website also used Template Toolkit, I wonder if they are using the XML.XPath plugin as well or not.

Comment 9

[Justin Wood (:Callek)]

Ok, I promised solarce I'd update the bug -- looks like I never did...

This is now fixed, (albeit a slower run of |(cd /data/build/seamonkeyproject-org ; bin/build_full-exclusive.pl)| which we can live with)

The fix was first done by a manual install of the perl module, and solarce said he was creating an rpm to setup with puppet to avoid this issue in the future (if the hosting node ever needs to move).

I'm leaving open so solarce can confirm that the rpm was/is deployed, but the actual issue of the website not updating is now fixed.

Comment 10

[Jake Maul [:jakem]]

Okay, there's some more work here to do.

The cron jobs build from /data/build/seamonkeyproject-org, and (ultimately) write their output to /data/static/www/www.seamonkeyproject.org. This is all on ip-admin02.phx.

The actual document roots are in /data/sync/static/www. This comes from mradm02, and is what get sync'd out to the actual web heads.

We *could* play with the crons a bit and try to merge in www.seamonkeyproject.org into the copy from mradm02. I'm not a major fan of this because it's kinda non-obvious... there would be content in there that's originates locally and non-locally, with no obvious indication as to which is which.

Instead what I've done for a temporary fix (as the site was serving very old content) was to simply copy the whole "dest" directory to mradm02 and merge it in there. This means it won't auto-update for now.


However, I'm told that very shortly we (fox2mike) may be building a proper admin node for the static cluster. This would be moved to that host, and all of this tomfoolery would disappear along with it. I've been told he's going to build that as soon as tonight, so with any luck this temp fix should only need to hold us over for a day or two.

If we need to update the site in the meantime, simply run the bin/build_full-exclusive.pl cron job by hand, tar up the dest directory, and put it in place on mradm02:/data/static/www.

Comment 11

[Adrian J Fernandez [:Aj]]

As per :Callek request, doing a manual update of the site.

Comment 12

[Adrian J Fernandez [:Aj]]

Manual update of the site completed.

Comment 13

[Jens Hatlak (:InvisibleSmiley)]

(In reply to Jake Maul [:jakem] from comment #10)
> I've been told he's going to build that [admin node for the static cluster]
> as soon as tonight, so with any luck this temp fix should only
> need to hold us over for a day or two.

I assume this hasn't happened yet, so may I ask you to do the below once more for me since I have no direct access but just pushed an update to the release notes of our latest beta:

> If we need to update the site in the meantime, simply run the
> bin/build_full-exclusive.pl cron job by hand, tar up the dest directory, and
> put it in place on mradm02:/data/static/www.

Thanks in advance!

Comment 14

[Jens Hatlak (:InvisibleSmiley)]

(In reply to Jens Hatlak (:InvisibleSmiley) from comment #13)
> I assume this hasn't happened yet, so may I ask you to do the below once
> more for me since I have no direct access but just pushed an update to the
> release notes of our latest beta:

FTR: solarce was kind enough to do that for me when I asked on #it.

Comment 15

[Justin Wood (:Callek)]

jakem just confirmed in #IT for me that he is working on getting the new host setup properly, he did not give me an ETA yet though.

Comment 16

[Jake Maul [:jakem]]

This was completed last week. Seamonkey (and the rest of the static cluster) is hosted by the new staticadm admin node. Thanks guys!

There is still an open issue (I think... still crawling through lots of bugmail) to improve the Seamonkey deployment, but that's another bug. :)