853529 - Linux B2G desktop builds failing in checktests with perl path problems

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Ryan VanderMeulen [:RyanVM]]

This will also need fixing before checktests can be turned back on.

https://tbpl.mozilla.org/php/getParsedLog.php?id=20928633&tree=Firefox

b2g_mozilla-central_linux32_gecko build on 2013-03-21 05:02:38 PDT for push a73a2b5c423b
slave: bld-linux64-ec2-368

make -C test check
make[3]: Entering directory `/builds/slave/m-cen-linux32_g-00000000000000/build/obj-firefox/build/unix/test'
mkdir -p .ts/
touch .ts/.done
/usr/bin/perl /builds/slave/m-cen-linux32_g-00000000000000/build/build/unix/test/runtest /builds/slave/m-cen-linux32_g-00000000000000/build/build/unix/test/uniq.tpl
Can't locate Test/Harness.pm in @INC (@INC contains: /usr/local/lib/perl5 /usr/local/share/perl5 /usr/lib/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib/perl5 /usr/share/perl5 .) at /builds/slave/m-cen-linux32_g-00000000000000/build/build/unix/test/runtest line 23.
BEGIN failed--compilation aborted at /builds/slave/m-cen-linux32_g-00000000000000/build/build/unix/test/runtest line 23.
make[3]: *** [.ts/uniq.tpl] Error 2
make[3]: Target `check' not remade because of errors.
make[3]: Leaving directory `/builds/slave/m-cen-linux32_g-00000000000000/build/obj-firefox/build/unix/test'
make[2]: Leaving directory `/builds/slave/m-cen-linux32_g-00000000000000/build/obj-firefox/build/unix'
make[2]: *** [check] Error 2
make[1]: *** [check] Error 2
make[1]: Leaving directory `/builds/slave/m-cen-linux32_g-00000000000000/build/obj-firefox/build'
make -C js/src check
make: *** [check] Error 2

Comment 1

[Ryan VanderMeulen [:RyanVM]]

Joey, any suggestions for how to debug this?

Comment 2

[Joey Armstrong [:joey]]

(In reply to Ryan VanderMeulen [:RyanVM] from comment #1)
> Joey, any suggestions for how to debug this?

Can't locate Test/Harness.pm

This is a problem with the perl installation on the machine.  Test::Harness in general should be available as a default module.  Either the module will need to be installed (host ~bld-linux64-ec2-368) -or- if Harness.pm can be found beneath /usr, the interpreter will need to have that directory available on the default search path.  Either installed or symlinked beneath site-lib or or a cpan*' directory iirc.

Comment 3

[Ryan VanderMeulen [:RyanVM]]

@ the RelEng people CCed here - any idea why we hit this on B2G desktop builds but not Firefox builds on the ec2 builders?

From a mozilla-inbound Firefox build log:

mkdir -p .ts/
touch .ts/.done
/usr/bin/perl /builds/slave/m-in-lx-0000000000000000000000/build/build/unix/test/runtest /builds/slave/m-in-lx-0000000000000000000000/build/build/unix/test/uniq.tpl
/builds/slave/m-in-lx-0000000000000000000000/build/build/unix/test/uniq.tpl .. ok
All tests successful.
Files=1, Tests=12,  1 wallclock secs ( 0.01 usr  0.01 sys +  0.18 cusr  0.05 csys =  0.25 CPU)
Result: PASS

Comment 4

[[e-mail] (:bhearsum)]

I think this is a RelEng problem. Firefox builds use this mock configuration: https://github.com/mozilla/build-buildbot-configs/blob/master/mozilla/config.py#L163 (note, CentOS environment, perl-Test-Simple explicitly installed), B2G uses this: https://github.com/mozilla/build-buildbot-configs/blob/master/mozilla/b2g_config.py#L219 (Fedora environment, no perl-Test-Simple listed).

Comment 5

[Ryan VanderMeulen [:RyanVM]]

Attachment: Add missing Perl packages to B2G config

Like this?

Comment 6

[Ryan VanderMeulen [:RyanVM]]

Comment on attachment 731905 [details] [diff] [review]
Add missing Perl packages to B2G config

http://hg.mozilla.org/build/buildbot-configs/rev/effd87840378

Comment 7

[[e-mail] (:bhearsum)]

in production

Comment 8

[Ryan VanderMeulen [:RyanVM]]

Attachment: Add missing Perl packages to B2G config (linux64)

On the bright side, the patch worked. On the down side, I only remembered to patch linux32.

Comment 9

[Ryan VanderMeulen [:RyanVM]]

Comment on attachment 732541 [details] [diff] [review]
Add missing Perl packages to B2G config (linux64)

http://hg.mozilla.org/build/buildbot-configs/rev/ce5cca1c4e5b

Comment 10

[Rail Aliiev [:rail]]

Comment on attachment 732541 [details] [diff] [review]
Add missing Perl packages to B2G config (linux64)

Review of attachment 732541 [details] [diff] [review]:
-----------------------------------------------------------------

::: mozilla/b2g_config.py
@@ +286,5 @@
>              'l10n_check_test': False,
>              'use_mock': True,
>              'mock_target': 'mozilla-f16-x86_64',
>              'mock_packages': ['autoconf213', 'python', 'zip', 'mercurial', 'git', 'ccache',
> +                              'glibc-static', 'libstdc++-static', perl-Test-Simple',

syntax error, needs a single quote before perl-Test-Simple

Comment 11

[Ryan VanderMeulen [:RyanVM]]

Dammit, I saw that when I made the patch and thought I fixed it. Sorry :(
http://hg.mozilla.org/build/buildbot-configs/rev/90ef51229202

Comment 12

[[e-mail] (:bhearsum)]

in production