797050 - Anti-virus failed for Firefox 16.0b6 build1

Status: RESOLVED WORKSFORME

(Release Engineering :: Release Automation: Other, defect)

Description

[Armen [:armenzg]]

http://buildbot-master13.build.scl1.mozilla.com:8001/builders/release-mozilla-beta-antivirus/builds/23/steps/run_script/logs/stdio

The "Command failed for the following files" is for the sparc builds which they fail with:
"lstat() failed: Permission denied. ERROR"

I also can see a bunch of these:
"Exception IOError: 'File not open for writing' in <bound method BZ2MarFile.__del__ of <mar.BZ2MarFile instance at 0x115cd88>> ignored
no key specified to validate 1 signature"

^^ these seem to happen in older anti-virus runs as well.

The command run looks like this:
scripts/scripts/release/push-to-mirrors.sh mozilla/production_config.py antivirus '--extra-excludes=*.zip' '--extra-excludes=*.zip.asc' --ssh-user ffxbld --ssh-key ffxbld_dsa


#################################
Command failed for the following files:
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_pkgadd/firefox-16.0b5.en-US.opensolaris-sparc-pkg.bz2.md5sum
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_pkgadd/firefox-16.0b5.en-US.solaris-10-fcs-i386-pkg.bz2
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_pkgadd/firefox-16.0b5.en-US.solaris-10-fcs-sparc-pkg.bz2
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_pkgadd/firefox-16.0b5.en-US.solaris-10-fcs-sparc-pkg.bz2.md5sum
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_pkgadd/firefox-16.0b5.en-US.opensolaris-i386-pkg.bz2.md5sum
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_pkgadd/firefox-16.0b5.en-US.opensolaris-i386-pkg.bz2
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_pkgadd/README.txt
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_pkgadd/firefox-16.0b5.en-US.opensolaris-sparc-pkg.bz2
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_pkgadd/firefox-16.0b5.en-US.solaris-10-fcs-i386-pkg.bz2.md5sum
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.opensolaris-sparc.complete.mar.md5sum
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b4-16.0b5.en-US.opensolaris-sparc.partial.mar
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.opensolaris-sparc.tar.bz2
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.opensolaris-i386.tar.bz2
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.solaris-10-fcs-i386.complete.mar
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.opensolaris-i386.complete.mar
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b4-16.0b5.en-US.opensolaris-i386.partial.mar
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.opensolaris-i386.tar.bz2.md5sum
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.opensolaris-i386.complete.mar.md5sum
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.solaris-10-fcs-sparc.tar.bz2.md5sum
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.solaris-10-fcs-i386.complete.mar.md5sum
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.solaris-10-fcs-i386.tar.bz2.md5sum
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.solaris-10-fcs-i386.tar.bz2
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b4-16.0b5.en-US.solaris-10-fcs-i386.partial.mar
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.opensolaris-sparc.complete.mar
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/README.txt
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b4-16.0b5.en-US.solaris-10-fcs-sparc.partial.mar
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.opensolaris-sparc.tar.bz2.md5sum
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.solaris-10-fcs-sparc.complete.mar.md5sum
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.solaris-10-fcs-sparc.tar.bz2
  /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.solaris-10-fcs-sparc.complete.mar
command: ERROR
Traceback (most recent call last):
  File "/builds/slave/rel-m-beta-av/scripts/scripts/release/../../lib/python/util/commands.py", line 42, in run_cmd
    return subprocess.check_call(cmd, **kwargs)
  File "/tools/python-2.5.1/lib/python2.5/subprocess.py", line 461, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['ssh', '-l', 'ffxbld', '-i', '/home/cltbld/.ssh/ffxbld_dsa', 'stage.mozilla.org', 'nice', 'ionice', '-c2', '-n7', 'extract_and_run_command.py', '-j2', 'clamdscan', '-m', '--no-summary', '--', '/pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/']' returned non-zero exit status 1
command: END (4392.21s elapsed)

Traceback (most recent call last):
  File "/builds/slave/rel-m-beta-av/scripts/scripts/release/push-to-mirrors.py", line 183, in <module>
    buildNumber=buildNumber)
  File "/builds/slave/rel-m-beta-av/scripts/scripts/release/push-to-mirrors.py", line 96, in runAntivirusCheck
    sshKey=stageSshKey)
  File "/builds/slave/rel-m-beta-av/scripts/scripts/release/../../lib/python/util/commands.py", line 60, in run_remote_cmd
    run_cmd(cmd_prefix + cmd, **kwargs)
  File "/builds/slave/rel-m-beta-av/scripts/scripts/release/../../lib/python/util/commands.py", line 42, in run_cmd
    return subprocess.check_call(cmd, **kwargs)
  File "/tools/python-2.5.1/lib/python2.5/subprocess.py", line 461, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['ssh', '-l', 'ffxbld', '-i', '/home/cltbld/.ssh/ffxbld_dsa', 'stage.mozilla.org', 'nice', 'ionice', '-c2', '-n7', 'extract_and_run_command.py', '-j2', 'clamdscan', '-m', '--no-summary', '--', '/pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/']' returned non-zero exit status 1
program finished with exit code 1
elapsedTime=4408.864909

Comment 1

[Armen [:armenzg]]

-bash-4.1$ ls -l /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.solaris-10-fcs-sparc.complete.mar
-rw-r----- 1 dave.lin firefox 37717406 Sep 26 15:10 /pub/mozilla.org/firefox/nightly/16.0b5-candidates/build1/contrib/solaris_tarball/firefox-16.0b5.en-US.solaris-10-fcs-sparc.complete.mar

Comment 2

[[e-mail] (:bhearsum)]

From e-mail:

This one can be ignored. I was testing the latest version of clamav by rerunning the 16.0b5 job, and it failed to read some solaris files which were uploaded with bad permissions.

-Nick

On Tue Oct  2 17:07:53 2012, [e-mail] wrote:
> antivirus failed for Firefox 16.0b5 build1
>
> Status: failure
>
> Full details are available at:
>   http://buildbot-master13.build.scl1.mozilla.com:8001/builders/release-mozilla-beta-antivirus/builds/23
>
> -buildbot
>

Comment 3

[Armen [:armenzg]]

Are we going to back to the previous version of clamav?

This happened on my current beta and not the beta 5 as the email mentions.

Comment 4

[[e-mail] (:bhearsum)]

I don't see how that's possible...16.0b6 hasn't run the av scan yet. Please paste the mail with full headers so we can debug.

Comment 5

[Armen [:armenzg]]

I got very very confused.
You're right. This is not an issue.