804190 - hg clone build/tools broken

Status: RESOLVED FIXED

(Developer Services :: General, task)

Description

[Aki Sasaki (not active)]

hg clone http://hg.mozilla.org/build/tools tools
 in dir /builds/slave/m-esr10-lnx/. (timeout 1320 secs)
 watching logfiles {}
 argv: ['hg', 'clone', 'http://hg.mozilla.org/build/tools', 'tools']
 environment:
  CCACHE_HASHDIR=
  CVS_RSH=ssh
  G_BROKEN_FILENAMES=1
  HISTSIZE=1000
  HOME=/home/cltbld
  HOSTNAME=mv-moz2-linux-ix-slave18.build.mozilla.org
  INPUTRC=/etc/inputrc
  LANG=en_US.UTF-8
  LESSOPEN=|/usr/bin/lesspipe.sh %s
  LOGNAME=cltbld
  LS_COLORS=no=00:fi=00:di=01;34:ln=01;36:pi=40;33:so=01;35:bd=40;33;01:cd=40;33;01:or=01;05;37;41:mi=01;05;37;41:ex=01;32:*.cmd=01;32:*.exe=01;32:*.com=01;32:*.btm=01;32:*.bat=01;32:*.sh=01;32:*.csh=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.gz=01;31:*.bz2=01;31:*.bz=01;31:*.tz=01;31:*.rpm=01;31:*.cpio=01;31:*.jpg=01;35:*.gif=01;35:*.bmp=01;35:*.xbm=01;35:*.xpm=01;35:*.png=01;35:*.tif=01;35:
  MAIL=/var/spool/mail/cltbld
  PATH=/opt/local/bin:/tools/python/bin:/tools/buildbot/bin:/usr/kerberos/bin:/usr/lib/ccache:/usr/local/bin:/bin:/usr/bin:/home/cltbld/bin
  PWD=/builds/slave/m-esr10-lnx
  SHELL=/bin/bash
  SHLVL=1
  SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
  TERM=linux
  USER=cltbld
  _=/tools/python/bin/python
 using PTY: False
abort: error: 
program finished with exit code 255

Comment 1

[Matt Brubeck (:mbrubeck)]

"hg clone" seems to be working now, but tests are now failing in the "download" step:

http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-macosx64-debug/1350922161/firefox-19.0a1.en-US.mac64.tests.zip:
09:34:40 ERROR 500: Internal Server Error.

https://tbpl.mozilla.org/php/getParsedLog.php?id=16345093&tree=Mozilla-Inbound

Comment 2

[Shyam Mani [:fox2mike]]

(In reply to Matt Brubeck (:mbrubeck) from comment #1)
> "hg clone" seems to be working now, but tests are now failing in the
> "download" step:
> 
> http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-
> inbound-macosx64-debug/1350922161/firefox-19.0a1.en-US.mac64.tests.zip:
> 09:34:40 ERROR 500: Internal Server Error.

Where is this failing from? Works for me. Also, please comment about this on  bug 804119

> https://tbpl.mozilla.org/php/getParsedLog.php?id=16345093&tree=Mozilla-
> Inbound

Comment 3

[Shyam Mani [:fox2mike]]

hg is fine, we've moved it to another zlb to prevent this from happening in the future.

Comment 4

[Matt Brubeck (:mbrubeck)]

The 500 errors happened in several tests around 9:34 to 9:35 PDT, for example the log in my previous comment.  Looks like it might be cleared up now.

Comment 5

[Corey Shields [:cshields]]

(In reply to Matt Brubeck (:mbrubeck) from comment #4)
> The 500 errors happened in several tests around 9:34 to 9:35 PDT, for
> example the log in my previous comment.  Looks like it might be cleared up
> now.

This is possibly due to leftover load from our earlier scl3 issues combined with the change in product_details for beta and cdn nodes needing to cache those files.