992154 - Cronjob for testcase-data on mozqa1.qa.scl3 no longer updates HTTP root

Status: VERIFIED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Description

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Not sure what's wrong with the current cronjob task but it no longer downloads the latest changes from our testcase-data repository:

Latest change: http://hg.mozilla.org/qa/testcase-data/diff/f96a01c5508c/firefox/search/mozsearch.html
Version on mozqa.com: http://www.mozqa.com/data/firefox/search/mozsearch.html

As you can see the extra paragraph is not visible. 

We are blocked on this by fixing an important test failure for Firefox Beta. Can someone please look at it? Thanks.

Comment 1

[Brandon Burton [:solarce]]

It looks like a previous hg pull got hung up, the lock file is older but there were only a couple things backed up, i cleaned it out and it's working again

bburton@mozqa1: ~
$ s bash -x /data/bin/mozqa-hg-pull.sh                                                                                                                                  [5:29:13]
+ DATA_DIR=/var/ftp/data/
+ cd /var/ftp/data/
+ sudo -u mozqahguser sh
+ echo 'hg pull | hg up -C'
waiting for lock on repository /var/ftp/data held by 'mozqa1.qa.scl3.mozilla.com:27540'
^Cinterrupted!

bburton@mozqa1: ~
$ ps waux | grep hg                                                                                                                                                     [5:30:18]
root     27534  0.0  0.0   9228   972 ?        Ss    2013   0:00 /bin/sh -c /data/bin/mozqa-hg-pull.sh
root     27537  0.0  0.0  90328  1780 ?        S     2013   0:00 sudo -u mozqahguser sh
491      27540  0.0  0.1  93596  2080 ?        S     2013   0:00 /usr/bin/python /usr/bin/hg pull
root     27579  0.0  0.0   9228   972 ?        Ss    2013   0:00 /bin/sh -c /data/bin/mozqa-hg-pull.sh
root     27584  0.0  0.0  90328  1780 ?        S     2013   0:00 sudo -u mozqahguser sh
491      27587  0.0  0.1  82732  2076 ?        S     2013   0:00 /usr/bin/python /usr/bin/hg pull
root     27934  0.0  0.0   9228   972 ?        Ss    2013   0:00 /bin/sh -c /data/bin/mozqa-hg-pull.sh
root     27937  0.0  0.0  90328  1780 ?        S     2013   0:00 sudo -u mozqahguser sh
491      27940  0.0  0.1  82728  2076 ?        S     2013   0:00 /usr/bin/python /usr/bin/hg pull
root     28033  0.0  0.0   9228   972 ?        Ss    2013   0:00 /bin/sh -c /data/bin/mozqa-hg-pull.sh
root     28037  0.0  0.0  90328  1780 ?        S     2013   0:00 sudo -u mozqahguser sh
491      28041  0.0  0.1  82728  2076 ?        S     2013   0:00 /usr/bin/python /usr/bin/hg pull
root     30762  0.0  0.0   9228  1128 ?        Ss   05:30   0:00 /bin/sh -c /data/bin/mozqa-hg-pull.sh
root     30766  0.0  0.1  90348  2788 ?        S    05:30   0:00 sudo -u mozqahguser sh
491      30772  0.2  0.5  83084 10312 ?        S    05:30   0:00 /usr/bin/python /usr/bin/hg pull
bburton  30794  0.0  0.0 103244   840 pts/1    S+   05:30   0:00 grep hg

[[e-mail]3 store]$ ls -lahtr lock
lrwxrwxrwx 1 mozqahguser vpn_mozqa 32 Nov 16 12:23 lock -> mozqa1.qa.scl3.mozilla.com:27540

bburton@mozqa1: ~
$ pgrep hg | s xargs kill -9                                                                                                                                            [5:32:47]

bburton@mozqa1: ~
$ ps waux | grep hg                                                                                                                                                     [5:32:53]
bburton  30906  0.0  0.0 103240   836 pts/1    S+   05:32   0:00 grep hg

bburton@mozqa1: ~
$ s bash -x /data/bin/mozqa-hg-pull.sh                                                                                                                                  [5:32:58]
+ DATA_DIR=/var/ftp/data/
+ cd /var/ftp/data/
+ sudo -u mozqahguser sh
+ echo 'hg pull | hg up -C'

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Thanks for the quick follow-up Brandon! All updated.