472970 - Permissions broken on aus2-staging, breaking nightly updates

Status: VERIFIED FIXED

(mozilla.org Graveyard :: Server Operations, task)

Description

[Mark Banner (:standard8)]

+++ This bug was initially created as a clone of Bug #472817 +++

This seems related to bug 472817. All of Thunderbird nightly builds have failed to upload update snippets for today's builds.

From the log:

Starting snippet generation
Generating complete update in: build/objdir-tb/mozilla/dist/update/complete.update.snippet
Snippet generation complete

Could not chdir to home directory /home/tbirdbld: Permission denied
bash: /home/tbirdbld/.bashrc: Permission denied
mkdir: cannot create directory `/opt/aus2/build/0/Thunderbird/trunk/Linux_x86-gcc3/20090110031334': Permission denied

http://tinderbox.mozilla.org/showlog.cgi?log=Thunderbird3.0/1231585200.1231590584.24051.gz

Comment 1

[Aravind Gottipati [:aravind]]

I fixed the perms on the box, please let me know if you continue to have problems.  I apologize for the screw up.

Comment 2

[Nick Thomas [:nthomas] (UTC+12)]

Got something similar with the ffxbld account:

rsync: recv_generator: mkdir "/opt/aus2/incoming/2/Firefox/mozilla-1.9.1/Darwin_Universal-gcc3/20090110020329" failed: Permission de
nied (13)

Also seeing that fwenzel owns all of /opt/aus2/incoming/2/Thunderbird, and rcampbell the Firefox equivalent.

Comment 3

[Mark Banner (:standard8)]

We've just tried respining the Thunderbird nightlies, (and as Nick's comments implied there could be) there is still the same issue with them uploading.

Comment 4

[Nick Thomas [:nthomas] (UTC+12)]

/opt/aus2/build/0 should be fixed up now, so tinderboxes should be able to push up OK. Still working on /opt/aus2/incoming/2 (so that the partial update generator can push), taking this chance to clean up a bit.

Comment 5

[Mark Banner (:standard8)]

Thanks for the update, I'm not going to try and push any more nightlies through at the moment - will let them kick in normally tomorrow and see what happens.

Comment 6

[Bill Gianopoulos [:WG9s]]

(In reply to comment #4)
> /opt/aus2/build/0 should be fixed up now, so tinderboxes should be able to push
> up OK. Still working on /opt/aus2/incoming/2 (so that the partial update
> generator can push), taking this chance to clean up a bit.

Does this fix bug 472984 as well?

Comment 8

[Nick Thomas [:nthomas] (UTC+12)]

(In reply to comment #7)
> *** Bug 472984 has been marked as a duplicate of this bug. ***

Now that I finished cleaning up /opt/aus2/incoming/2 that is fixed.

The partial generator is running again. Firefox 2.0 & 3.0 and Thunderbird 2.0 will skip the 20080110 nightlies and go from 20080109 to 20080111.

Please reopen if I missed anything.

Comment 9

[Mark Banner (:standard8)]

This has worked on the Thunderbird nightlies today (at least Mac updates work,  and all builds are green), thanks for fixing.