935461 - (b-linux64-hp-0014) b-linux64-hp-0014 problem tracking

Status: RESOLVED WONTFIX

(Infrastructure & Operations Graveyard :: CIDuty, task, P3)

Description

[Ed Morley [:emorley]]

Try B2G emulator builds on this machine are permanently failing in the checkout-sources step, with:

{
23:45:26     INFO - rmtree: /builds/slave/b2g_try_emu-d_dep-000000000000/build/.repo
23:45:26     INFO - Creating link from /builds/slave/b2g_try_emu-d_dep-000000000000/build/.repo to /builds/git-shared/repo
23:45:26     INFO - Running command: ['/builds/slave/b2g_try_emu-d_dep-000000000000/build/repo', 'init', '--repo-url', 'https://git.mozilla.org/external/google/gerrit/git-repo.git', '--no-repo-verify', '-q', '-u', '/builds/slave/b2g_try_emu-d_dep-000000000000/build/tmp_manifest', '-m', 'generic.xml', '-b', u'master'] in /builds/slave/b2g_try_emu-d_dep-000000000000/build
23:45:26     INFO - Copy/paste: /builds/slave/b2g_try_emu-d_dep-000000000000/build/repo init --repo-url https://git.mozilla.org/external/google/gerrit/git-repo.git --no-repo-verify -q -u /builds/slave/b2g_try_emu-d_dep-000000000000/build/tmp_manifest -m generic.xml -b master
23:45:26     INFO -  fatal: cannot make /builds/slave/b2g_try_emu-d_dep-000000000000/build/.repo/repo directory: File exists
23:45:26     INFO -  fatal: repo init failed; run without --quiet to see why
23:45:27     INFO -  Traceback (most recent call last):
23:45:27     INFO -    File "/builds/slave/b2g_try_emu-d_dep-000000000000/build/repo", line 758, in <module>
23:45:27     INFO -      main(sys.argv[1:])
23:45:27     INFO -    File "/builds/slave/b2g_try_emu-d_dep-000000000000/build/repo", line 731, in main
23:45:27     INFO -      os.rmdir(os.path.join(root, name))
23:45:27     INFO -  OSError: [Errno 20] Not a directory: '.repo/.repo/manifests/.git/rr-cache'
}

Whilst this machine is capable of running other builds, failing B2G builds on Try are only going to confuse devs and/or reduce their confidence in B2G/automation even further), so still going to disable.

Disabled in slavealloc.

Comment 1

[[e-mail] (:bhearsum)]

(In reply to Ed Morley [:edmorley UTC+1] from comment #0)
> Try B2G emulator builds on this machine are permanently failing in the
> checkout-sources step, with:
> 
> {
> 23:45:26     INFO - rmtree:
> /builds/slave/b2g_try_emu-d_dep-000000000000/build/.repo
> 23:45:26     INFO - Creating link from
> /builds/slave/b2g_try_emu-d_dep-000000000000/build/.repo to
> /builds/git-shared/repo
> 23:45:26     INFO - Running command:
> ['/builds/slave/b2g_try_emu-d_dep-000000000000/build/repo', 'init',
> '--repo-url', 'https://git.mozilla.org/external/google/gerrit/git-repo.git',
> '--no-repo-verify', '-q', '-u',
> '/builds/slave/b2g_try_emu-d_dep-000000000000/build/tmp_manifest', '-m',
> 'generic.xml', '-b', u'master'] in
> /builds/slave/b2g_try_emu-d_dep-000000000000/build
> 23:45:26     INFO - Copy/paste:
> /builds/slave/b2g_try_emu-d_dep-000000000000/build/repo init --repo-url
> https://git.mozilla.org/external/google/gerrit/git-repo.git --no-repo-verify
> -q -u /builds/slave/b2g_try_emu-d_dep-000000000000/build/tmp_manifest -m
> generic.xml -b master
> 23:45:26     INFO -  fatal: cannot make
> /builds/slave/b2g_try_emu-d_dep-000000000000/build/.repo/repo directory:
> File exists
> 23:45:26     INFO -  fatal: repo init failed; run without --quiet to see why
> 23:45:27     INFO -  Traceback (most recent call last):
> 23:45:27     INFO -    File
> "/builds/slave/b2g_try_emu-d_dep-000000000000/build/repo", line 758, in
> <module>
> 23:45:27     INFO -      main(sys.argv[1:])
> 23:45:27     INFO -    File
> "/builds/slave/b2g_try_emu-d_dep-000000000000/build/repo", line 731, in main
> 23:45:27     INFO -      os.rmdir(os.path.join(root, name))
> 23:45:27     INFO -  OSError: [Errno 20] Not a directory:
> '.repo/.repo/manifests/.git/rr-cache'
> }
> 
> Whilst this machine is capable of running other builds, failing B2G builds
> on Try are only going to confuse devs and/or reduce their confidence in
> B2G/automation even further), so still going to disable.
> 
> Disabled in slavealloc.

From bug 801503:
(In reply to Chris AtLee [:catlee] from comment #9)
> b2g_build.py creates a symlink from build/.repo to /builds/git-shared/repo
> 
> http://hg.mozilla.org/build/mozharness/file/default/scripts/b2g_build.py#l551
> 
> so perhaps something with the contents of the shared dir is messing this
> slave up?

I've cleaned out /builds/git-shared/* and put this machine back in production. If it continues to have issues I'll look into this more deeply.

Comment 2

[Chris Cooper [:coop] (he/him)]

Please do not re-enable this slave. We are retiring linux hardware build slaves in bug 1106922.