1184594 - git 'repo' is not deployed correctly on build machines managed by buildbot

Status: RESOLVED WONTFIX

(Release Engineering :: General, defect)

Description

[Hal Wine [:hwine] use NI!]

issue worked around in bug 1184422 comment 2

However, that needs a real fix, so we can resume mirroring of 'repo' again.

One suspect is the buildbot modification at:
 http://mxr.mozilla.org/build/source/buildbot-configs/mozilla/b2g_config.py#1617
which may explain why this is a releng only issue

Comment 1

[Rail Aliiev [:rail]]

Attachment: pin-repo.diff

As Hal mentioned, repo tries to self-update if if detects that we are on a detached head. This is the case when you checkout using a tag. Repo's code parses .git/HEAD and find whether it starts with "ref:".

This is a workaround to prevent repo self-upgrading itself.

`git checkout -B tmp_branch $tag_name` creates a temporary branch based on a revision we need. -B ensures that we force it to create a new branch (in case we don't clobber and run it twice)

Comment 2

[Rail Aliiev [:rail]]

This is what I had mid-build on https://treeherder.mozilla.org/#/jobs?repo=try&revision=0ec8824e6961

[[e-mail] repo]$ pwd
/builds/slave/b2g_try_emu_dep-00000000000000/build/.repo/repo
[[e-mail] repo]$ git status
On branch tmp_moz_branch
nothing to commit, working directory clean
[[e-mail] repo]$ git show-branch --sha1-name tmp_moz_branch
[666d534] Ensure HEAD is correct when skipping remote fetch
[[e-mail] repo]$ git show-branch --sha1-name v1.12.16
[666d534] Ensure HEAD is correct when skipping remote fetch

Comment 3

[Hal Wine [:hwine] use NI!]

Comment on attachment 8637332 [details] [diff] [review]
pin-repo.diff

Review of attachment 8637332 [details] [diff] [review]:
-----------------------------------------------------------------

lgtm; r+ with the addition of the "get back to stable" bug as being blocked by this.

The following still shows in the log, and likely will until upstream is fixed for the reason we pinned:
     INFO -  info: A new version of repo is available
     INFO -  warning: project 'repo' branch 'master' is not signed
     INFO -  warning: Skipped upgrade to unverified version

Of most concern is the attempt to update to branch 'master' -- we should be using 'stable' (which has signed tags).

Comment 4

[Pulsebot]

https://hg.mozilla.org/integration/mozilla-inbound/rev/88ef4fbf5d6b

Comment 5

[Rail Aliiev [:rail]]

Comment on attachment 8637332 [details] [diff] [review]
pin-repo.diff

https://hg.mozilla.org/integration/mozilla-inbound/rev/88ef4fbf5d6b

https://hg.mozilla.org/build/mozharness/rev/57dde819edcb

Comment 6

[Rail Aliiev [:rail]]

Comment on attachment 8637332 [details] [diff] [review]
pin-repo.diff

backout 

https://hg.mozilla.org/integration/mozilla-inbound/rev/07ff7cf012bc

https://hg.mozilla.org/build/mozharness/rev/3ae81f4458ef


Errors received:
The directory '/home/worker/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Return code: 0
IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/builder/oauth.txt'
Return code: 128
128 not in success codes: [0]
Halting on failure while running ['git', 'checkout', '-B', 'tmp_moz_branch', 'stable']
Running post_fatal callback...
Exiting 2 

https://tools.taskcluster.net/task-inspector/#_H85CAQ6T8-jYZI84z4efw/0

Comment 7

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12300230
repository: mozilla-inbound
start_time: 2015-07-30T05:25:00
who: rail[at]mozilla[dot]com
machine: unknown
buildname: non-buildbot b2g-emu-kk test [TC] B2G Emulator KK (Debug)
revision: 88ef4fbf5d6b

Errors received:
The directory '/home/worker/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Return code: 0
IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/builder/oauth.txt'
Return code: 128
128 not in success codes: [0]
Halting on failure while running ['git', 'checkout', '-B', 'tmp_moz_branch', 'stable']
Running post_fatal callback...
Exiting 2

Comment 8

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12300229
repository: mozilla-inbound
start_time: 2015-07-30T05:24:59
who: rail[at]mozilla[dot]com
machine: unknown
buildname: non-buildbot b2g-emu-jb test [TC] B2G JB Emulator: (Opt)
revision: 88ef4fbf5d6b

Comment 9

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12300234
repository: mozilla-inbound
start_time: 2015-07-30T05:25:02
who: rail[at]mozilla[dot]com
machine: unknown
buildname: non-buildbot b2g-device-image test [TC] B2G Flame KK Debug
revision: 88ef4fbf5d6b

IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/phone-builder/oauth.txt'
Return code: 128
128 not in success codes: [0]
Halting on failure while running ['git', 'checkout', '-B', 'tmp_moz_branch', 'stable']
Running post_fatal callback...
Exiting 2

Comment 10

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12300233
repository: mozilla-inbound
start_time: 2015-07-30T05:24:58
who: rail[at]mozilla[dot]com
machine: unknown
buildname: non-buildbot b2g-emu-kk test [TC] B2G KK Emulator (Opt)
revision: 88ef4fbf5d6b

Errors received:
The directory '/home/worker/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Return code: 0
IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/builder/oauth.txt'
Return code: 128
128 not in success codes: [0]
Halting on failure while running ['git', 'checkout', '-B', 'tmp_moz_branch', 'stable']
Running post_fatal callback...
Exiting 2

Comment 11

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12300231
repository: mozilla-inbound
start_time: 2015-07-30T05:24:59
who: rail[at]mozilla[dot]com
machine: unknown
buildname: non-buildbot b2g-emu-l test [TC] B2G Emulator L (Debug)
revision: 88ef4fbf5d6b

Errors received:
The directory '/home/worker/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Return code: 0
IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/builder/oauth.txt'
Return code: 128
128 not in success codes: [0]
Halting on failure while running ['git', 'checkout', '-B', 'tmp_moz_branch', 'stable']
Running post_fatal callback...
Exiting 2

Comment 12

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12300235
repository: mozilla-inbound
start_time: 2015-07-30T05:28:05
who: rail[at]mozilla[dot]com
machine: unknown
buildname: non-buildbot b2g-device-image test [TC] B2G Aries Opt
revision: 88ef4fbf5d6b

IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/phone-builder/oauth.txt'
Return code: 128
128 not in success codes: [0]
Halting on failure while running ['git', 'checkout', '-B', 'tmp_moz_branch', 'stable']
Running post_fatal callback...
Exiting 2

Comment 13

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12300227
repository: mozilla-inbound
start_time: 2015-07-30T05:24:58
who: rail[at]mozilla[dot]com
machine: unknown
buildname: non-buildbot b2g-emu-l test [TC] B2G L Emulator (Opt)
revision: 88ef4fbf5d6b

Errors received:
The directory '/home/worker/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Return code: 0
IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/builder/oauth.txt'
Return code: 128
128 not in success codes: [0]
Halting on failure while running ['git', 'checkout', '-B', 'tmp_moz_branch', 'stable']
Running post_fatal callback...
Exiting 2

Comment 14

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12300236
repository: mozilla-inbound
start_time: 2015-07-30T05:25:04
who: rail[at]mozilla[dot]com
machine: unknown
buildname: non-buildbot b2g-device-image test [TC] B2G Flame KK Opt
revision: 88ef4fbf5d6b

IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/phone-builder/oauth.txt'
Return code: 128
128 not in success codes: [0]
Halting on failure while running ['git', 'checkout', '-B', 'tmp_moz_branch', 'stable']
Running post_fatal callback...
Exiting 2

Comment 15

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12300241
repository: mozilla-inbound
start_time: 2015-07-30T05:30:56
who: rail[at]mozilla[dot]com
machine: unknown
buildname: non-buildbot b2g-device-image test [TC] B2G Aries Debug
revision: 88ef4fbf5d6b

IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/phone-builder/oauth.txt'
Return code: 128
128 not in success codes: [0]
Halting on failure while running ['git', 'checkout', '-B', 'tmp_moz_branch', 'stable']
Running post_fatal callback...
Exiting 2

Comment 16

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12300240
repository: mozilla-inbound
start_time: 2015-07-30T05:30:56
who: rail[at]mozilla[dot]com
machine: unknown
buildname: non-buildbot b2g-device-image test [TC] B2G Aries Eng
revision: 88ef4fbf5d6b

IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/phone-builder/oauth.txt'
Return code: 128
128 not in success codes: [0]
Halting on failure while running ['git', 'checkout', '-B', 'tmp_moz_branch', 'stable']
Running post_fatal callback...
Exiting 2

Comment 17

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12300238
repository: mozilla-inbound
start_time: 2015-07-30T05:30:56
who: rail[at]mozilla[dot]com
machine: unknown
buildname: non-buildbot b2g-device-image test [TC] B2G Flame KK Eng
revision: 88ef4fbf5d6b

IOError: [Errno 2] No such file or directory: '/home/worker/workspace/gecko/testing/taskcluster/scripts/phone-builder/oauth.txt'
Return code: 128
128 not in success codes: [0]
Halting on failure while running ['git', 'checkout', '-B', 'tmp_moz_branch', 'stable']
Running post_fatal callback...
Exiting 2

Comment 18

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12300232
repository: mozilla-inbound
start_time: 2015-07-30T05:24:58
who: rail[at]mozilla[dot]com
machine: unknown
buildname: non-buildbot b2g-emu-jb test [TC] B2G Emulator JB (Debug)
revision: 88ef4fbf5d6b

Comment 19

[Chris Cooper [:coop] (he/him)]

mozharness production tag moved to: https://hg.mozilla.org/build/mozharness/rev/80df8b8b2376

Comment 20

[Rail Aliiev [:rail]]

back to the pool, I haven't touched this for a long time