Closed Bug 1211371 Opened 9 years ago Closed 9 years ago

b2g builds upload manifests with 'ssh mkdir' and resync to stage.mozilla.org

Categories

(Release Engineering :: Applications: MozharnessCore, defect)

Product:
Release Engineering
Component:
Applications: MozharnessCore
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 1228214

People

(Reporter: nthomas, Unassigned)

References

Details

eg a b2g_mozilla-central_emulator-debug_dep job:

17:25:11     INFO - ##### Running upload-source-manifest step.
17:25:11     INFO - #####
17:25:11     INFO - Running pre-action listener: influxdb_recording_pre_action
17:25:11     INFO - Running main action method: upload_source_manifest
17:25:11     INFO - rmtree: /builds/slave/b2g_m-cen_emu-d_dep-0000000000/build/upload-manifest
17:25:11     INFO - Determining sha512sum for /builds/slave/b2g_m-cen_emu-d_dep-0000000000/build/sources.xml
17:25:11     INFO - Reading from file /builds/slave/b2g_m-cen_emu-d_dep-0000000000/build/sources.xml
17:25:11     INFO -  a6db392ede8449f1dad4f5a6581836ccea87975c3fc0c6695749ac77e665c636ca609ec9a15ab6532e0cb5bf2df341ff92e1555928628005cafd54a1793136e6
17:25:11     INFO - mkdir: /builds/slave/b2g_m-cen_emu-d_dep-0000000000/build/upload-manifest
17:25:11     INFO - Uploading the contents of /builds/slave/b2g_m-cen_emu-d_dep-0000000000/build/upload-manifest to stage.mozilla.org:/pub/mozilla.org/b2g/manifests/depend/mozilla-central/emulator/20151003155039
17:25:11     INFO - Running command: ['ssh', '-oIdentityFile=/home/cltbld/.ssh/b2gbld_dsa', 'b2gbld@stage.mozilla.org', 'mkdir', '-p', u'/pub/mozilla.org/b2g/manifests/depend/mozilla-central/emulator/20151003155039'] in /builds/slave/b2g_m-cen_emu-d_dep-0000000000/build
17:25:11     INFO - Copy/paste: ssh -oIdentityFile=/home/cltbld/.ssh/b2gbld_dsa b2gbld@stage.mozilla.org mkdir -p /pub/mozilla.org/b2g/manifests/depend/mozilla-central/emulator/20151003155039
17:25:11     INFO - Return code: 0
17:25:11     INFO - Running command: ['rsync', '-e', 'ssh -oIdentityFile=/home/cltbld/.ssh/b2gbld_dsa', '-azv', '.', u'b2gbld@stage.mozilla.org:/pub/mozilla.org/b2g/manifests/depend/mozilla-central/emulator/20151003155039/'] in /builds/slave/b2g_m-cen_emu-d_dep-0000000000/build/upload-manifest
17:25:11     INFO - Copy/paste: rsync -e "ssh -oIdentityFile=/home/cltbld/.ssh/b2gbld_dsa" -azv . b2gbld@stage.mozilla.org:/pub/mozilla.org/b2g/manifests/depend/mozilla-central/emulator/20151003155039/
17:25:12     INFO -  sending incremental file list
17:25:12     INFO -  ./
17:25:12     INFO -  sources-a6db392ede8449f1dad4f5a6581836ccea87975c3fc0c6695749ac77e665c636ca609ec9a15ab6532e0cb5bf2df341ff92e1555928628005cafd54a1793136e6.xml
17:25:12     INFO -  sources.xml
17:25:12     INFO -  sent 283 bytes  received 269 bytes  368.00 bytes/sec
17:25:12     INFO -  total size is 24742  speedup is 44.82
17:25:12     INFO - Return code: 0
17:25:12     INFO - TinderboxPrint: sources.xml: http://stage.mozilla.org/pub/mozilla.org/b2g/manifests/depend/mozilla-central/emulator/20151003155039/sources-a6db392ede8449f1dad4f5a6581836ccea87975c3fc0c6695749ac77e665c636ca609ec9a15ab6532e0cb5bf2df341ff92e1555928628005cafd54a1793136e6.xml
17:25:12     INFO - Upload successful
17:25:12     INFO - Running post-action listener: influxdb_recording_post_action
17:25:12     INFO - Starting new HTTPS connection (1): goldiewilson-onepointtwentyone-1.c.influxdb.com

Either a new mode in post_upload and teach mozharness to use it, or use s3 credentials to post directly with boto.
This is just the manifests, for dep and nightly builds. The "public bit" uploads from nightly builds are OK, they upload to /tmp/<tmpdir> and do a post_upload (but we need bug 1211374 so that works).
Summary: b2g builds upload manifests with 'ssh mkdir' and resync → b2g builds upload manifests with 'ssh mkdir' and resync to stage.mozilla.org
Oh nice, nightly manifests have organize.py called on them. All the code for this is in 
 https://dxr.mozilla.org/mozilla-central/rev/3d7532ce81ac571962abc3b99582fe7f5d685192/testing/mozharness/scripts/b2g_build.py#968
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → DUPLICATE
You need to log in before you can comment on or make changes to this bug.