Closed Bug 1147165 Opened 9 years ago Closed 9 years ago

Jobs in buildjson files without "packageUrl" and "testsUrl"

Categories

(Release Engineering :: General, defect)

x86_64
Linux
defect
Not set
normal

Tracking

(Not tracked)

RESOLVED DUPLICATE of bug 942616

People

(Reporter: armenzg, Unassigned)

Details

Up until now, I have been relying on finding from buildjson day files information about where a build has uploaded files.

I have used "packageUrl" and "testsUrl" from the "properties" key. [1]

For some odd reason, I have found jobs that don't have that information [2][3].
I also don't have a "request_ids" entry under "properties".
However, I can find the upload information under "propeties""uploadFiles"

I will work around it.

[1]
https://github.com/armenzg/mozilla_ci_tools/blob/master/mozci/mozci.py#L169
[2]
http://builddata.pub.build.mozilla.org/builddata/buildjson/builds-2015-03-06.js.gz
[3]
    {
      "builder_id": 367913, 
      "buildnumber": 177, 
      "endtime": 1425682661, 
      "id": 60621717, 
      "master_id": 161, 
      "properties": {
        "appName": "Firefox", 
        "appVersion": "39.0a1", 
        "basedir": "/c/builds/moz2_slave/m-in-w32-000000000000000000000", 
        "branch": "mozilla-inbound", 
        "buildername": "WINNT 5.2 mozilla-inbound build", 
        "buildid": "20150306133431", 
        "buildnumber": 177, 
        "builduid": "eabd297a01b441a8822c6e7d16a656a8", 
        "comments": "Bug 1131805 part 2.  Remove remaining js::GetObjectParent and JS_GetParent uses in SpiderMonkey.  r=waldo", 
        "commit_titles": [
          "Bug 1131805 part 2.  Remove remaining js::GetObjectParent and JS_GetParent uses in SpiderMonkey. ", 
          "Bug 1131805 part 1.  Remove remaining JS_GetParent and js::GetObjectParent uses in Gecko.  r=bholley", 
          "Bug 1131802 part 2.  Allocate functions with reserved slots for DOM Xrays so we can store the Xray", 
          "Bug 1131802 part 1.  Add JS friend API to test whether a given function object has extended slots. ", 
          "Bug 1140399.  Add friend API to check whether a given function object has a JSNative and to get", 
          "Bug 1102042.  Fix the test to not have a race between the binding and the test bits.  r=terrence", 
          "Bug 1139604.  Remove incorrect assert from ArrayCache::EntrySlotMustExist and the unused"
        ], 
        "got_revision": "4139522bf814", 
        "master": "http://buildbot-master84.bb.releng.scl3.mozilla.com:8001/", 
        "platform": "win32", 
        "product": "firefox", 
        "project": "", 
        "repo_path": "integration/mozilla-inbound", 
        "repository": "", 
        "revision": "4139522bf81411bb298025a7e2d405dc89f638d9", 
        "scheduler": "mozilla-inbound-firefox", 
        "script_repo_revision": "e170cecfdee2", 
        "script_repo_url": "https://hg.mozilla.org/build/mozharness", 
        "slavename": "b-2008-ix-0085", 
        "sourcestamp": "4139522bf814", 
        "stage_platform": "win32", 
        "symbolsUrl": "http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip", 
        "toolsdir": "/c/builds/moz2_slave/m-in-w32-000000000000000000000/scripts", 
        "uploadFiles": "[u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/install/sea/firefox-39.0a1.en-US.win32.installer.exe', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/win32/xpi/firefox-39.0a1.en-US.langpack.xpi', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.tests.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.txt', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.json', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.mozinfo.json', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/jsshell-win32.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mar.exe', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mbsdiff.exe']"
      }, 
      "reason": "scheduler", 
      "request_ids": [
        63681629
      ], 
      "requesttime": 1425677671, 
      "result": 0, 
      "slave_id": 8238, 
      "starttime": 1425677685
    },
This also affects treeherder because we can't load a log for them:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&revision=4139522bf814&filter-searchStr=winnt 5.2 mozilla-inbound build

You can hover the log links for the opt build and you will get notified that they're not reachable.
Thanks Chris.
I will review it in the morning.
Flags: needinfo?(armenzg)
For the record, the log is in here:
http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/mozilla-inbound-win32-bm84-build1-build177.txt.gz

Setting the properties seem to happen in here [1][2].

These are the same issues as found in bug 942616.

[1]
14:37:04     INFO - Properties set from 'mach build'
14:37:04     INFO - {u'jsshellUrl': u'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/jsshell-win32.zip',
14:37:04     INFO -  u'packageUrl': u'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.zip',
14:37:04     INFO -  u'symbolsUrl': u'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip',
14:37:04     INFO -  u'testsUrl': u'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.tests.zip',
14:37:04     INFO -  u'uploadFiles': [u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.zip',
14:37:04     INFO -                   u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/install/sea/firefox-39.0a1.en-US.win32.installer.exe',
14:37:04     INFO -                   u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/win32/xpi/firefox-39.0a1.en-US.langpack.xpi',
14:37:04     INFO -                   u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.tests.zip',
14:37:04     INFO -                   u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip',
14:37:04     INFO -                   u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.txt',
14:37:04     INFO -                   u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.json',
14:37:04     INFO -                   u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.mozinfo.json',
14:37:04     INFO -                   u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/jsshell-win32.zip',
14:37:04     INFO -                   u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mar.exe',
14:37:04     INFO -                   u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mbsdiff.exe']}
14:37:04     INFO - Setting buildbot property symbolsUrl to http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip
14:37:04     INFO - Writing buildbot properties [u'symbolsUrl'] to c:\builds\moz2_slave\m-in-w32-000000000000000000000\properties\symbolsUrl
14:37:04     INFO - Writing to file c:\builds\moz2_slave\m-in-w32-000000000000000000000\properties\symbolsUrl
14:37:04     INFO - Contents:
14:37:04     INFO -  symbolsUrl:http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip
14:37:04     INFO - Setting buildbot property packageUrl to http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.zip
14:37:04     INFO - Writing buildbot properties [u'packageUrl'] to c:\builds\moz2_slave\m-in-w32-000000000000000000000\properties\packageUrl
14:37:04     INFO - Writing to file c:\builds\moz2_slave\m-in-w32-000000000000000000000\properties\packageUrl
14:37:04     INFO - Contents:
14:37:04     INFO -  packageUrl:http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.zip
14:37:04     INFO - Setting buildbot property testsUrl to http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.tests.zip
14:37:04     INFO - Writing buildbot properties [u'testsUrl'] to c:\builds\moz2_slave\m-in-w32-000000000000000000000\properties\testsUrl
14:37:04     INFO - Writing to file c:\builds\moz2_slave\m-in-w32-000000000000000000000\properties\testsUrl
14:37:04     INFO - Contents:
14:37:04     INFO -  testsUrl:http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.tests.zip


[2]
========= Started set props: symbolsUrl packageUrl appName buildid got_revision appVersion comments testsUrl jsshellUrl sourcestamp stage_platform builduid uploadFiles (results: 0, elapsed: 0 secs) (at 2015-03-06 14:57:40.483108) =========
'bash' '-c' 'for file in `ls -1`; do cat $file; done'
...
appName:Firefox
appVersion:39.0a1
buildid:20150306133431
builduid:eabd297a01b441a8822c6e7d16a656a8
comments:Bug 1131805 part 2.  Remove remaining js::GetObjectParent and JS_GetParent uses in SpiderMonkey.  r=waldo
got_revision:4139522bf814
jsshellUrl:http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/jsshell-win32.zip
packageUrl:http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.zip
sourcestamp:4139522bf814
stage_platform:win32
symbolsUrl:http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip
testsUrl:http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.tests.zip
uploadFiles:[u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/install/sea/firefox-39.0a1.en-US.win32.installer.exe', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/win32/xpi/firefox-39.0a1.en-US.langpack.xpi', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.tests.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.txt', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.json', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.mozinfo.json', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/jsshell-win32.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mar.exe', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mbsdiff.exe']
program finished with exit code 0
elapsedTime=0.568000
symbolsUrl: 'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip'
packageUrl: 'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.zip'
appName: 'Firefox'
buildid: '20150306133431'
got_revision: '4139522bf814'
appVersion: '39.0a1'
comments: 'Bug 1131805 part 2.  Remove remaining js::GetObjectParent and JS_GetParent uses in SpiderMonkey.  r=waldo'
testsUrl: 'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.tests.zip'
jsshellUrl: 'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/jsshell-win32.zip'
sourcestamp: '4139522bf814'
stage_platform: 'win32'
builduid: 'eabd297a01b441a8822c6e7d16a656a8'
uploadFiles: "[u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/install/sea/firefox-39.0a1.en-US.win32.installer.exe', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/win32/xpi/firefox-39.0a1.en-US.langpack.xpi', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.tests.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.txt', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.json', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.mozinfo.json', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/jsshell-win32.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mar.exe', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mbsdiff.exe']"
========= Finished set props: symbolsUrl packageUrl appName buildid got_revision appVersion comments testsUrl jsshellUrl sourcestamp stage_platform builduid uploadFiles (results: 0, elapsed: 0 secs) (at 2015-03-06 14:57:41.083386) =========
Status: NEW → RESOLVED
Closed: 9 years ago
Flags: needinfo?(armenzg)
Resolution: --- → DUPLICATE
Component: Tools → General
You need to log in before you can comment on or make changes to this bug.