Closed Bug 1147165 Opened 10 years ago Closed 10 years ago

Jobs in buildjson files without "packageUrl" and "testsUrl"

Categories

(Release Engineering :: General, defect)

Product:
Release Engineering
Component:
General
Platform:
x86_64
Linux
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 942616

People

(Reporter: armenzg, Unassigned)

Details

Up until now, I have been relying on finding from buildjson day files information about where a build has uploaded files. I have used "packageUrl" and "testsUrl" from the "properties" key. [1] For some odd reason, I have found jobs that don't have that information [2][3]. I also don't have a "request_ids" entry under "properties". However, I can find the upload information under "propeties""uploadFiles" I will work around it. [1] https://github.com/armenzg/mozilla_ci_tools/blob/master/mozci/mozci.py#L169 [2] http://builddata.pub.build.mozilla.org/builddata/buildjson/builds-2015-03-06.js.gz [3] { "builder_id": 367913, "buildnumber": 177, "endtime": 1425682661, "id": 60621717, "master_id": 161, "properties": { "appName": "Firefox", "appVersion": "39.0a1", "basedir": "/c/builds/moz2_slave/m-in-w32-000000000000000000000", "branch": "mozilla-inbound", "buildername": "WINNT 5.2 mozilla-inbound build", "buildid": "20150306133431", "buildnumber": 177, "builduid": "eabd297a01b441a8822c6e7d16a656a8", "comments": "Bug 1131805 part 2. Remove remaining js::GetObjectParent and JS_GetParent uses in SpiderMonkey. r=waldo", "commit_titles": [ "Bug 1131805 part 2. Remove remaining js::GetObjectParent and JS_GetParent uses in SpiderMonkey. ", "Bug 1131805 part 1. Remove remaining JS_GetParent and js::GetObjectParent uses in Gecko. r=bholley", "Bug 1131802 part 2. Allocate functions with reserved slots for DOM Xrays so we can store the Xray", "Bug 1131802 part 1. Add JS friend API to test whether a given function object has extended slots. ", "Bug 1140399. Add friend API to check whether a given function object has a JSNative and to get", "Bug 1102042. Fix the test to not have a race between the binding and the test bits. r=terrence", "Bug 1139604. Remove incorrect assert from ArrayCache::EntrySlotMustExist and the unused" ], "got_revision": "4139522bf814", "master": "http://buildbot-master84.bb.releng.scl3.mozilla.com:8001/", "platform": "win32", "product": "firefox", "project": "", "repo_path": "integration/mozilla-inbound", "repository": "", "revision": "4139522bf81411bb298025a7e2d405dc89f638d9", "scheduler": "mozilla-inbound-firefox", "script_repo_revision": "e170cecfdee2", "script_repo_url": "https://hg.mozilla.org/build/mozharness", "slavename": "b-2008-ix-0085", "sourcestamp": "4139522bf814", "stage_platform": "win32", "symbolsUrl": "http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip", "toolsdir": "/c/builds/moz2_slave/m-in-w32-000000000000000000000/scripts", "uploadFiles": "[u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/install/sea/firefox-39.0a1.en-US.win32.installer.exe', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/win32/xpi/firefox-39.0a1.en-US.langpack.xpi', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.tests.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.txt', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.json', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.mozinfo.json', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/jsshell-win32.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mar.exe', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mbsdiff.exe']" }, "reason": "scheduler", "request_ids": [ 63681629 ], "requesttime": 1425677671, "result": 0, "slave_id": 8238, "starttime": 1425677685 },
This also affects treeherder because we can't load a log for them: https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&revision=4139522bf814&filter-searchStr=winnt 5.2 mozilla-inbound build You can hover the log links for the opt build and you will get notified that they're not reachable.
dupe of bug 942616?
Thanks Chris. I will review it in the morning.
Flags: needinfo?(armenzg)
For the record, the log is in here: http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/mozilla-inbound-win32-bm84-build1-build177.txt.gz Setting the properties seem to happen in here [1][2]. These are the same issues as found in bug 942616. [1] 14:37:04 INFO - Properties set from 'mach build' 14:37:04 INFO - {u'jsshellUrl': u'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/jsshell-win32.zip', 14:37:04 INFO - u'packageUrl': u'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.zip', 14:37:04 INFO - u'symbolsUrl': u'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip', 14:37:04 INFO - u'testsUrl': u'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.tests.zip', 14:37:04 INFO - u'uploadFiles': [u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.zip', 14:37:04 INFO - u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/install/sea/firefox-39.0a1.en-US.win32.installer.exe', 14:37:04 INFO - u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/win32/xpi/firefox-39.0a1.en-US.langpack.xpi', 14:37:04 INFO - u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.tests.zip', 14:37:04 INFO - u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip', 14:37:04 INFO - u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.txt', 14:37:04 INFO - u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.json', 14:37:04 INFO - u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.mozinfo.json', 14:37:04 INFO - u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/jsshell-win32.zip', 14:37:04 INFO - u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mar.exe', 14:37:04 INFO - u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mbsdiff.exe']} 14:37:04 INFO - Setting buildbot property symbolsUrl to http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip 14:37:04 INFO - Writing buildbot properties [u'symbolsUrl'] to c:\builds\moz2_slave\m-in-w32-000000000000000000000\properties\symbolsUrl 14:37:04 INFO - Writing to file c:\builds\moz2_slave\m-in-w32-000000000000000000000\properties\symbolsUrl 14:37:04 INFO - Contents: 14:37:04 INFO - symbolsUrl:http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip 14:37:04 INFO - Setting buildbot property packageUrl to http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.zip 14:37:04 INFO - Writing buildbot properties [u'packageUrl'] to c:\builds\moz2_slave\m-in-w32-000000000000000000000\properties\packageUrl 14:37:04 INFO - Writing to file c:\builds\moz2_slave\m-in-w32-000000000000000000000\properties\packageUrl 14:37:04 INFO - Contents: 14:37:04 INFO - packageUrl:http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.zip 14:37:04 INFO - Setting buildbot property testsUrl to http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.tests.zip 14:37:04 INFO - Writing buildbot properties [u'testsUrl'] to c:\builds\moz2_slave\m-in-w32-000000000000000000000\properties\testsUrl 14:37:04 INFO - Writing to file c:\builds\moz2_slave\m-in-w32-000000000000000000000\properties\testsUrl 14:37:04 INFO - Contents: 14:37:04 INFO - testsUrl:http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.tests.zip [2] ========= Started set props: symbolsUrl packageUrl appName buildid got_revision appVersion comments testsUrl jsshellUrl sourcestamp stage_platform builduid uploadFiles (results: 0, elapsed: 0 secs) (at 2015-03-06 14:57:40.483108) ========= 'bash' '-c' 'for file in `ls -1`; do cat $file; done' ... appName:Firefox appVersion:39.0a1 buildid:20150306133431 builduid:eabd297a01b441a8822c6e7d16a656a8 comments:Bug 1131805 part 2. Remove remaining js::GetObjectParent and JS_GetParent uses in SpiderMonkey. r=waldo got_revision:4139522bf814 jsshellUrl:http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/jsshell-win32.zip packageUrl:http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.zip sourcestamp:4139522bf814 stage_platform:win32 symbolsUrl:http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip testsUrl:http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.tests.zip uploadFiles:[u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/install/sea/firefox-39.0a1.en-US.win32.installer.exe', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/win32/xpi/firefox-39.0a1.en-US.langpack.xpi', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.tests.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.txt', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.json', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.mozinfo.json', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/jsshell-win32.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mar.exe', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mbsdiff.exe'] program finished with exit code 0 elapsedTime=0.568000 symbolsUrl: 'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip' packageUrl: 'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.zip' appName: 'Firefox' buildid: '20150306133431' got_revision: '4139522bf814' appVersion: '39.0a1' comments: 'Bug 1131805 part 2. Remove remaining js::GetObjectParent and JS_GetParent uses in SpiderMonkey. r=waldo' testsUrl: 'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/firefox-39.0a1.en-US.win32.tests.zip' jsshellUrl: 'http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-inbound-win32/1425677671/jsshell-win32.zip' sourcestamp: '4139522bf814' stage_platform: 'win32' builduid: 'eabd297a01b441a8822c6e7d16a656a8' uploadFiles: "[u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/install/sea/firefox-39.0a1.en-US.win32.installer.exe', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/win32/xpi/firefox-39.0a1.en-US.langpack.xpi', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.tests.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.crashreporter-symbols.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.txt', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.json', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/firefox-39.0a1.en-US.win32.mozinfo.json', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/jsshell-win32.zip', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mar.exe', u'c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/obj-firefox/dist/host/bin/mbsdiff.exe']" ========= Finished set props: symbolsUrl packageUrl appName buildid got_revision appVersion comments testsUrl jsshellUrl sourcestamp stage_platform builduid uploadFiles (results: 0, elapsed: 0 secs) (at 2015-03-06 14:57:41.083386) =========
Status: NEW → RESOLVED
Closed: 10 years ago
Flags: needinfo?(armenzg)
Resolution: --- → DUPLICATE
Component: Tools → General
You need to log in before you can comment on or make changes to this bug.