1121015 - Dolphin non-engineering nightlies are broken

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Ryan VanderMeulen [:RyanVM]]

Dep builds and engineering nightlies appear to be fine. Regular nightlies are broken across the board (confirmed on m-c and b2g30 both).

https://treeherder.mozilla.org/logviewer.html#?job_id=876352&repo=mozilla-central

Comment 1

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2015-01-13T08:39:26
log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-b2g30_v1_4&job_id=101319
repository: mozilla-b2g30_v1_4
who: rvandermeulen[at]mozilla[dot]com
machine: bld-linux64-spot-484
buildname: b2g_mozilla-b2g30_v1_4_dolphin_nightly
revision: 56d9a0a11efb

Couldn't find complete mar url in config or package_urls
Running post_fatal callback...
Exiting -1

Comment 2

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2015-01-13T08:39:26
log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-b2g30_v1_4&job_id=101120
repository: mozilla-b2g30_v1_4
who: rvandermeulen[at]mozilla[dot]com
machine: bld-linux64-spot-121
buildname: b2g_mozilla-b2g30_v1_4_dolphin_nightly
revision: 56d9a0a11efb

Error contacting server
Error contacting server for clobberer information.
Return code: 1
Couldn't find complete mar url in config or package_urls
Running post_fatal callback...
Exiting -1

Comment 3

[[e-mail] (:bhearsum)]

Looks like this is my fault, fallout from bug 1000217. Looking into it now.

Comment 4

[Chris Cooper [:coop] (he/him)]

For posterity, here's a link to a log from a working nightly last week:

http://people.mozilla.org/~coop/bug1121015/b2g_mozilla-central_dolphin_nightly-bm77-build1-build7-2015-01-10-working.txt.gz

And a failing one from today:

http://people.mozilla.org/~coop/bug1121015/b2g_mozilla-central_dolphin_nightly-bm70-build1-build6-2015-01-13-failing.txt.gz

Comment 5

[[e-mail] (:bhearsum)]

Attachment: set B2G_UPDATE_CHANNEL (mozilla-central

Comment 6

[[e-mail] (:bhearsum)]

Attachment: set B2G_UPDATE_CHANNEL (b2g30)

Comment 7

[[e-mail] (:bhearsum)]

Comment on attachment 8548279 [details] [diff] [review]
set B2G_UPDATE_CHANNEL (b2g30)

Landed with a=bustage.

Comment 8

[[e-mail] (:bhearsum)]

Should be fixed for the next set of nightlies.

Comment 9

[Ryan VanderMeulen [:RyanVM]]

Still broken :(
https://treeherder.mozilla.org/logviewer.html#?job_id=879195&repo=mozilla-central
https://treeherder.mozilla.org/logviewer.html#?job_id=101497&repo=mozilla-b2g30_v1_4

Comment 10

[Carsten Book [:Tomcat]]

https://treeherder.mozilla.org/logviewer.html#?job_id=881619&repo=mozilla-central

Comment 11

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2015-01-14T04:40:08
log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=881619
repository: mozilla-central
who: tomcat[at]mozilla[dot]com
machine: bld-linux64-spot-448
buildname: b2g_mozilla-central_dolphin_nightly
revision: 63006936ab99

Return code: 1
Couldn't find complete mar url in config or package_urls
Running post_fatal callback...
Exiting -1

Comment 12

[[e-mail] (:bhearsum)]

Before I go debugging this a ton more, do we even need Dolphin builds at all any more Bhavana?

Comment 13

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2015-01-14T06:02:22
log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-b2g30_v1_4&job_id=101585
repository: mozilla-b2g30_v1_4
who: rvandermeulen[at]mozilla[dot]com
machine: bld-linux64-spot-116
buildname: b2g_mozilla-b2g30_v1_4_dolphin_nightly
revision: 997eb4cae036

Return code: 1
Couldn't find complete mar url in config or package_urls
Running post_fatal callback...
Exiting -1

Comment 14

[[e-mail] (:bhearsum)]

Attachment: upload dolphin mars

Turns out we didn't upload the dolphin mars anywhere except update.boot2gecko.org. Which means that updates through Balrog (which is where our builds point) have been broken forever. What a waste.

Turning off uploading to update.boot2gecko.org exposed this bug because I removed the fallback code that guesses MAR urls.

This should fix it (really!).

Comment 15

[Ryan VanderMeulen [:RyanVM]]

Comment on attachment 8548905 [details] [diff] [review]
upload dolphin mars

Review of attachment 8548905 [details] [diff] [review]:
-----------------------------------------------------------------

lulz

Comment 16

[[e-mail] (:bhearsum)]

Comment on attachment 8548905 [details] [diff] [review]
upload dolphin mars

Landed on central and b2g30.

Comment 17

[[e-mail] (:bhearsum)]

I moved potential removal of these builds to the more encompassing bug 1121495.

Comment 18

[[e-mail] (:bhearsum)]

It's fixed for reals this time.

Comment 19

[[:fabrice] Fabrice Desré]

https://hg.mozilla.org/projects/cypress/rev/3121f461b090