Closed Bug 1305406 Opened 8 years ago Closed 8 years ago

Spidermonkey builds broken with abort: could not find web.cacerts: /etc/mercurial/cacert/cacert.pem

Categories

(Infrastructure & Operations Graveyard :: CIDuty, task)

Product:
Infrastructure & Operations Graveyard
Component:
CIDuty
Type:
task
Priority:
Not set
Severity:
blocker

Tracking

(firefox50 fixed, firefox51 fixed, firefox52 fixed)

Status:
RESOLVED FIXED
Tracking Flags:
Tracking Status
firefox50 --- fixed
firefox51 --- fixed
firefox52 --- fixed

People

(Reporter: cbook, Unassigned)

References

(
URL
)

Details

(Keywords: intermittent-failure) 

abort: could not find web.cacerts: /etc/mercurial/cacert/cacert.pem 

https://treeherder.mozilla.org/logviewer.html#?job_id=5087366&repo=mozilla-central
closed integration trees for this problem :(
Severity: normal → blocker
Depends on: 1303766
Landed a fix for this (see https://bugzilla.mozilla.org/show_bug.cgi?id=1303766#c25).

Started regenerating all Linux AMIs, will probably take 1.5-2 hours to finish.
Is this related to the android mozilla-central and android nightly fails?
Status update - an additional fix was required in the puppet code; new golden AMIs were started for Windows, but not for Linux. markco is verifying the y-2008 AMI is good, b-2008 is still going, linux AMIs will be started soon.
b-2008 and y-2008 instances are regenerated, verified, and we've removed all instances running on older AMI. Linux AMI generating has been running about 20 minutes (looks like the runtime is about 40 minutes normally).
bld-linux64 golden is done, terminated old instances, new jobs are working for desktop and spidermonkey.
try-linux64 golden seems wedged, investigating.
We have a try-linux64 image in use1, but got the previous image copied to usw2 (bug 1152624, as ami-6b03dc0b). Manually recovered from that, and terminated all old-ami try-linux-spot instances. Almost there.
try-linux64 are running jobs, which is good because they haven't been generated August 18 (bug 1305564 for alerts on that).

At this point I think all the buildbot infra is working OK.
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
Product: Release Engineering → Infrastructure & Operations
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.