Closed Bug 843568 Opened 10 years ago Closed 8 years ago

Please do not use for high-reliability Python installs


(Release Engineering :: General, defect)

Not set


(Not tracked)



(Reporter: dustin, Unassigned)



(Whiteboard: [SPOF])


(1 file)

This vhost is external, and single-hosted.  It's intended as an means to expose puppetagain' data to external users via rsync and http.  If it goes down, meh, external users can't see the data for a while.  No great emergency, no trees closed.

In PuppetAgain in general, resiliency is client-side, meaning that clients using data on puppet masters should be prepared to search for a working puppet master.  It's fine to use this host for stuff that can break for a few hours, but not for things that will close the tree.

On PuppetAgain-managed systems, ~/.pip/pip.conf is configured to point to all of the mirrors of this data on all of the puppetagain masters.  This is the correct way to install Python packages reliably.

For the duration of our not having everything managed by PuppetAgain, it'd be best to replicate this config some other way (old-puppet? mozharness?) and use it for the Python installs.
suggests a bunch of places to fix this, but they all seem mozharness-related, so maybe that's not too bad.
Blocks: 843502
We now run unit tests officially through mozharness.

For instance, what should I run instead of this?
/builds/panda-0131/test/build/venv/bin/pip install --find-links mozpoolclient
Duplicate of this bug: 843502
pip install mozpoolclient

should do the trick, assuming ~/.pip/pip.conf is in place.
Hrmm... we should look at deploying that to the Windows slaves and verify that the foopies, linux and mac machines have it deployed.
Bug 852473 comment 5 through 15 have some discussion about this bug.
Assignee: nobody → aki
Attachment #727015 - Flags: review?(armenzg)
Attachment #727015 - Flags: review?(armenzg) → review+
Comment on attachment 727015 [details] [diff] [review]
puppetagain/data/ -> repos/

I'll push to Cedar and wait for some green before merging.
Attachment #727015 - Flags: checked-in+
Seeing green on Cedar.
Merged to production.
Closed: 9 years ago
Resolution: --- → FIXED
This is better, but not resilient yet.

http://repos just points to the nearest puppet server, so it's no more fault-tolerant than pointing at that server itself, although it is a shorter path than  

As I indicated in comment 3, the correct fix here is to use a pip.conf that lists multiple mirrors:
and then pip install specific versions of packages (bug 851305).
Resolution: FIXED → ---
Ok.  I'm not working on comment 9.
Assignee: aki → nobody
Product: → Release Engineering
I think mozharness is consistently using now, right?
Closed: 9 years ago8 years ago
Flags: needinfo?(aki)
Resolution: --- → FIXED
Component: General Automation → General
You need to log in before you can comment on or make changes to this bug.