1250719 - Sumo: Set Python path to search Kitsune git repo before installed packages

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Description

[Michael Cooper [:mythmon]]

Cyliang did this on -dev. We'll need it on stage and prod for some code changes that are coming down soon (In particular, for bug 1164035).

Comment 1

[C. Liang [:cyliang]]

@mythmon: I've applied the changes to -stage.  Can you please verify that things are still working as expected?  Once you've given the thumbs up, I'll make the changes to -prod.

Comment 2

[Michael Cooper [:mythmon]]

-stage looks good. bd to continue to -prod.

Comment 3

[C. Liang [:cyliang]]

Change pushed to -prod (r 115240).  Holding this bug open for a few days to make sure there no unintended consequences. =)

Comment 4

[Jake Maul [:jakem]]

Seems that there are. :(

Since this change, we've been getting sporadic alerts from Zeus about queuing time. New Relic shows something amiss too:

https://rpm.newrelic.com/accounts/263620/applications/2779374?tw%5Bend%5D=1456527916&tw%5Bstart%5D=1456517116#tab_hosts=breakout


What's the underlying change here? The old python-path directives would have been harmless I think (wrong python version, so they shouldn't get loaded... right?). What's in the new one that wasn't already getting pulled in some other way?

Comment 5

[Michael Cooper [:mythmon]]

This change was to accommodate the Python package "authority" being moved into the git repo. Authority is unmaintained and not compatible with Django 1.8 (bug 1164035). We moved it into kitsune's git repo to make it compatible.

Comment 6

[Michael Cooper [:mythmon]]

Alternatively, I think we can revert this change, and uninstall authority from the virtualenv, as a part of bug 1251744.

Comment 7

[C. Liang [:cyliang]]

The queue time alerts largely appear to be firing in reaction to client behavior (i.e. excessive # of requests and/or excessive traffic being generated in response to requests).  Closing this bug.