Closed Bug 1202288 Opened 9 years ago Closed 7 years ago

update packages (2015-09-06)

Categories

(Input Graveyard :: Code Quality, defect)

Product:
Input Graveyard
Component:
Code Quality
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED WONTFIX

People

(Reporter: willkg, Unassigned)

References

Details

(Whiteboard: p=2 s=input.2015q4) 

We set up fjord with requires.io and it lists a bunch of libs as outdated. We should update the following ones before we attempt a django upgrade:

requirements/requirements.txt
---------------------  ---------  ----------  --------
Babel                  ==1.3      2.0         outdated
bleach                 ==1.4      1.4.1       outdated
certifi                ==1.0.0    2015.9.6.1  outdated
chardet                ==2.2.1    2.3.0       outdated
commonware             ==0.4.2    0.4.3       outdated
cssselect              ==0.7.1    0.9.1       outdated
dennis                 ==0.4.3    0.6.1       outdated
django-appconf         ==0.5      1.0.1       outdated
django-extensions      ==1.3.3    1.5.6       outdated
django-picklefield     ==0.3.1    0.3.2       outdated
django-pipeline        ==1.5.2    1.5.4       outdated
django-ratelimit       ==0.4.0    0.6.0       outdated
django-statsd-mozilla  ==0.3.8.5  0.3.15      outdated
djangorestframework    ==3.1.3    3.2.3       outdated
eadred                 ==0.2      0.3         outdated
elasticsearch          ==1.2.0    1.6.0       outdated
factory_boy            ==2.4.1    2.5.2       outdated
gengo                  ==0.1.19   0.1.26      outdated
GitPython              ==0.1.7    1.0.1       outdated  (Might be able to ditch this.)
html5lib               ==0.95     0.999999    outdated
mock                   ==1.0.1    1.3.0       outdated
polib                  ==1.0.3    1.0.7       outdated
pyquery                ==1.2.1    1.2.9       outdated
python-dateutil        ==1.5      2.4.2       outdated
python-memcached       ==1.48     1.57        outdated
pytz                   ==2013.9   2015.4      outdated
statsd                 ==2.0.3    3.1         outdated
tldextract             ==1.3.1    1.7.1       outdated
translate-toolkit      ==1.11.0   1.13.0      outdated
urllib3                ==1.8      1.12        outdated
---------------------  ---------  ----------  --------

requirements/dev.txt
----------------  --------  ------  --------
cached-property   ==1.1.0   1.2.0   outdated
django-sslserver  ==0.14    0.15    outdated
flake8            ==2.2.5   2.4.1   outdated
jsonschema        ==2.4.0   2.5.1   outdated
mccabe            ==0.3     0.3.1   outdated
nodeenv           ==0.13.1  0.13.5  outdated
pep8              ==1.6.1   1.6.2   outdated
pre_commit        ==0.5.4   0.5.5   outdated
py                ==1.4.26  1.4.30  outdated
pyflakes          ==0.8.1   0.9.2   outdated
pytest            ==2.7.1   2.7.2   outdated
simplejson        ==3.0.7   3.8.0   outdated
virtualenv        ==12.1.1  13.1.2  outdated
----------------  --------  ------  --------
Grabbing this to work on Tuesday. I think I'll do it in three groups:

1. dev environment and testing required libs
2. libs that are small (e.g. polib)
3. everything else

I might do the third group one at a time.

I suspect this will take a couple of days, but we'll see. If there are any code changes involved, they'll need to go through review. We might want to spin those off into separate bugs. We'll do that as needed.
Assignee: nobody → willkg
Status: NEW → ASSIGNED
Whiteboard: p=2 s=input.2015q3
I spun off dev/testing requirement updates into a separate bug and marked it mentored.

I'll tackle the main requirements in this bug.
Updated translation-related requirements.

Babel                  ==1.3      2.0         outdated
dennis                 ==0.4.3    0.6.1       outdated
polib                  ==1.0.3    1.0.7       outdated
pytz                   ==2013.9   2015.4      outdated
translate-toolkit      ==1.11.0   1.13.0      outdated

In a PR: https://github.com/mozilla/fjord/pull/662

Landed in master: https://github.com/mozilla/fjord/commit/fa19bb80f1b36bea54a886ee10dfd37c9e948300

Pushed to production just now.
Updating testing/dev related requirements:

    cssselect: 0.7.1 -> 0.9.1
    django-eadred: 0.2 -> 0.3
    factory-boy: 2.4.1 -> 2.5.2
    mock: 1.0.1 -> 1.3.0
    pyquery: 1.2.1 -> 1.2.9

In a PR: https://github.com/mozilla/fjord/pull/663

Landed in master: https://github.com/mozilla/fjord/commit/4558396f254d678190ddd3739dbc86ba3d556df5

There are no server-affecting changes there, so I don't need to deploy that.
django-appconf is no longer maintained. I wrote up a bug to covers switching to something else. In the meantime, I'm going to leave it as is.

This batch should be straight-forward updates:

    chardet: 2.2.1 -> 2.3.0 (moved to vendor/src/, too)
    django-extensions: 1.3.3 -> 1.5.6
    django-pipeline: 1.5.2 -> 1.5.4
    tldextract: 1.3.1 -> 1.7.1 (moved to vendor/src/, too)

In a PR: https://github.com/mozilla/fjord/pull/664

Landed in master: https://github.com/mozilla/fjord/commit/e77753a83c5f39e7a71f20ae2cd20f680ce3375b

I pushed it to stage and stage died with an ISE. Turns out mock needs to be in a distributed form and doesn't work well from a git checkout (I don't know why--didn't look into it). I moved it back to vendor/packages/.

In a PR: https://github.com/mozilla/fjord/pull/665

Landed in master: https://github.com/mozilla/fjord/commit/bce51eda3e68c3a69c9cf5588c7817be7e244828

Now I'm hitting some weird error on -stage. I opened up a bug with webops to look into it. Blocked on that.
-stage got fixed.

But mock still had problems, so I reverted it.

In a PR: https://github.com/mozilla/fjord/pull/666

Landed in master: https://github.com/mozilla/fjord/commit/8ab1e9ab4fd86d5d4554c925acff2a1c4fae5dd7

Pushed that to stage and it worked super. Then pushed it to prod.


Did some cleanup for things I already landed.

In a PR: https://github.com/mozilla/fjord/pull/667

Landed in master: https://github.com/mozilla/fjord/commit/aba529f813cb38186b7e8bb6e92014b8b6751b96


Updated security-related libraries

bleach                 ==1.4      1.4.1
certifi                ==1.0.0    2015.9.6.1
commonware             ==0.4.2    0.4.3

In a PR: https://github.com/mozilla/fjord/pull/668

Landed in master: https://github.com/mozilla/fjord/commit/b4b040c78ee4baefbb2b4e306b918b7d88218036

Pushed to stage. Ran the smoketests. Pushed to prod.
Upgraded html5lib, statsd and django-statsd.

In a PR: https://github.com/mozilla/fjord/pull/669

Landed in master: https://github.com/mozilla/fjord/commit/5e57c8431de7614fb7d6b011653417f5f9a26987

I'll push it tomorrow.

Then I think I'm going to spin the rest of the items off into separate bugs and update them more methodically.
Pushed the last changes to stage, ran smoketests, then pushed to prod.

The remaining libs are these:

python-memcached       ==1.48     1.57        outdated
djangorestframework    ==3.1.3    3.2.3       outdated
django-ratelimit       ==0.4.0    0.6.0       outdated
elasticsearch          ==1.2.0    1.6.0       outdated
gengo                  ==0.1.19   0.1.26      outdated
urllib3                ==1.8      1.12        outdated
python-dateutil        ==1.5      2.4.2       outdated
django-picklefield     ==0.3.1    0.3.2       outdated


might be able to ditch:
GitPython              ==0.1.7    1.0.1       outdated  (Might be able to ditch this.)


Plus I just say jingo-minify floating around still. That can be removed. That might be the only user of GitPython, so we might be able to remove both.


Removing jingo-minify in PR: https://github.com/mozilla/fjord/pull/670

Landed in master: https://github.com/mozilla/fjord/commit/6f0a38ee00ec54f2b302b50172e96254ae1c2b77

Pushed to stage and prod just now.
No longer blocks: 1203126
Depends on: 1203126
No longer blocks: 1203117
Depends on: 1203117
No longer blocks: 1203118
Depends on: 1203118
No longer blocks: 1203119
Depends on: 1203119
No longer blocks: 1203120
Depends on: 1203120
No longer blocks: 1203121
Depends on: 1203121
I created bugs for the outstanding libraries. We'll deal with them one at a time. I'll probably tackle the django libraries now and push the rest off until later.
New quarter!
Whiteboard: p=2 s=input.2015q3 → p=2 s=input.2015q4
I'm unassigning myself from this. I'm not going to get to it before I transition off.
Assignee: willkg → nobody
Status: ASSIGNED → NEW
I'm going to hazard a guess that this is no longer applicable, since we just decom'd Input in favor of a survey site.
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → WONTFIX
Product: Input → Input Graveyard
You need to log in before you can comment on or make changes to this bug.